Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API
фото показано с : cryptoslate.com

2024-11-22 15:08

Yu Xian, founder of the blockchain security firm Slowmist, has raised alarms about a rising threat known as AI code poisoning.

This attack type involves injecting harmful code into the training data of AI models, which can pose risks for users who depend on these tools for technical tasks.

The incident

The issue gained attention after a troubling incident involving OpenAI’s ChatGPT. On Nov. 21, a crypto trader named “r_cky0” reported losing $2,500 in digital assets after seeking ChatGPT’s help to create a bot for Solana-based memecoin generator Pump.fun.

However, the chatbot recommended a fraudulent Solana API website, which led to the theft of the user’s private keys. The victim noted that within 30 minutes of using the malicious API, all assets were drained to a wallet linked to the scam.

[Editor’s Note: ChatGPT appears to have recommended the API after running a search using the new SearchGPT as a ‘sources’ section can be seen in the screenshot. Therefore, it does not seem to be a case of AI poisoning but a failure of the AI to recognize scam links in search results.]

AI scam link API (Source: X)

Further investigation revealed this address consistently receives stolen tokens, reinforcing suspicions that it belongs to a fraudster.

The Slowmist founder noted that the fraudulent API’s domain name was registered two months ago, suggesting the attack was premeditated. Xian furthered that the website lacked detailed content, consisting only of documents and code repositories.

While the poisoning appears deliberate, no evidence suggests OpenAI intentionally integrated the malicious data into ChatGPT’s training, with the result likely coming from SearchGPT.

Implications

Blockchain security firm Scam Sniffer noted that this incident illustrates how scammers pollute AI training data with harmful crypto code. The firm said that a GitHub user, “solanaapisdev,” has recently created multiple repositories to manipulate AI models to generate fraudulent outputs in recent months.

AI tools like ChatGPT, now used by hundreds of millions, face increasing challenges as attackers find new ways to exploit them.

Xian cautioned crypto users about the risks tied to large language models (LLMs) like GPT. He emphasized that once a theoretical risk, AI poisoning has now materialized into a real threat. So, without more robust defenses, incidents like this could undermine trust in AI-driven tools and expose users to further financial losses.

The post Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API appeared first on CryptoSlate.

origin »

Bitcoin price in Telegram @btc_price_every_hour

Gene Source Code Chain (GENE) на Currencies.ru

$ 0 (+0.00%)
Объем 24H $0
Изменеия 24h: 0.00 %, 7d: -0.22 %
Cегодня L: $0 - H: $0
Капитализация $0 Rank 99999
Доступно / Всего 375.245m GENE

code blockchain poisoning security firm models data

code blockchain → Результатов: 126


Sui Sees Record Inflow Following Network Downtime: Can This Save SUI Falling Price?

Attention has been on SUI following its network downtime on Thursday. The SUI blockchain experienced its first network outage caused by a bug in the congestion control code. According to a post by the network developers, this control code was recently upgraded to allow for better-shared object utilization, but it is clear that some work […] The post Sui Sees Record Inflow Following Network Downtime: Can This Save SUI Falling Price? appeared first on CaptainAltcoin.

2024-11-22 17:15


ChainUp subsidiary, Top Value and Huobi Asset Management launch one-of-a-kind blockchain mining fund

ChainUp Group’s subsidiary Top Value is pleased to announce a partnership with Huobi Technology Holdings Limited (Stock code: 1611.HK)’s wholly-owned subsidiary Huobi Asset Management (Hong Kong)The post ChainUp subsidiary, Top Value and Huobi Asset Management launch one-of-a-kind blockchain mining fund appeared first on AMBCrypto.

2022-4-28 14:00


Фото:

Vertex Events to Organize 3 Days Blockchain Summit in February 2022

Vertex Events has organized 3 Blockchain events during 2020 with renowned International Blockchain experts and renowned projects & sponsors like TDeFi, Lukka, Lbank & Code Viral etc. Recently we have organized India-UAE Partnership Summit & Business Leadership Awards under your kind patronage Sheikh Nahayan Mabarak Al Nahayan on 15th November 2021 and the event wasRead More

2021-12-18 08:00


Blockchain finance platform SETL open sources its code

SETL, a London-based blockchain company, today announced that it is open-sourcing its core framework, PORTL, in an effort to speed up the adoption of blockchain and DLT solutions. PORTL provides a permission-based toolset for financial institutions to build applications that interoperate between existing infrastructures and a range of enterprise ledger technologies including Corda, Besu, Fabric, […] The post Blockchain finance platform SETL open sources its code appeared first on CryptoNinjas.

2021-10-28 19:10


Cross-chain platform Biconomy live on Moonriver to offer gasless transactions to dApp devs

Biconomy, a cross-chain transaction infrastructure platform, announced today integration with Moonriver, an Ethereum-compatible smart contract blockchain environment on the Kusama (KSM) network. Moonriver is intended to function as the “canary network” for Moonbeam on Polkadot, meaning that the new code would ship to Moonriver first, where it can be tested and verified under real economic […] The post Cross-chain platform Biconomy live on Moonriver to offer gasless transactions to dApp devs appeared first on CryptoNinjas.

2021-9-22 23:07


HashEx: 20 Million Users Might Be Threatened by SafeMoon’s Critical Vulnerabilities

The SafeMoon DeFi protocol is the latest project to have vulnerabilities revealed in its smart contract code. A recent audit conducted by analysts from HashEx, a blockchain security consulting firm, has revealed that 12 critical vulnerabilities are placing the funds of over 20 million users and the protocol with over $3.5 billion in market capitalization […]

2021-5-26 14:05


$45M Gone in a Flash Loan Attack: How Scammers Exploited Vulnerabilities in Pancake Bunny’s Smart Contract Code

CryptoNinjas » $45M Gone in a Flash Loan Attack: How Scammers Exploited Vulnerabilities in Pancake Bunny’s Smart Contract Code In its latest Hack Track article, Merkle Science, a blockchain monitoring and investigation platform published a summary describing in plain English what happened, who was affected, and what does it mean for the future of flash loans and DeFi?  Earlier today, DeFi yield farming aggregator, Pancake Bunny, suffered a flash loan attack with the attacker making off with […] CryptoNinjas » $45M Gone in a Flash Loan Attack: How Scammers Exploited Vulnerabilities in Pancake Bunny’s Smart Contract Code

2021-5-21 00:18