Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API

Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API
фото показано с : cryptoslate.com

2024-11-22 15:08

Yu Xian, founder of the blockchain security firm Slowmist, has raised alarms about a rising threat known as AI code poisoning.

This attack type involves injecting harmful code into the training data of AI models, which can pose risks for users who depend on these tools for technical tasks.

The incident

The issue gained attention after a troubling incident involving OpenAI’s ChatGPT. On Nov. 21, a crypto trader named “r_cky0” reported losing $2,500 in digital assets after seeking ChatGPT’s help to create a bot for Solana-based memecoin generator Pump.fun.

However, the chatbot recommended a fraudulent Solana API website, which led to the theft of the user’s private keys. The victim noted that within 30 minutes of using the malicious API, all assets were drained to a wallet linked to the scam.

[Editor’s Note: ChatGPT appears to have recommended the API after running a search using the new SearchGPT as a ‘sources’ section can be seen in the screenshot. Therefore, it does not seem to be a case of AI poisoning but a failure of the AI to recognize scam links in search results.]

AI scam link API (Source: X)

Further investigation revealed this address consistently receives stolen tokens, reinforcing suspicions that it belongs to a fraudster.

The Slowmist founder noted that the fraudulent API’s domain name was registered two months ago, suggesting the attack was premeditated. Xian furthered that the website lacked detailed content, consisting only of documents and code repositories.

While the poisoning appears deliberate, no evidence suggests OpenAI intentionally integrated the malicious data into ChatGPT’s training, with the result likely coming from SearchGPT.

Implications

Blockchain security firm Scam Sniffer noted that this incident illustrates how scammers pollute AI training data with harmful crypto code. The firm said that a GitHub user, “solanaapisdev,” has recently created multiple repositories to manipulate AI models to generate fraudulent outputs in recent months.

AI tools like ChatGPT, now used by hundreds of millions, face increasing challenges as attackers find new ways to exploit them.

Xian cautioned crypto users about the risks tied to large language models (LLMs) like GPT. He emphasized that once a theoretical risk, AI poisoning has now materialized into a real threat. So, without more robust defenses, incidents like this could undermine trust in AI-driven tools and expose users to further financial losses.

The post Blockchain security firm warns of AI code poisoning risk after OpenAI’s ChatGPT recommends scam API appeared first on CryptoSlate.

origin »

Bitcoin price in Telegram @btc_price_every_hour

Gene Source Code Chain (GENE) на Currencies.ru

$ 0 (+0.00%)
Объем 24H $0
Изменеия 24h: 0.00 %, 7d: -0.22 %
Cегодня L: $0 - H: $0
Капитализация $0 Rank 99999
Доступно / Всего 375.245m GENE

code blockchain poisoning security firm models data

code blockchain → Результатов: 126


Sui Sees Record Inflow Following Network Downtime: Can This Save SUI Falling Price?

Attention has been on SUI following its network downtime on Thursday. The SUI blockchain experienced its first network outage caused by a bug in the congestion control code. According to a post by the network developers, this control code was recently upgraded to allow for better-shared object utilization, but it is clear that some work […] The post Sui Sees Record Inflow Following Network Downtime: Can This Save SUI Falling Price? appeared first on CaptainAltcoin.

2024-11-22 17:15


ChainUp subsidiary, Top Value and Huobi Asset Management launch one-of-a-kind blockchain mining fund

ChainUp Group’s subsidiary Top Value is pleased to announce a partnership with Huobi Technology Holdings Limited (Stock code: 1611.HK)’s wholly-owned subsidiary Huobi Asset Management (Hong Kong)The post ChainUp subsidiary, Top Value and Huobi Asset Management launch one-of-a-kind blockchain mining fund appeared first on AMBCrypto.

2022-4-28 14:00


Blockchain Payment Processor BitPay And Poynt Enable Crypto Payments at POS Terminals

The blockchain payments provider BitPay has closed a partnership with Poynt, the world’s first open commerce platform, to make crypto payments possible at point-of-safe (POS) terminals. The announcement was made on Tuesday, in a press release that reads: “With just the scan of a QR code at checkout, consumers can now pay merchants using Poynt’s devices […]

2020-2-12 22:09


nOS blockchain app and development portal launches public testnet

nOS, a blockchain platform with built-in DApp store allowing for fair and transparent distribution and discovery of web-apps, announced today the official launch of the nOS public testnet. Users can now test the blockchain’s latest features such as staking testnet NOS, vote for validators, build blockchain code and applications, launch validator nodes and collect block […] CryptoNinjas: nOS blockchain app and development portal launches public testnet

2020-2-7 13:57