AI Incident Database #736 · 2023-12-01
Underground Market for LLMs Powers Malware and Phishing Scams
A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites.
- Risk class (MIT)
- Cyberattacks, weapon development or use, and mass harm
- Reports
- 2
- Developers and deployers named
- 11
On ShieldMap: OpenAI (named by AIID as a developer or deployer).
Reports
- FraudGPT and other malicious AIs are the new frontier of online threats. What can we do? · theconversation.com, 2024-07-23
- Studying Underground Market for Large Language Models, Researchers Find OpenAI Models Power Malicious Services · techpolicy.press, 2024-01-19
Title and description from the AI Incident Database (incidentdatabase.ai), snapshot of 2026-11-16, shared under CC BY-SA 4.0. Selected incidents; descriptions shortened; harmed parties and report text left out. The description is AIID's summary of what was reported, not ShieldPi's finding.