UTC

AI Incident Database #736 · 2023-12-01

Underground Market for LLMs Powers Malware and Phishing Scams

A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites.

Risk class (MIT)
Cyberattacks, weapon development or use, and mass harm
Reports
2
Developers and deployers named
11

On ShieldMap: OpenAI (named by AIID as a developer or deployer).

All 2 reports and the full entry on the AI Incident Database →

Title and description from the AI Incident Database (incidentdatabase.ai), snapshot of 2026-11-16, shared under CC BY-SA 4.0. Selected incidents; descriptions shortened; harmed parties and report text left out. The description is AIID's summary of what was reported, not ShieldPi's finding.