UTC

AI Incident Database #552 · 2023-06-22

Bing Chat Solved CAPTCHAs with Image Analysis Feature Despite Safeguards

Microsoft was reported by a Twitter user for deploying image analysis feature capable of solving CAPTCHAs for its GPT-based chatbot despite it being safeguarded against solving them for users.

Risk class (MIT)
AI system security vulnerabilities and attacks
Reports
1
Developers and deployers named
2

On ShieldMap: Microsoft, OpenAI (named by AIID as a developer or deployer).

Reports
All 1 report and the full entry on the AI Incident Database →

Title and description from the AI Incident Database (incidentdatabase.ai), snapshot of 2026-11-16, shared under CC BY-SA 4.0. Selected incidents; descriptions shortened; harmed parties and report text left out. The description is AIID's summary of what was reported, not ShieldPi's finding.