AI Incident Database #552 · 2023-06-22
Bing Chat Solved CAPTCHAs with Image Analysis Feature Despite Safeguards
Microsoft was reported by a Twitter user for deploying image analysis feature capable of solving CAPTCHAs for its GPT-based chatbot despite it being safeguarded against solving them for users.
- Risk class (MIT)
- AI system security vulnerabilities and attacks
- Reports
- 1
- Developers and deployers named
- 2
On ShieldMap: Microsoft, OpenAI (named by AIID as a developer or deployer).
Reports
- Tweet: @sayashk · twitter.com, 2023-06-22
Title and description from the AI Incident Database (incidentdatabase.ai), snapshot of 2026-11-16, shared under CC BY-SA 4.0. Selected incidents; descriptions shortened; harmed parties and report text left out. The description is AIID's summary of what was reported, not ShieldPi's finding.