AML.T0063
Discover AI Model Outputs
Adversaries may discover what information an AI model or service exposes through its outputs. They may investigate both the intended responses and additional model-generated information exposed through the surrounding application.
- Tactic Discovery
- Maturity: Realized
- Predictive AI
- Generative AI
- Agentic AI
- Predictive AI Output ObfuscationAML.M0002
Reduce the fidelity and amount of information returned by predictive AI inference endpoints to make model discovery, extraction, replication, and black-box adversarial-example optimization more difficult.
Technical - AI
- Encrypt Sensitive InformationAML.M0012
Encrypt sensitive data such as AI models to protect against adversaries attempting to access sensitive data.
Technical - Cyber
- AI Model Distribution MethodsAML.M0017
Deploying AI models to edge devices can increase the attack surface of the system. Consider serving models in the cloud to reduce the level of access the adversary has to the model. Also consider computing features in the cloud to prevent gray-box attacks, where an adversary has access to the model preprocessing methods.
Policy
- Control Access to AI Models and Data in ProductionAML.M0019
Require users to verify their identities before accessing a production model. Require authentication for API endpoints and monitor production model queries to ensure compliance with usage policies and to prevent model misuse.
Policy
From MITRE ATLAS 2026.10, Copyright 2021-2026 MITRE, Apache License 2.0.