AML.T0137.002
Training Data Information from AI Models: Invert AI Model
Adversaries may infer sensitive aggregate attributes or reconstruct representative examples of data used to train or fine-tune a target AI model by analyzing its behavior, outputs, or exposed representations.
- Tactic Collection
- Maturity: Feasible
- Predictive AI
- Predictive AI Output ObfuscationAML.M0002
Reduce the fidelity and amount of information returned by predictive AI inference endpoints to make model discovery, extraction, replication, and black-box adversarial-example optimization more difficult.
Technical - AI
- Limit AI Service Query Volume and RateAML.M0004
Limit the number and rate of requests that users can submit to an AI service. Apply limits by user, API key, tenant, device, or other authenticated identity. Use short-term rate, burst, and concurrency limits together with longer-term usage quotas.
Technical - Cyber
- Validate AI ModelAML.M0008
Evaluate AI models against defined functional requirements before deployment and throughout their operational lifecycle. Validate newly trained or acquired models and repeat evaluation after fine-tuning, model updates, or changes to the conditions in which the model is used.
Technical - AI
- AI Telemetry Logging and MonitoringAML.M0024
Implement logging and monitoring across the AI lifecycle to detect suspicious activity and support investigation. Capture security-relevant access, changes, and operations across data pipelines, model development, deployment, and connected systems.
Technical - Cyber
- AI Red TeamAML.M0035
Establish an AI red team responsible for conducting recurring, authorized, and threat-informed red-teaming exercises to identify and remediate vulnerabilities in AI-enabled systems before deployment and throughout operation.
Policy · Technical - AI · Technical - Cyber
- Adaptive AI Response DegradationAML.M0040
Reduce the utility of AI model outputs for unauthorized model replication, knowledge distillation, or inference about training data by dynamically modifying responses when suspected extraction activity or privacy attacks are detected.
Technical - AI
- Privacy-Preserving AI Training and InferenceAML.M0041
Use privacy-preserving mechanisms throughout model training and inference to limit disclosure of sensitive training or inference data. These mechanisms can reduce the risk that model outputs reveal sensitive information, such as individual training records, and can also protect sensitive training data from exposure to model developers or operators.
Technical - AI
From MITRE ATLAS 2026.10, Copyright 2021-2026 MITRE, Apache License 2.0.