Air Force Logo
Thundercats Logo
All incident types

Model Exfiltration Drill

Weights, adapters, or a functional copy of a model leaving the environment, either downloaded directly or distilled out through the API.

3 scenarios in this pool

3:12 AM: Systematic Model Extraction via Inference API: Threshold Breach on Token Entropy & Request Volume

The target system is a production inference API serving a fine-tuned LLaMA-3 70B model, hosted on a Kubernetes cluster in AWS us-east-1. The model was fine-tuned on proprietary enterprise data and represents significant IP. You are an on-call ML security analyst for a SaaS company that licenses this model's capabilities to enterprise customers.

Alert

SIEM Rule "ML_EXTRACT_003" fired at 03:12:07 UTC. Single API key (key_id: cust-4471-prod) issued 14,382 inference requests over 47 minutes, 98th percentile baseline is 340 req/hr for this customer tier. Mean input token length: 6.3 tokens ("What is", "Define", "Explain", "Output the"). Mean output token length: 847 tokens. Response entropy variance is abnormally LOW (sigma=0.04 vs. baseline sigma=0.31), consistent with structured probing. Egress volume: 2.3 GB from inference endpoint in session. Source IPs: 3 addresses across AS14061 (DigitalOcean), rotating every ~900 seconds. No WAF blocks triggered.

ATLAS mapping: AML.T0016
Step 1 of 6

Your first action at 3:12 AM is to triage the severity of this alert. Which factor most strongly indicates this is a model extraction attempt rather than a runaway automation bug or misconfigured integration?