Academy module 8 · ISO/IEC 27090 · Lesson 8 of 8
Investigate AI-specific security signals
About 8 minutes · Introductory draft · Checked 2026-10-23
AI-authored and AI editorially reviewed; independent review pending. Read course scope and remaining gaps.
Session only. Enable saving or download a backup from this course’s hub.
Completion is self-reported and does not certify understanding.
See it · Try it · Recall it
Picture the topic
Remember this: Observe the behavior, preserve the version, then test the hypothesis.
Explore the anchors
Collect relevant protected observations.
Concept matching activity
Match this task or description to its concept:
Correlate data model and service evidence.
Choose a concept before checking the explanation.
Detection laboratory
Positive means the detector raised an alert. True/false compares that decision with known reality.
False negative — An attack exists. No alert was raised.
| Detector | Attack present | No attack |
|---|---|---|
| Alert | True positive | False positive |
| No alert | False negative | True negative |
Change the threshold
Eight fictional events have fixed known truth. An alert fires when the synthetic score is at least the threshold. The score is not a probability of attack.
TP 2 · FP 1 · FN 2 · TN 3. Precision 67%. Recall 50%.
Precision = TP ÷ (TP + FP). Recall = TP ÷ (TP + FN). Lower thresholds can increase detection and false alarms; this tiny dataset does not establish real-world performance.
A quick way to study this topic
- Hide the explanation and redraw these three anchors from memory.
- Explain the difference between the anchors in your own words.
- Apply the distinction to the worked example below. Check the full lesson for assumptions and exceptions.
- Recall it again tomorrow, then after a few days. A memory hint is a retrieval cue, not a replacement for understanding.
Original academy illustrations and fictional exercises. These are learning simulations, not a real virtual machine, network assessment or measure of job readiness. Activities reset when you leave or reload; they do not change quiz scores.
What you will learn
- Collect relevant protected observations.
- Correlate data model and service evidence.
- Contain safely and validate recovery.
Concepts and distinctions
AI-security observations can include unusual inference patterns, unexpected output changes, model-store access, data-pipeline modifications and tool actions outside normal use. A changed output may reflect a malicious input, an authorized update, random variation or a data-quality problem. Preserve relevant context before deciding which hypothesis the evidence supports.
Monitoring needs defined use cases, known limitations and an operating response route. A detector’s false positives and misses affect workload and risk. Do not interpret confidence scores as proof of a named attacker or use a few synthetic events to claim measured production effectiveness. Logs also need proportionate retention, access control and privacy protection.
Apply the process and collect evidence
Record the model and configuration version, relevant data lineage, timestamps and affected service state. Use approved containment options that consider business and safety consequences. Coordinate model, data, operations, security and privacy owners. Validate a trusted recovery state and test whether the identified failure path is addressed before reopening the same workflow.
Work through a scenario
Fictional facts for learning. This exercise is not scored.
An assistant begins exposing unexpected document fragments after a model-service update. The first responder wants to delete all stored prompts and immediately retrain the model.
Compare your reasoning
Preserve authorized evidence and relevant versions, restrict the exposed path under response authority and investigate competing explanations. Deleting records or retraining before investigation can destroy useful evidence and introduce another unreviewed change. Apply retention and privacy requirements while preserving necessary facts.
Remember
- Observe the behavior, preserve the version, then test the hypothesis.
- Collect relevant protected observations.
- Contain safely and validate recovery.
Orientation and further reading
- ISO: ISO/IEC 27090:2026 · Published AI-security guidance
- NIST AI 100-2 E2025: adversarial machine learning
Original examples and explanations. Background references do not establish complete exam coverage.
Try ISO/IEC 27090 practice questions · Report a content correction