AI Security Curriculum — FreakLabs Academy
A 9-level, 54-lesson curriculum on how AI systems fail and how to test them, from prompt injection through agents, supply chain, and red team practice.
-
LLM Fundamentals — How the Machine Works
- Text Becomes Tokens
- Attention: Every Token Sees Every Token
- Can't Versus Won't
- The Transcript Is the Program
- The Trust Boundary That Isn't There
- Threat-Modelling an AI System
-
Injection & Jailbreaks — Making It Say Things
- Four Axes of a Prompt Attack
- Multi-Turn Escalation
- Encoding and Obfuscation
- Jailbreak Versus Injection
- Extracting the System Prompt
- Writing a Prompt That Survives Being Read
-
Output Attacks — Making It Do Things to Your Users
- Model Output Is Untrusted Input
- Markup Injection Through Generated Output
- Query and Command Injection Through Generated Code
- Request Forgery Through Generated URLs
- Encoding at the Sink
- Schema-Valid and Hostile
-
RAG & Retrieval Security — Making It Read the Wrong Thing
- Indirect Injection
- Delivery Channels: Image, Audio, Cross-Modal
- Similarity Is Not Trust
- Retrieval Access Control and Provenance
- Ingestion Security
- Rates, Not Verdicts
-
Model & Data Attacks — Taking the Model Itself
- Memorisation and Extraction
- Membership Inference
- Model Inversion and Attribute Inference
- Model Extraction and Theft
- Poisoning and Backdoors
- Differential Privacy and the Privacy–Utility Curve
-
Agentic Security — Making It Act
- What Changes When a Model Has Tools
- The Confused Deputy and Least Agency
- Memory, Persistence, and Dormant Compromise
- Tool Design: Making the Dangerous Unrepresentable
- Trust Between Agents and Cascade Failure
- Approval Gates People Actually Read
-
Supply Chain & Infrastructure — The Things You Didn't Build
- What You Can and Can't Verify About a Model
- Loaders That Execute
- Dependency Risk in a Fast-Moving Ecosystem
- Connector Protocols and Inherited Trust
- Deployment and Serving Infrastructure
- Inventory: What 'Were We Affected' Costs
-
Detection & Response — Seeing It Happen
- What Compromise Looks Like in Logs
- Tool-Call Telemetry
- Behavioural Baselines
- Exfiltration Channels That Look Like Formatting
- Incident Response for Systems That Act
- Layered Defence, Honestly Rated
-
Red Team Practice — Doing It for Real
- How AI Red Teaming Differs from Pentesting
- Scoping, Authorisation and Rules of Engagement
- Running a Campaign
- Automation and Regression Against a Moving Target
- Reporting That Drives Action
- Frameworks as Maps