3-Day Course · Hands-on
Advanced · 3-Day

AI Red Teaming and Adversarial Testing

Attack LLMs and agents the way real adversaries do, then prove your defenses hold, across three hands-on days.

Course code RED-5413 days hands-onGPU-backed labs
Red Team Jailbreaks Adversarial ML
You will be able to

What you can do after the course

RED-541. The syllabus

Three days, from threat model to report

Classes are custom built from the following learning modules. (Times are approximate.) Custom formats from 2 to 5 days available.

Reconnaissance and Target Profiling

Map Before You Attack

100-00 AI System Reconnaissance 1 hr

Fingerprinting AI systems from the outside: identifying model providers, inferring model versions from response patterns, enumerating available tools and capabilities, and mapping the AI attack surface before you touch a prompt.

100-01 Threat Modeling for Red Teams 1 hr

Building the attack plan. What are the high-value targets (training data, PII, internal tools, payment functions, admin capabilities)? What trust boundaries exist? Where are the weakest points? We build a threat model that drives the engagement, not a generic checklist.

100-02 Rules of Engagement for AI Red Teams 0.5 hr

Scope, authorization, data handling and the ethical boundaries of AI red teaming. What you can and cannot do with extracted data. Responsible handling of jailbreak techniques.

Prompt Injection

The Core Attack Technique

101-00 Direct Prompt Injection Fundamentals 1.5 hrs

Hands on: the core injection techniques. Role override, instruction smuggling, delimiter escape, encoding bypass (base64, rot13, unicode tricks) and multi-turn state manipulation. We attack a live target and observe what works, what fails and why.

101-01 Indirect Prompt Injection 1.5 hrs

Hands on: inject payloads through data the model retrieves rather than through the user prompt. Poisoned documents in RAG, malicious tool responses, hidden instructions in web pages and email content. The attack surface where the user never typed the injection.

101-02 Advanced Injection Techniques 1 hr

Payload obfuscation, token-level attacks, few-shot poisoning, system prompt extraction and context window manipulation. The techniques that bypass first-generation defenses.

Jailbreaks and Guardrail Evasion

Systematic Bypass

102-00 Jailbreak Taxonomy 1 hr

The categories of jailbreak that work today: roleplay (DAN, character assumption), hypothetical framing, encoding and language switching, multi-turn escalation and social engineering the model. We test each category against live targets.

102-01 Guardrail Testing Methodology 1.5 hrs

Hands on: systematically test guardrails rather than throwing random prompts. Build a test matrix: categories of restricted content, categories of evasion technique, and the cross-product that tells you which guardrails hold and which do not. Produce a coverage report.

102-02 Automated Jailbreak Testing with Promptfoo 1 hr

Hands on: configure and run promptfoo against a live target. Write test cases, define success criteria, run the suite and interpret the results.

Data Extraction and Model Attacks

Pull What the Model Knows

103-00 Training Data Extraction 1 hr

Hands on: attempt to extract training data from a model. Verbatim memorization probes, membership inference and canary detection. What the model remembers and how to surface it.

103-01 System Prompt Extraction 1 hr

Hands on: extract the system prompt from a deployed model. Direct extraction, indirect inference and the side channels that leak system instructions even when the model is told not to reveal them.

103-02 Model Stealing and API Abuse 1 hr

Querying a model systematically to build a functional copy. Distillation attacks, output harvesting and what rate limiting and output controls actually prevent.

103-03 Adversarial Examples and Evasion 1 hr

Crafting inputs that cause the model to misclassify, misinterpret or produce incorrect output. Adversarial suffixes, perturbation attacks and the gap between academic adversarial ML and practical red teaming.

Agent and Tool Attacks

When the Model Has Hands

104-00 Agent Privilege Escalation 1.5 hrs

Hands on: escalate an agent's effective privileges. Manipulate the agent into calling tools it should not call, accessing data outside its scope, or performing actions above its trust level. Confused deputy attacks in an agent context.

104-01 Tool Poisoning and Rug-Pulls 1 hr

Hands on: poison tool descriptions to make the agent do something the tool owner controls. Change tool behaviour between listing and invocation. Inject through tool responses.

104-02 Multi-Agent Attack Chains 1 hr

When agents talk to other agents, the attack surface multiplies. Compromise one agent and use it to manipulate others through the delegation chain. Scope escalation across agent boundaries.

104-03 MCP Attack Techniques 1 hr

Hands on: attack MCP servers using the techniques from the CVE case studies. Replay, DoS (CVE-2026-39313), unauthenticated enumeration, tool rug-pulls and injection through tool responses. dvmcp

Red Team Tooling

Promptfoo, Garak, PyRIT and Custom

105-00 Promptfoo for Red Teams 1 hr

Hands on: advanced promptfoo usage. Custom providers, adversarial plugins, grading functions and CI integration. Building a promptfoo test suite that runs as part of your red team engagement.

105-01 Garak 1 hr

Hands on: configure and run garak (the NVIDIA LLM vulnerability scanner) against a target. Understand its probe categories, interpret results and integrate findings into your report.

105-02 PyRIT 1 hr

Hands on: Microsoft's Python Risk Identification Toolkit. Multi-turn attack orchestration, automated jailbreak chains and scored evaluation. When to use PyRIT vs promptfoo vs garak.

105-03 Custom Attack Tooling 0.5 hr

When the tools do not cover your target. Writing custom attack scripts, building prompt mutation engines and the discipline of logging every attempt for the report.

Reporting and Handoff

Findings That Defenders Can Fix

106-00 Writing AI Red Team Findings 1 hr

Finding structure: attack technique, reproduction steps, impact assessment, AISVS control mapping and OWASP LLM Top 10 mapping. Writing findings that defenders can fix, not just read.

106-01 The Red Team Report 1 hr

Report structure for AI red team engagements. Executive summary, scope, methodology, findings by severity, and recommendations. What to include, what to redact and how to handle sensitive findings.

106-02 Handoff to Defenders 0.5 hr

Working with the blue team and the AI engineering team after the engagement. Reproducing findings, verifying fixes and the re-test cycle.

Labs

Hands-On Attack Labs

107-00 Full Red Team Lab 3 hrs

Attack a complete AI system (LLM + RAG + agents + MCP tools) end to end. Reconnaissance, injection, jailbreak, data extraction, agent escalation and tool poisoning. Produce a scored findings report. dvmcp dvrag

107-01 Guardrail Bypass Lab 2 hrs

Systematic guardrail testing against a hardened target. Build the test matrix, run automated and manual attacks, document which guardrails hold and which break.

107-02 Agent Attack Lab 2 hrs

Red-team an agent estate. Escalate privileges, manipulate delegation chains, exfiltrate data through tool calls and produce the evidence for each finding.

~38 hrs
Total instructional hours
32
Individual modules across 8 sections
2-5 days
Flexible delivery
The toolchain

Tools and labs you will use

Hands-on with the CyberSecAI tooling, not slideware.

PromptProbe

Jailbreak and injection fuzzer with a payload corpus and pass/fail scoring.

LLMoney

LLM forensic auditor used to strip guardrail layers and probe an unguarded model in the lab.

Claw

Static scanner running the OWASP-standards check set.

DVRAG and DVMCP

The vulnerable RAG and MCP targets you attack.

Who it is for

Built for the people testing AI

Security engineers

Add AI attack surface and adversarial testing to your remit.

AppSec

Bring application security discipline to LLMs and agents.

ML engineers

See how your models fail under adversarial pressure, and fix it.

Penetration testers

Move into AI targets with methods and tooling that carry over.

AI red teams

Sharpen a structured, repeatable practice with a full toolchain.

GPU-backed labs

Hands-on, attacking live models and agents

No slideware. You attack real LLMs and agents on live instances backed by cloud GPUs, reproduce the paths you find, and prove which defenses hold and which do not.

The certification

Counts toward the AISVS assurance track

This course counts toward the CyberSecAI AISVS assurance track. Assessment is practical: you run a structured red-team against a live LLM or agent, reproduce the injection, jailbreak and tool-abuse paths you find, measure the adversarial-ML exposure, and write the report that engineering can act on.

Reserve a place

Attack it, then prove your defenses hold.

Three days, hands-on, attacking live models and agents, taught by the former OWASP-AISVS Co-Leader (v1.0). Places are limited.

3 days intensive, hands-on GPU-backed labs Private corporate cohorts available
Reserve a Place

Corporate & sovereign cohorts, and bespoke on-site delivery, on request.