Skip to content
Human operators · Real AI systems · No rules

AI and LLM Red Teaming Services

AI red teaming (or LLM red teaming) is the adversarial security testing of AI and LLM systems — human operators attack live models to surface prompt injection, jailbreaks, data leakage, tool/agent abuse and unsafe outputs before attackers do. Berghem red-teams AI systems using the Promptware Kill Chain, OWASP LLM Top 10 and MITRE ATLAS.

4–8 wkTypical duration
7Kill-chain stages
100%Human operators
15/21Incidents with 4+ kill-chain stages
57%Attackers with active persistence
4–8Weeks per campaign
72hSLA for critical findings
Definition

What is AI red teaming

AI red teaming is an offensive exercise with a defined objective — for example, extracting customer data through the assistant, executing an unauthorized transaction via an agent, or poisoning a copilot's long-term memory — conducted against the real system, in production or an equivalent environment, under rules of engagement agreed in writing.

Unlike a scanner or a battery of automated prompts, the campaign is run by people who adapt each step to how the system responds. The operator combines direct and indirect prompt injection, tool and plugin abuse, system prompt extraction, persistence in vector stores, and command-and-control channels hidden in documents retrieved through RAG.

The result is not a list of vulnerabilities: it is a demonstration of which attack chains work end to end against your generative AI, how long each one took, what your SOC saw (or did not see), and which controls would have broken the chain earlier.

Comparison

AI red teaming vs AI pentest

The two services are complementary. AI pentesting measures exposure — how many flaws exist and how severe they are. Red teaming measures resilience — whether an adversary with an objective can reach the end and whether you notice in time.

CriterionAI pentestAI red teaming
Question it answersWhich vulnerabilities exist in my LLM, RAG, plugins and infrastructure?Can a motivated adversary reach a business objective without being detected?
Primary metricExposure: number, severity (CVSS) and OWASP LLM Top 10 category of each findingResilience: complete chains to the objective, time to detection and response effectiveness
ScopeDefined and broad: the ten OWASP LLM Top 10 categories over a bounded systemObjective-driven: any path that reaches the target, including people, processes and integrations
ApproachSystematic and coverage-oriented — finds as many flaws as possible in the contracted timeObjective-oriented — chains flaws like a real attacker, with stealth and persistence
Typical durationAbout 4 weeks, from kickoff to report4–8 weeks, with a continuous exploitation phase
SOC involvementUsually notified; the focus is the system, not detectionTested — optionally in purple team mode, validating detection and response live
Core deliverableVulnerability report with PoC and a prioritized remediation planExecutive and technical report per attack chain, campaign replay and a 90-day plan
When to chooseBefore launch, after relevant changes, or as a periodic controlWhen the system has already been pentested and you need to validate defense, detection and response

Haven't run a pentest yet? Start with the AI and LLM pentest and move up to a Red Team campaign once the basic controls are in production.

Red Team for AI is part of Berghem, the AI security company for AI and LLM systems in Brazil and LATAM.

Methodology

How does an AI red teaming engagement work?

An AI red team engagement moves through four connected stages: reconnaissance, attack scenarios, chaining and reporting. Human operators run every stage — automation only supports them — so the campaign adapts to what your systems actually do instead of following a fixed checklist.

Red teaming an LLM application is not the same as red teaming a network. The attack surface is language: system prompts, retrieved documents, tool descriptions, agent memory and the conversations your users have every day. Our operators treat each of those inputs as a potential entry point and each model output as a potential exit for data or unauthorized actions. The goal is not a list of prompts that make the model misbehave, but a demonstration of what a motivated adversary could achieve against your business — and whether anyone would notice while it happened.

Every engagement starts with a two-day threat modeling workshop with your team. Together we inventory the AI systems in scope, identify the crown jewels an attacker would target — customer data, transaction flows, internal tools, privileged integrations — and agree on adversary objectives, rules of engagement and success criteria. From that point the red team operates as an external attacker would, with a direct channel to your security team open for the whole campaign.

01

Reconnaissance

We map the AI attack surface from the outside in: which models are in use, what the system prompt reveals, which tools and functions the agent can call, which data sources feed the RAG pipeline and which third-party integrations sit behind it. Passive OSINT and active probing establish the starting position of a realistic adversary.

Weeks 1–2Passive + active
02

Attack scenarios

Using the OWASP LLM Top 10 and MITRE ATLAS as coverage maps, we design scenarios tied to the objectives agreed in threat modeling: direct and indirect prompt injection, jailbreaks and guardrail bypass, system prompt and data leakage, tool and function abuse, memory poisoning and supply chain attacks against models and packages.

Weeks 2–3OWASP LLM · ATLAS
03

Chaining

Isolated findings become an operation. Following the Promptware Kill Chain we chain initial access into escalation, reconnaissance, persistence, command-and-control, lateral movement and objective completion — proving impact with canary data rather than real records. This is where red teaming differs from a pentest: we measure how far an attacker gets and whether your detection and response react.

Weeks 3–67-stage kill chain
04

Reporting

Every chain is documented stage by stage with payloads, screenshots, logs and reproducible PoC. You receive an executive report, a technical report, an interactive campaign replay and a 90-day remediation plan, followed by a debrief with your engineering, security and product teams.

Weeks 7–8Debrief + replay
Frameworks

Which frameworks guide our AI and LLM red teaming?

We anchor every campaign to three public references, so findings arrive in a language your security, compliance and engineering teams already share.

FW-01

Promptware Kill Chain

The seven-stage model we use to structure an AI attack from the first prompt injection to objective completion: initial access, escalation, reconnaissance, persistence, command-and-control, lateral movement and objective. It turns isolated prompt tricks into an end-to-end operation that can be measured, detected and replayed.

Read the Promptware Kill Chain guide →

FW-02

OWASP LLM Top 10

The reference list of the most critical risks in LLM applications — prompt injection, sensitive information disclosure, supply chain, data and model poisoning, improper output handling, excessive agency and system prompt leakage among them. We use it as the coverage map for attack scenarios and as the classification for every finding we report.

Read our OWASP LLM Top 10 practical guide →

FW-03

MITRE ATLAS

MITRE's knowledge base of adversary tactics and techniques against AI-enabled systems, structured like MITRE ATT&CK. We map each executed technique to ATLAS so your SOC can build detections and your blue team can compare AI incidents with the rest of the threat landscape.

How we map ATLAS to MITRE ATT&CK →

Frameworks give structure; operators give judgment. The techniques catalogued in OWASP and ATLAS are starting points — the value of a red team lies in combining them against your specific stack, your specific guardrails and your specific business flows.

Campaign phases

Five phases
One coordinated operation

We work like a motivated adversary — not like a scanner. Each phase has clear deliverables, and you follow the operation in real time through our dashboard.

01

Threat modeling

We map your AI stack, identify the crown jewels and define adversary objectives together with your team.

Week 1Workshop · 2 days
02

Reconnaissance

OSINT, attack-surface enumeration, identification of models, plugins, exposed data and third-party integrations.

Week 2Passive + active
03

Exploitation

Promptware Kill Chain activated — prompt injection, escalation, credential harvesting, persistence via agent memory.

Week 3–6Continuous operation
04

Objectives & impact

Lateral movement, simulated exfiltration, compromise of business flows. We document each path with evidence.

Week 6–7Forensic evidence
05

Report & debrief

Executive report, technical walkthrough, campaign replay, and a remediation plan prioritized by impact.

Week 8Executive session
Methodology

Methodology: OWASP LLM Top 10 and MITRE ATLAS

Every campaign is planned on two public references: the OWASP Top 10 for LLM Applications, which classifies the vulnerabilities we exploit, and MITRE ATLAS, which organizes the tactics and techniques of an adversary against AI systems. The Promptware Kill Chain is the thread that ties the two into an attack narrative.

In practice, each stage of the Promptware Kill Chain is mapped to ATLAS tactics and OWASP categories: initial access uses direct and multimodal prompt injection (LLM01) and corresponds to the Initial Access and AI Model Access tactics; escalation exploits excessive agency and tool-call abuse (LLM06), covering Execution and Privilege Escalation; reconnaissance extracts the system prompt and privileged context (LLM07) under the Discovery tactic; persistence poisons memory, vector stores and embeddings (LLM04, LLM08) under Persistence; command and control uses indirect channels in documents and content retrieved through RAG, under Command and Control; lateral movement propagates the instruction across agents and orchestration queues, documented with Execution and Collection and cross-referenced to MITRE ATT&CK's Lateral Movement; and actions on the objective demonstrate exfiltration through a legitimate channel (LLM02), under Exfiltration and Impact.

Two families of technique cut across every stage: evasion of guardrails and safety classifiers, recorded as Defense Evasion, and supply chain attacks on packages, models and datasets (LLM03), recorded as Resource Development. Each executed technique receives the corresponding ATLAS identifier and OWASP category in the technical report, so your team can map controls directly onto the framework they already use.

Which attack techniques do AI red teamers actually use?

Every technique below was observed in real 2025–26 incidents or academic research. All are executed with explicit authorization and blast-radius containment.

T1 · INITIAL

Prompt injection multimodal

Hidden instructions in images, PDFs, audio, and metadata. Breaks the trust boundary between data and instructions.

img.alt = "ignore..."
pdf metadata::cmd
audio steganography
T2 · ESCALATE

Tool / function abuse

Chaining of legitimate tool calls to reach unauthorized capabilities — file system, email, transactions.

searchemail$exec
T3 · RECON

Model & system prompt leak

Extraction of system instructions, privileged context, and model details via adversarial prompts.

→LEAKsystem_prompt
→LEAKmodel: gpt-4o
→LEAKapi_key prefix
T4 · PERSIST

Memory poisoning

Injection of persistent instructions into long-term memory, vector stores, and context shared across sessions.

T5 · C2

Indirect prompt channel

Command-and-control channel via shared documents, comments, or content retrieved by RAG.

T6 · LATERAL

Agent-to-agent contagion

Propagation across agents via inter-agent calls, message queues, and shared orchestration contexts.

T7 · OBJECTIVE

Data exfil via legitimate channel

Sensitive data leaving through responses, summaries, or actions that appear legitimate to detection.

15:42EXFIL12,847 records
15:43EXFILvia summarize()
15:44CLEANtrace removed
T8 · EVASION

Guardrail bypass

Encoding, role-play, long context, logic puzzle attacks, and safety classifier evasion.

base64 encode
roleplay::dev_mode
token smuggle
T9 · SUPPLY

Supply chain

Malicious packages, backdoored models, poisoned datasets — attacking before deploy.

npmmodel.safetensorsprod
Brazil and LATAM

AI red teaming in Brazil and LATAM

Berghem is headquartered in São Paulo and delivers AI red teaming across Brazil and Latin America, with a European presence through Berilo. Our operators work in Portuguese, Spanish, English and Italian — and that matters more than it sounds. Prompt injection, jailbreaks and social engineering of an LLM are language attacks: a model that resists English payloads is frequently exposed to the same techniques written in Portuguese or Spanish. We test the assistants your customers actually talk to, in the languages they actually use.

Regional context shapes the scenarios. Brazilian financial institutions operate under Banco Central cybersecurity requirements and LGPD, and fintechs, retailers, healthcare providers and telcos across LATAM are deploying customer-facing LLM assistants faster than their security programs can follow. We design adversary objectives around the data and flows that carry regulatory and business risk in your jurisdiction, and we write reports your auditors and regulators can read.

Working in the same time zone as your team means live coordination during the campaign, purple-team sessions with your SOC in business hours and a debrief in the room instead of an emailed PDF. For multinational groups we run the same methodology from São Paulo and from Europe, so a Brazilian subsidiary and a European headquarters receive comparable results.

Related services: AI and LLM pentest · AI security services · Red Team and attack simulation

From kickoff to executive scorecard

What do you receive from an AI red teaming engagement?

Every campaign ends with four deliverables, each written for a different audience: leadership, engineering, the SOC and the program owner responsible for remediation.

DOC-01

Executive report (15–25 pp)

Business-language impact summary, risk map, top 5 attack paths, prioritized recommendations, and estimated financial exposure.

DOC-02

Technical report (60–120 pp)

Each attack chain documented stage-by-stage, with payloads, screenshots, logs, and reproducible PoC for the engineering team.

PoCcurl-X POST /api/v1/...
PoCprompt"ignore prev..."
PoCresponse200 OK · system
DOC-03

Campaign replay

Interactive visual timeline of each executed stage, operator decisions, and windows where the defense would have detected had observability been active.

DOC-04

90-day remediation plan

Prioritized actions (high/medium/low), suggested owners, estimated effort, and dependencies between controls. We revisit at 90 days to validate.

P1
P2
P3
Rules of engagement

How are AI red team operations kept under control?

Every campaign starts with documented rules of engagement, blast-radius containment, and a direct channel with your response team if anything escapes scope.

ROE-01

Surgical scope

Systems, test accounts, time windows, and action types approved in writing before any execution.

ROE-02

24/7 red line

Direct channel between the campaign lead and your security team — we pause the operation at any moment.

ROE-03

No real data exfiltrated

We demonstrate exfiltration capability with canaries and synthetic data. Nothing sensitive leaves your perimeter.

ROE-04

Reversibility

Every modification to memory, configuration, or state is documented and rolled back at the end of the operation.

ROE-05

SOC coordination

"Purple team" mode available — we operate in coordination with your SOC to validate detection and response in real time.

ROE-06

Compliance & legal

Contract with NDA, legal authorization, data segregation, and auditable report for regulators and auditors.

Frequently asked questions

AI red teaming: frequently asked questions

What is AI/LLM red teaming?
AI red teaming (also called LLM red teaming) is adversarial security testing in which human operators attack live AI systems the way a real attacker would — through prompt injection, jailbreaks, data extraction, tool and agent abuse and unsafe outputs — and chain those techniques into a full operation to measure real business impact and whether your detection and response hold.
How is it different from an AI/LLM pentest?
An AI pentest hunts for as many vulnerabilities as possible within a defined scope, with broad coverage and fixed time. Red teaming pursues specific objectives like a real adversary, chains flaws into an attack path and measures whether your team detects and responds. Pentest measures exposure; red team measures resilience. Many clients start with a pentest and move to red teaming once the basics are fixed.
Do you red-team agentic and RAG systems?
Yes. Agentic systems and RAG pipelines are where most of our attack chains run today. For agents we test tool and function abuse, excessive agency, memory poisoning and agent-to-agent propagation; for RAG we test indirect prompt injection through retrieved documents, vector and embedding weaknesses and data leakage across tenants or permission boundaries.
How long does an AI red team campaign take?
A typical campaign runs four to eight weeks, starting with a two-day threat modeling workshop and ending with a debrief. Duration depends on the number of AI systems in scope, the depth of the integrations behind them and whether the engagement includes purple-team sessions with your SOC.
Is it safe to red-team production AI systems?
Yes, within documented rules of engagement. Scope, test accounts, time windows and permitted actions are approved in writing before execution; exfiltration is demonstrated with canaries and synthetic data, never real records; every change to memory, configuration or state is documented and rolled back; and a direct channel with your security team lets either side pause the operation at any moment.
Which frameworks do you use for AI red teaming?
Three public references: the Promptware Kill Chain to structure the operation end to end, the OWASP LLM Top 10 as the coverage map and classification for findings, and MITRE ATLAS to map every executed technique to adversary tactics so your SOC can build detections.
What do you receive at the end of the campaign?
You receive an executive report in business language, a technical report documenting each attack chain with reproducible PoC, an interactive campaign replay of every stage executed, and a prioritized 90-day remediation plan with suggested owners, estimated effort and dependencies between the controls involved.

Ready to find out what a motivated adversary can actually do?

2-day threat modeling workshop to start — leave with surface map, top 5 hypothetical attack paths, and a complete campaign proposal.

Schedule workshop