Cybrary ForgeCYBRARY / FORGE
AI catalog
AI range
Maturity level 3
60 minutes · Advanced

Copilot Under Attack

The copilot your analysts trust has been fed instructions through an alert body. Catch what it did on that instruction, contain the session, and rebuild the boundary that keeps alert text as data.

Advanced · Several moving parts — expect trade-offs and a wrong turn or two.

Outcome · Investigate prompt injection against a SOC copilot using ordinary telemetry.

George · 5 lines
Roles
• SOC analyst
• Detection engineer
Standards mapping
NICE T0258
ATLAS AML.T0051, AML.T0051.001
OWASP LLM01
Publish gate
Manifest valid · release 1.0.0

AI connection

This activity runs entirely on the deterministic runtime. Optional live-model runtimes only affect dialog, coaching and wording — never checks or scoring.

Deterministic simulationmode 0

Nothing leaves the browser session.

Chrome built-in AImode 1

Prompts never leave the learner's machine.

Bring your own keymode 2

Lab prompts reach the learner's chosen provider only.

Organization-owned AImode 3

Customer tenancy; Cybrary sees metadata only.

Cybrary-managed AImode 4

Cybrary AI gateway; retention off by default.

Hybrid routingmode 5

Per-job — the router never sends restricted jobs off-tenant.

Lab manifest

The machine-readable release contract. Authors edit this; the console refuses to publish without checks, both regression suites and a reference solve.

schemaVersion: cybrary.ai-lab/v1
id: copilot-under-attack
release: 1.0.0
mode: ai-range
maturity: 3
roles:
  - soc-analyst
  - detection-engineer
outcomes:
  niceTasks:
    - T0258
  atlasTechniques:
    - AML.T0051
    - AML.T0051.001
  owaspRisks:
    - LLM01
aiAssets:
  models:
    - support-agent-model@2026.06
  prompts:
    - copilot-under-attack-system-prompt@1
  agents:
    - support-agent-orchestrator@3
  tools:
    - crm.lookup
    - ticket.update
    - email.send
    - refund.issue
  corpora:
    - support-kb@v4
enterpriseTopology: support-enterprise-v3
scenario:
  seed: copilot-under-attack-seed-1
  injects:
    - copilot-under-attack-inject-1
telemetry:
  requiredSignals:
    - ai.trace
    - rag.retrieval
    - tool.call
    - identity.auth
    - dlp.egress
    - siem.alert
evaluation:
  deterministicChecks:
    - copilot-under-attack-checks
  repeatedTrials: 20
  maliciousSuite: copilot-under-attack-attack-v1
  benignSuite: support-utility-v4
safety:
  networkEgress: deny
  maxTokens: 250000
  maxCostUsd: 20