Add multi-agent prompt injection defense skill - #93
SayanDey322 wants to merge 1 commit into
Conversation
mukul975
left a comment
There was a problem hiding this comment.
Thanks for picking up issue #59 — the multi-agent prompt-injection-defense skill is genuinely wanted. A few fixes before merge:
- Folder placement. Move it to
skills/multi-agent-prompt-injection-defense/following the standard layout (SKILL.md + references/ + scripts/agent.py + LICENSE) like the other 817 skills. - ATLAS technique names. A couple are wrong: AML.T0066 is 'Retrieval Content Crafting' and AML.T0070 is 'RAG Poisoning' — please match the official ATLAS names for whichever IDs you map. The relevant ones for this skill are AML.T0051 (LLM Prompt Injection) and AML.T0054 (LLM Jailbreak).
- Dead reference. The 'OWASP Agent Threat Bench' link 404s. Replace it with the real OWASP Agentic Top 10 (ASI01–ASI10) reference, and double-check the 'ASI06' code you cite.
- Frontmatter author. Reconcile the
authorfield with the actual contributor, and drop any agent.py capability claim that the script doesn't actually implement.
Content is substantive — these are accuracy/placement fixes.
mukul975
left a comment
There was a problem hiding this comment.
The skill itself is welcome — poisoned context, inter-agent message tampering and output filtering are real and under-covered here. Three things before merge.
1. Subdomain is not in the allowed set. adversarial-machine-learning is not in ALLOWED_SUBDOMAINS, so the skill fails validation. Use ai-security, which is canonical and already in the enum.
2. Please drop tools/validate-skill.py from this PR entirely. The bundled copy is behind main and self-patches the enum to accommodate the subdomain above. Measured against the committed corpus it takes validation from 817/817 passing to 719/817:
- it reverts the column-0 top-level-key guard, so nested
mitre_f3name:values clobber real skill names — 94 of the 98 failures, including 10 instances ofName 'Account Takeover: Exposed Login Credential' - it removes
hardware-firmware-security, breaking the 4 skills that use it - it shrinks
REQUIRED_FIELDSfrom 8 to 5, droppingversion/author/license
Fixing the subdomain removes the reason to touch the validator at all.
3. author: is set to mukul975. It should be your handle — the field credits whoever wrote the skill.
Summary
Added a new cybersecurity skill for detecting and mitigating prompt injection attacks across multi-agent AI systems.
Changes
Fixes #59