•3 min read
General Analysis Launches MCP Guard
We are excited to launch MCP Guard, the first runtime firewall designed to secure every MCP (Model Context Protocol) tool call against prompt injection attacks.
Read more
Systematic Vulnerability
Testing for AI Agents
We provide a repository of stress-testing, jailbreaking, and red-teaming methods—a knowledge base to build and improve custom guardrails for your AI agents.
Backed byYCombinator
Comprehensive security assessment to identify exploitable vulnerabilities and OWASP Top 10/NIST/MITRE ATLAS compliance gaps in your AI systems and application layers.
Latest Blog Posts
►Research, analysis, and updates from our team
View all posts
•8 min read
The Redact-and-Recover Jailbreak Reveals Ricin Extraction Instructions from Claude
We present the Redact & Recover (RnR) Jailbreak, a novel attack that exploits partial compliance behaviors in frontier LLMs to bypass safety guardrails through a two-phase decomposition strategy.
Read more
•8 min read
Supabase MCP can leak your entire SQL database
In this post, we show how an attacker can exploit Supabase’s MCP integration to leak a developer’s private SQL tables. Model Context Protocol (MCP) has emerged as a standard way for LLMs to interact with external tools. While this unlocks new capabilities, it also introduces new risk surfaces.
Read more
•2 min read
General Analysis x Together AI
TLDR: We are excited to announce our partnership with Together AI to stress-test the safety of open-source (and closed) language models.
Read more
•40 min read
The Jailbreak Cookbook
We have created a comprehensive overview of the most influential LLM jailbreaking methods.
Read more
•5 min read
Generating Diverse Test Cases with Diversity Transfer from LegalBench
TLDR: we utilized LegalBench as a diversity source to enhance the diversity of our generation of red teaming questions. We show that diversity transfer from a domain-specific knowledge base is a simple and practical way to build a solid red teaming benchmark.
Read more