This is an early release preview. You may encounter bugs.
AI-Infra-Guard logo
Unclaimed

Tool security

AI-Infra-Guard

AI red-teaming platform for scanning agents, skills, MCP servers, and infrastructure and evaluating LLM jailbreaks

Built by Tencent

A+ 91/100 GitHub score ? This grade is derived from GitHub signals, not user votes. Open for the full breakdown.
No votes yet

01 / About

What AI-Infra-Guard is.

AI-Infra-Guard, abbreviated A.I.G, is a self-hosted red-teaming platform for AI systems. It scans AI infrastructure, agent workflows, MCP servers, and agent skills for security risks, and reports them through a web interface, an HTTP API with Swagger documentation, or standalone command-line scanners for skills, MCP, and agents.

Six scanners make up the platform. ClawScan evaluates an OpenClaw installation for insecure configuration, risky skills, known vulnerabilities, and privacy leakage. Agent Scan is a multi-agent framework that probes agent workflows, including agents running on platforms such as Dify and Coze. The MCP and skill scanner detects 14 categories of risk in MCP servers and agent skills, from source code or a remote URL. The infrastructure scanner fingerprints over 100 AI framework components against more than 2,000 known CVE rules. Jailbreak evaluation tests prompt robustness with curated datasets and several attack methods, including the multi-turn Many-Shot, PAIR, GOAT, and ActorAttack techniques, and compares results across models. The model and API relay checker covers model fingerprinting, signature verification, and black-box relay auditing.

Skill findings map to the SkillTrustBench T01–T09 taxonomy: skill instruction hijacking and memory poisoning, remote payload download and execution and embedded malicious code, privilege escalation and system persistence, tool hijacking and spoofing and insecure dependencies, and insecure coding practices. The skill scanner installs as a Python package for use in a continuous-integration pipeline, and its measured accuracy on that benchmark varies by the judging model.

Judging model F1 Precision Recall False-positive rate
Claude Opus 4.6 0.9848 0.9725 0.9974 0.0663
GLM 5.1 0.9836 0.9701 0.9974 0.0723
Gemini 3.5 Flash 0.9792 0.9947 0.9641 0.0120
Kimi 2.6 0.9780 0.9895 0.9667 0.0241
DeepSeek v4 Flash 0.9740 0.9868 0.9615 0.0301

Deployment is by Docker Compose against pre-built images or a source build, needing Docker 20.10 or later, 4 GB of memory, and 10 GB of disk, with the interface on port 8088. The platform is intended for internal use inside an organisation: it carries no authentication mechanism and is not meant to be exposed on a public network. Version 4.6.0 added LLM API poisoning detection as a multi-probe black-box audit for model substitution and backdoor risks, and expanded the vulnerability library to 146 AI components and more than 2,000 CVE rules.

Features

  • ClawScan: one-click evaluation of an OpenClaw deployment for insecure configuration, skill risk, CVEs, and privacy leakage
  • Agent Scan: a multi-agent scanning framework for agent workflows, with a mutation engine and web-exfiltration detection
  • MCP and skill scanning: 14 risk categories detected from source code or a remote URL, with tool whitelisting to prevent remote code execution in dynamic mode
  • Skill risk taxonomy: findings classified against SkillTrustBench T01–T09 across instruction, execution, privilege, dependency, and code-quality layers
  • Bytecode and charset checks: .pyc bytecode bypass detection and charset smuggling defence in the skill scanner
  • Infrastructure scanning: fingerprints more than 100 AI framework components, including Ollama, ComfyUI, vLLM, n8n, and Triton Inference Server, against 2,000-plus CVE rules
  • Jailbreak evaluation: curated datasets and multi-turn attacks with cross-model comparison
  • Relay checker: model fingerprinting, signature verification, and black-box auditing of API relays via /api/v1/relay/check/stream
  • CI-ready CLI: aig-skill-scan runs against a local skill directory and writes JSON results, with a model and output language selectable per run
  • Agent skills: scanner skills published on ClawHub so scanning can be triggered from an agent conversation

02 / Discussion CREDIBILITY-GATED

Discussion

Reading is open to everyone. Posting and voting need a verified identity or a GitHub grade of B or higher.

  • No discussions yet.

04 / Build

Build with AI-Infra-Guard.

Browse the catalogue for frameworks, tools, and harnesses, each scored on real GitHub credibility.

Get AI-Infra-Guard →

Browse the catalogue