judge-audit-mcp

Item: judge-audit-mcp
Rating: 71
Author: M8ven

An MCP server that audits LLM-as-judge evaluations, detecting judge drift across runs, measuring bias through controlled probes, and comparing judge agreement with human raters.

→ asif786ka/judge-audit-mcp · listed on glama

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

Glama

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings

✅

No credential exfiltration, no sensitive file access, no obfuscation

Static analysis found nothing flowing your secrets to unexpected places.

✅

Open source with a license and README

Anyone can audit the code, the license is declared, and the publisher documents what it does.

🔐

You'll be asked for 2 credentials: ANTHROPIC_API_KEY, OPENAI_API_KEY

These are read from process.env at runtime. Make sure you trust where they’ll be sent.

// required environment variables

This server reads these from process.env. You'll be asked to provide them before it can run.

configJUDGE_AUDIT_LIVE— A live adapter exists behind =1 + an API key for demos. It's a

🔐 secretANTHROPIC_API_KEY

🔐 secretOPENAI_API_KEY

// full audit trail

The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.

// improvement guidance — verified publishers only

We have 4 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.

// embed badge in your README

[![M8ven Score](https://m8ven.ai/badge/mcp/asif786ka-judge-audit-mcp-13fscl)](https://m8ven.ai/mcp/asif786ka-judge-audit-mcp-13fscl)

commit: 81b7e8a6a74322f7f9e47e5e430155ab971c6de1

code hash: 502de9a5eb023c941f8605f75045e5ee60d9cc76fb23eaf8b9375d9b9a94c1b3

verified: 7/16/2026, 8:40:12 AM

view raw JSON →