Back to MCP Trust Indexm8ven
15
/ 100
10 days ago
glama

metrillm-mcp

Enables benchmarking of local LLM models (performance and quality) and sharing results to a public leaderboard via MCP tools.

→ MetriLLM/metrillm· listed on glama
Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

Glama

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings
🚨
Known vulnerabilities in dependencies: 1 critical, 2 high
Affects packages this MCP installs at runtime. Upgrade or remove the affected dependency.
🔐
You'll be asked for 4 credentials: LM_STUDIO_API_KEY, METRILLM_POSTHOG_KEY, METRILLM_SUPABASE_ANON_KEY, METRILLM_SUPABASE_SERVICE_KEY
These are read from process.env at runtime. Make sure you trust where they’ll be sent.
// known CVEs in dependencies1 critical2 high

Disclosed vulnerabilities in this server's declared npm dependencies (via OSV). Whether each is reachable depends on the installed versions.

criticalvitest@4.0.18GHSA-5xrq-8626-4rwp

When Vitest UI server is listening, arbitrary file can be read and executed

highsysteminformation@5.31.2GHSA-5xpp-75jx-m839

systeminformation: OS command injection in networkInterfaces() via interfaces(5) source-directive path on Linux

highsysteminformation@5.31.2GHSA-hvx9-hwr7-wjj9

Systeminformation vulnerable to Linux command injection in networkInterfaces() via unsanitized NetworkManager connection profile name

Depend on this server? Get alerted when its CVEs change.Watch this server free →
// required environment variables
This server reads these from process.env. You'll be asked to provide them before it can run.
configFORCE_COLOR
🔐 secretLM_STUDIO_API_KEY— LM Studio --backend lm-studio http://127.0.0.1:1234 LM_STUDIO_BASE_URL (optional), (optional)
configLM_STUDIO_BASE_URL— LM Studio --backend lm-studio http://127.0.0.1:1234 (optional), LM_STUDIO_API_KEY (optional)
configMETRILLM_CODING_ALLOW_WORKER_FALLBACK
configMETRILLM_CODING_SANDBOX
configMETRILLM_ENABLE_EXPERIMENTAL_TS_STRIP
configMETRILLM_LEADERBOARD_URL
🔐 secretMETRILLM_POSTHOG_KEY
configMETRILLM_PROJECT_URL
configMETRILLM_PUBLIC_RESULT_BASE_URL
🔐 secretMETRILLM_SUPABASE_ANON_KEY
🔐 secretMETRILLM_SUPABASE_SERVICE_KEY
configMETRILLM_SUPABASE_URL
configNO_COLOR
configOLLAMA_HOST— Ollama --backend ollama http://127.0.0.1:11434 (optional)
configOLLAMA_SMOKE_MODEL
configTERM_PROGRAM
configWT_SESSION
// full audit trail
The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.
// improvement guidance — verified publishers only
We have 3 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.
// embed badge in your README
[![M8ven Score](https://m8ven.ai/badge/mcp/metrillm-metrillm-f9pigy)](https://m8ven.ai/mcp/metrillm-metrillm-f9pigy)
commit: 41779e757dd580ab8bdacb94b35f92e6ddb5c09b
code hash: a722584637007afa4634392b038f4023339ae0cbdd49e2c76b79d06e8eacb10c
verified: 7/21/2026, 9:27:22 AM
view raw JSON →