inferbench

InferBench's MCP server lets coding agents run, serve and benchmark local LLMs (text + image, llama.cpp + Stable Diffusion) on your own hardware on demand — measuring real tokens/sec and picking the optimal quant for your GPU from a 124-model catalog. Local-first, no cloud required.

→ JoniMartin27/inferbench · listed on glama

Is this your MCP?

Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.

Install from

Glama

M8ven verifies MCPs across every public registry — install directly from whichever one you prefer.

// key findings

✅

No credential exfiltration, no sensitive file access, no obfuscation

Static analysis found nothing flowing your secrets to unexpected places.

✅

Open source with a license and README

Anyone can audit the code, the license is declared, and the publisher documents what it does.

// required environment variables

This server reads these from process.env. You'll be asked to provide them before it can run.

configIB_OUT_DIR

configINFERBENCH_BENCH_ITERS

configINFERBENCH_BENCH_NO_WARMUP

configINFERBENCH_CODE_EXEC

configINFERBENCH_GPU_RESERVE_GB

configLOOKSPAN_ENDPOINT

configINFERBENCH_PORT

configINFERBENCH_BACKEND_URL

// full audit trail

The full breakdown of what we checked, the deductions that landed, the network hosts, the dependency advisories, and concrete fix guidance is available to verified publishers.

// improvement guidance — verified publishers only

We have 6 concrete improvements we can share with the publisher of this MCP. Each comes with specific guidance to raise the trust score.

// embed badge in your README

[![M8ven Score](https://m8ven.ai/badge/mcp/jonimartin27-inferbench-i407o1)](https://m8ven.ai/mcp/jonimartin27-inferbench-i407o1)

commit: ff47da1d477e2aaf7b2f7b50a6881a9b5a7af1ae

code hash: 9fd337845a4850591388f192d5f1553a57173c4521de149626a4388cb4fdee87

verified: 6/16/2026, 11:30:09 AM

view raw JSON →