A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: π AI Gateway (LiteLLM) π€ LLM Serving (vLLM, SGLang, Ollama) π Vector Databases, π Embedding Models (TEI) π Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Claim it to get a verified publisher badge, a free copy of our full audit findings, and direct contact for any high-priority issues we find.
Install from
M8ven verifies MCPs across every public registry β install directly from whichever one you prefer.
process.env. You'll be asked to provide them before it can run.AWS_REGIONBRIDGE_AUTH_TOKENDOMAINβ ? Enter value for :EKS_CLUSTER_NAMEβ β Enter value for : genai-on-eksEKS_MODEβ EKS mode, auto (default) or standardHF_TOKENβ Hugging Face [user access token](https://huggingface.co/docs/hub/en/security-tokens)LITELLM_API_KEYLITELLM_BASE_URLLITELLM_MODEL_NAMELITELLM_UI_PASSWORDLITELLM_UI_USERNAMEMLFLOW_PASSWORDMLFLOW_USERNAMEOPENAI_API_KEYOPENWEBUI_ADMIN_EMAILOPENWEBUI_ADMIN_PASSWORDPHOENIX_API_KEYPLATFORMREGIONβ β Enter value for : us-west-2[](https://m8ven.ai/mcp/aws-samples-sample-genai-on-eks-starter-kit-h48zwo)