DevOps & Infra

Runs 70B models on a single 4 GB GPU without quantization, by keeping only one layer on the GPU at a time.

A suite of MCP servers from AWS Labs for AWS docs, the AWS API, infrastructure as code, support and many individual services.

antirez's focused engine for running DeepSeek V4 Flash and a few other large open models locally on Metal, CUDA and ROCm.

An MCP server for Kubernetes and OpenShift that talks to the Kubernetes API directly, with no kubectl needed.

One command to find which open-source LLMs actually run on your hardware, scored for fit, speed, quality and context.

Modular's open platform for AI development and deployment: the MAX framework, the Mojo language and an OpenAI-compatible server.

Sentry's MCP server for coding agents. Pull real errors, stack traces and issues into the chat while you debug.

A high-performance serving framework for LLMs and multimodal models, from a single GPU to large distributed clusters.

Fine-tune LLMs from one YAML file; layer streaming trains an 8B model on a 4 GB laptop GPU.

HashiCorp's official MCP server that connects agents to the Terraform Registry and HCP Terraform for accurate infrastructure code.

Run, fine-tune and serve LLMs and diffusion models on your own hardware, with an OpenAI-compatible API for your agents.

A high-throughput, memory-efficient engine for serving LLMs, with PagedAttention, continuous batching and prefix caching.