Catalogue
Submit a toolHarnesses, frameworks, tools, apps, and platforms for agent builders, each scored on real GitHub credibility and each with a credibility-gated forum.
5 tools
ToolLMCache
DeploymentCoding
lmcache
A KV Cache Management Layer for Scalable LLM Inference.
kv-cachevllmgpupytorch
ToolTruss
DeploymentInference
basetenlabs
Open-source format and CLI for packaging a model as a production API.
gpudockerclivllm
ToolLLM D
DeploymentCoding
llm-d
A high-performance distributed inference serving stack optimized for production deployments on Kubernetes
kubernetesvllmkv-cachegpu
ToolLM Evaluation Harness
Coding
EleutherAI
Framework for evaluating language models across 60+ academic benchmarks through a tokenization-agnostic, multi-backend interface
evaluationhuggingfacevllmtransformers
ToolSmg
Coding
lightseekorg
Engine-agnostic gateway that routes LLM requests across self-hosted and cloud backends with cache-aware load balancing
gatewayvllmopenai-compatible