A high-throughput and memory-efficient inference and serving engine for LLMs
Tool 
Unclaimed
Are you the maintainer?
Claim this page →vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub score unavailable
No votes yet
01 / About
About vllm.
02 / Credibility
Derived from GitHub, not voted.
Public-signal score, discounted for bought-star and bot-stargazer patterns — not a user rating. How scores are calculated.
—
Score unavailable
We haven't been able to compute a GitHub credibility score for this tool yet. It'll appear here once the evaluator runs.
03 / Discussion CREDIBILITY-GATED
Discussion · 0
Reading is open to everyone. Only verified humans or builders at GitHub B+ can post or vote — every comment carries its author's credibility.
🔒 Read-only view — verify your identity or
reach GitHub B+ to join the discussion. Get verified
- No comments yet — be the first to start the discussion.
04 / Related
More to explore.
Toolcaveman-code
JuliusBrussee
A TypeScript implementation of the caveman compression engine.
C
ToolCavemem
JuliusBrussee
Cross-agent persistent memory, caveman-compressed into SQLite with FTS5 and served via MCP.
B
Toolclaude-mem
thedotmack
Persistent cross-session memory that AI-compresses sessions to SQLite and Chroma.
B
ToolLangGraph
langchain-ai
Low-level orchestration for stateful agents.
A
ToolMem0
mem0ai
A universal memory layer that extracts salient facts and retrieves them at inference.
A+
Toolmemory-lancedb-pro
CortexReach
A LanceDB long-term memory plugin with hybrid vector and BM25 search and cross-encoder rerank.
A
05 / Build
Build with vllm.
Browse the catalogue for frameworks, tools, and blueprints — each scored on real GitHub credibility.
Browse the catalogue