Run any open-source LLMs (Llama 3.3, Qwen2.5, Phi3 and more) or custom models as OpenAI-compatible APIs with a single command.
Tool 
Unclaimed
Are you the maintainer?
Claim this page →OpenLLM
Run any open-source LLMs (Llama 3.3, Qwen2.5, Phi3 and more) or custom models as OpenAI-compatible APIs with a single command.
GitHub score unavailable
No votes yet
01 / About
About OpenLLM.
02 / Credibility
Derived from GitHub, not voted.
Public-signal score, discounted for bought-star and bot-stargazer patterns — not a user rating. How scores are calculated.
—
Score unavailable
We haven't been able to compute a GitHub credibility score for this tool yet. It'll appear here once the evaluator runs.
03 / Discussion CREDIBILITY-GATED
Discussion · 0
Reading is open to everyone. Only verified humans or builders at GitHub B+ can post or vote — every comment carries its author's credibility.
🔒 Read-only view — verify your identity or
reach GitHub B+ to join the discussion. Get verified
- No comments yet — be the first to start the discussion.
05 / Related
More to explore.
ToolZenml
zenml-io
ZenML is built for ML or AI Engineers working on traditional ML use-cases, LLM workflows, or agents, in a company setting.
A
FrameworkLetta
letta-ai
A server with CLI and API for stateful, self-improving agents with advanced memory.
B
ToolClawManager
Yuan-lab-LLM
A Kubernetes-native control plane for AI agent instance management, with governed AI access, runtime orchestration, and more
B
ToolFal
fal-ai
Fast generative-media inference (image, audio, video) via fal serverless models.
Score unavailable
ToolInspector
MCPJam
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
B
ToolLiveKit
livekit
WebRTC transport and infrastructure for real-time audio/video agents.
Score unavailable
06 / Build
Build with OpenLLM.
Browse the catalogue for frameworks, tools, and blueprints — each scored on real GitHub credibility.
Browse the catalogue