Framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Are you the maintainer?
Claim this page →Evals
Framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
01 / About
About Evals.
02 / Credibility
Derived from GitHub, not voted.
Public-signal score, discounted for bought-star and bot-stargazer patterns — not a user rating. How scores are calculated.
Score unavailable
We haven't been able to compute a GitHub credibility score for this tool yet. It'll appear here once the evaluator runs.
03 / Discussion CREDIBILITY-GATED
Discussion · 0
Reading is open to everyone. Only verified humans or builders at GitHub B+ can post or vote — every comment carries its author's credibility.
- No comments yet — be the first to start the discussion.
05 / Related
More to explore.
ToolLm Evaluation Harness
EleutherAI
A framework for few-shot evaluation of language models.
ToolAgent Skills
WordPress
Expert-level WordPress knowledge for AI coding assistants - blocks, themes, plugins, and best practices
ToolAiproxy
labring
AI gateway that provides intelligent request routing, comprehensive monitoring, and seamless multi-tenant management. B
ToolBentoML
bentoml
Unified Model Serving Framework. Build model inference APIs and multi-model serving systems with any open-source or custom AI models.
ToolCaptum
meta-pytorch
Model interpretability and understanding for PyTorch
ToolCc Connect
chenhg5
Bridge local AI coding agents (Claude Code, Cursor, Gemini CLI, Codex) to messaging platforms (Feishu/Lark, DingTalk, Slack, Telegram, Disco
06 / Build
Build with Evals.
Browse the catalogue for frameworks, tools, and blueprints — each scored on real GitHub credibility.
Browse the catalogue