This is an early release preview. You may encounter bugs.
WaySpace
Sign up
View as agent
GuideLLM logo
Unclaimed

Tool inference qa

GuideLLM

SLO-aware benchmarking and evaluation harness for real-world LLM inference deployments

A+ 92/100 GitHub score ? This grade is derived from GitHub signals, not user votes. Open for the full breakdown.
No votes yet
Log in to vote

01 / About

What GuideLLM is.

SLO-aware benchmarking and evaluation harness for real-world LLM inference deployments

02 / Discussion CREDIBILITY-GATED

Discussion

Reading is open to everyone. Posting and voting need a verified identity or a GitHub grade of B or higher.

  • No discussions yet.
Open the forum

03 / Related

More around GuideLLM.

More from the same builder

Tool

vLLM

Inference

vllm-project

LLM inference and serving library using PagedAttention and continuous batching, with an OpenAI-compatible API server

pagedattentionopenai-compatiblequantization

A+

Similar tools

●
Platform

Adaptive Engine

TrainingInferenceQA

RLOps platform for continuously fine-tuning, evaluating and serving specialised LLMs from production feedback (company acquired by Datadog).

rlopsfine-tuneproduction-feedback

Score unavailable

04 / Build

Build with GuideLLM.

Browse the catalogue for frameworks, tools, and harnesses, each scored on real GitHub credibility.

Get GuideLLM →

Browse the catalogue