Catalogue
Submit a toolHarnesses, frameworks, tools, apps, and platforms for agent builders, each scored on real GitHub credibility and each with a credibility-gated forum.
9 tools
Toolllama.cpp
Deployment
ggml-org
LLM inference in C/C++ across CPU and GPU backends, using the GGUF format with quantization, a REST server, and a WebUI
ggufquantizationguilocal-first
Toolwhisper.cpp
Voice
ggml-org
C/C++ port of OpenAI's Whisper speech-recognition model, dependency-free and optimized for on-device inference
stton-devicemetalquantization
ToolUnsloth
TrainingInference
unslothai
Run and fine-tune open LLMs, vision, and audio models locally, with training claimed at up to 2x faster and up to 70% less VRAM
fine-tuneloragguflocal-first
ToolMlx Serve
InferenceGenerative MediaVoice
ddalcu
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mo
mlxggufapple-siliconopenai-compatible
ToolLlamafile
Deployment
Mozilla-Ocho
Packages an LLM and its runtime into one cross-platform executable file that runs locally with no installation
gguflightweightwhispercross-platform
ToolOGAM
Generative MediaVoiceInterface
off-grid-ai
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text,
on-deviceggufwhisperstable-diffusion
ToolNeuphonic
VoiceGenerative Media
neuphonic
Text-to-speech via Neuphonic's API.
ttsvoice-cloningon-devicegguf
ToolZinc
Inference
zolotukhin
Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon
ggufvulkanrocmmetal
AppText Generation Webui
InferenceTrainingGenerative Media
oobabooga
A desktop app for local LLMs. Open source, no telemetry. Text, vision, tool-calling, web search. UI + API.
productivitydesktoplocal-firstgguftool-calling