Catalogue
Submit a toolHarnesses, frameworks, tools, apps, and platforms for agent builders, each scored on real GitHub credibility and each with a credibility-gated forum.
16 tools
Toolwhisper.cpp
Voice
ggml-org
C/C++ port of OpenAI's Whisper speech-recognition model, dependency-free and optimized for on-device inference
stton-devicemetalquantization
ToolMNN
Coding
alibaba
Lightweight deep learning engine for on-device inference and training, with runtimes for local LLMs and diffusion models
on-devicemobileembeddedquantization
ToolLiteRT
Coding
google-ai-edge
On-device runtime (formerly TensorFlow Lite) for running models at the edge.
on-devicegpunpuquantization
PlatformRoboflow Inference
Deployment
roboflow
Server and SDK for running vision models locally or in the cloud behind a simple API.
videocomputer-visionobject-detectionon-devicedocker
ToolFluidVoice
Voice
altic-dev
Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local Wispr Flow alternative. ⭐ helps a t
sttmacoson-devicewhisper
ToolApfel
InterfaceInference
Arthur-Ficial
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API key
apple-intelligenceon-devicemacosopenai-compatible
ToolOpenMed
Data WranglingSecurity
maziyarpanahi
On-device clinical NLP for biomedical entity extraction and HIPAA PII de-identification, running fully offline from phones to GPU servers
healthcareclinical-nlphipaapiion-device
ToolOpenSquilla
InferenceMemory
OpenSquilla
Token-efficient microkernel AI agent with an on-device model router, persistent memory and pluggable multi-provider support
model-routeron-devicemulti-providercli
ToolOGAM
Generative MediaVoiceInterface
off-grid-ai
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text,
on-deviceggufwhisperstable-diffusion
ToolMuna
InferenceDeployment
muna-ai
Compiles Python AI functions into self-contained native binaries and serves open models via an OpenAI-compatible client across cloud, edge and device.
openai-compatibleon-devicegpumodel-compilation
ToolESP-Claw
CodingMemoryConnectors
espressif
ESP-Claw, a "Chat Coding" AI agent framework for IoT devices
esp32iotembeddedon-device
ToolKoala
Voice
Picovoice
Audio noise-reduction filter using Picovoice's Koala on-device technology.
noise-reductionon-devicepicovoicecross-platform
ToolMLC LLM
Inference
mlc-ai
Machine-learning compiler and engine for deploying LLMs across AMD, NVIDIA, Apple, and Intel GPUs, browsers, iOS, and Android
cross-platformwebgpuon-devicequantization
ToolNeuphonic
VoiceGenerative Media
neuphonic
Text-to-speech via Neuphonic's API.
ttsvoice-cloningon-devicegguf
ToolMoondream
Inference
vikhyat
Small open-source vision-language model with a local server and client SDKs for VQA, captioning, pointing and object detection in agent pipelines.
vision-language-modelimage-captioningobject-detectionmultimodal
ToolMinions
Coding
HazyResearch
A communication protocol that enables small on-device models to collaborate with frontier models in the cloud
local-firsttoken-optimizationollamaon-device