Run agents on your own machine

Tool

whisper.cpp

Voice

ggml-org

C/C++ port of OpenAI's Whisper speech-recognition model, dependency-free and optimized for on-device inference

stton-devicemetalquantization

Tool

MNN

Coding

alibaba

Lightweight deep learning engine for on-device inference and training, with runtimes for local LLMs and diffusion models

on-devicemobileembeddedquantization

Harness

JiuwenSwarm

ConnectorsInterface

openJiuwen-ai

JiuwenSwarm is an intelligent AI Agent built on openJiuwen. It extends the powerful capabilities of large language models directly to your f

productivityfeishuxiaoyicronmobile

Tool

LiteRT

Coding

google-ai-edge

On-device runtime (formerly TensorFlow Lite) for running models at the edge.

on-devicegpunpuquantization

Harness

PicoClaw

Connectors

sipeed

Single-binary Go assistant for $10-class hardware, running in under 10MB RAM with 16+ chat channels

productivitylightweightrisc-vlocal-firstembedded

Platform

Roboflow Inference

Deployment

roboflow

Server and SDK for running vision models locally or in the cloud behind a simple API.

videocomputer-visionobject-detectionon-devicedocker

Tool

FluidVoice

Voice

altic-dev

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local Wispr Flow alternative. ⭐ helps a t

sttmacoson-devicewhisper

Tool

Cindy

CodingInterface

makecindy

Consider it done. The open-source AI agent that works out of the box · 想到，就能做到。开源、开箱即用的 AI Agent。

productivitycomputer-uselocal-firstdesktopmobile

Tool

Apfel

InterfaceInference

Arthur-Ficial

The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API key

apple-intelligenceon-devicemacosopenai-compatible

Tool

OpenMed

Data WranglingSecurity

maziyarpanahi

On-device clinical NLP for biomedical entity extraction and HIPAA PII de-identification, running fully offline from phones to GPU servers

healthcareclinical-nlphipaapiion-device

Tool

OpenSquilla

InferenceMemory

TokenRhythm

Token-efficient microkernel AI agent with an on-device model router, persistent memory and pluggable multi-provider support

model-routeron-devicemulti-providercli

Tool

OpenDroid

Interface

yashab-cyber

Your Open Autonomous Android Agent — A production-ready, self-planning AI assistant powered by local/remote LLMs and accessibility-driven sc

androidmobile-automationaccessibilitycomputer-use

Tool

OGAM

Generative MediaVoiceInterface

off-grid-ai

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text,

on-deviceggufwhisperstable-diffusion

Tool

Muna

InferenceDeployment

muna-ai

Compiles Python AI functions into self-contained native binaries and serves open models via an OpenAI-compatible client across cloud, edge and device.

openai-compatibleon-devicegpumodel-compilation

Tool

OpenLive

VoiceGenerative Media

katipally

Opensource, on-device voice + vision layer for AI agents. Bring any model or coding agent; the whole speech loop (VAD, STT, TTS, barge-in) r

sttttsbarge-invoice-cloning

Tool

ESP-Claw

CodingMemoryConnectors

espressif

ESP-Claw, a "Chat Coding" AI agent framework for IoT devices

esp32iotembeddedon-device

Tool

Hermex

Interface

uzairansaruzi

Native iPhone app for your Hermes agent

iosmobileswiftuiremote-control

Tool

Koala

Voice

Picovoice

Audio noise-reduction filter using Picovoice's Koala on-device technology.

noise-reductionon-devicepicovoicecross-platform

Tool

MLC LLM

Inference

mlc-ai

Machine-learning compiler and engine for deploying LLMs across AMD, NVIDIA, Apple, and Intel GPUs, browsers, iOS, and Android

cross-platformwebgpuon-devicequantization

Tool

Neuphonic

VoiceGenerative Media

neuphonic

Text-to-speech via Neuphonic's API.

ttsvoice-cloningon-devicegguf

Tool

Moondream

Inference

m87-labs

Small open-source vision-language model with a local server and client SDKs for VQA, captioning, pointing and object detection in agent pipelines.

vision-language-modelimage-captioningobject-detectionmultimodal

Tool

Hermes-Agent Mobile

Deployment

amirghm

Installs the Hermes Agent framework on Android (Termux) and iOS (iSH) to run agents locally on a phone

androidtermuxtelegramlocal-first

Tool

Minions

Coding

HazyResearch

A communication protocol that enables small on-device models to collaborate with frontier models in the cloud

local-firsttoken-optimizationollamaon-device

BaseRT

Inference

6.4x faster than llama.cpp, 3.9x faster than MLX

apple-siliconlocal-firstmacosllm-runtime