This is an early release preview. You may encounter bugs.

Run agents on your own machine

Runtimes, models and tooling that work on hardware you control.

68 tools · showing 1–24

Training

Mlx

MLX: An array framework for Apple silicon

A+
Voice

whisper.cpp

C/C++ port of OpenAI's Whisper speech-recognition model, dependency-free and optimized for on-device inference

A+
Deployment

llama.cpp

LLM inference in C/C++ across CPU and GPU backends, using the GGUF format with quantization, a REST server, and a WebUI

A+
Coding

LiteRT

On-device runtime (formerly TensorFlow Lite) for running models at the edge.

A+
Inference

Manifest

Open-source LLM router exposing one OpenAI-compatible endpoint across API keys, subscriptions, and local models, with cost tracking

A+
Coding

OpenCodex

Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, an

A+
Inference +1

LocalAI

Self-hosted engine that runs LLM, vision, voice, image, and video models on any hardware behind OpenAI-compatible APIs

A
Inference

Ollama

Runs open large language models locally without an API key

A
Deployment

oMLX

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

A
Deployment +2

Foundry Local

Foundry Local is an end-to-end local AI solution for building applications that run entirely on the user's device.

A
Coding

Ante Preview

Ghost in your shell. Ante is a self-contained agent harness with a highly optimized core. It works like Claude Code or Codex, with none of t

A
Interface +1

Jan

Desktop app for running open-weight LLMs locally or connecting to cloud providers, exposing an OpenAI-compatible local API

A
Deployment

Mesh LLM

Distributed LLM inference that pools GPUs across machines and serves one OpenAI-compatible API, splitting large models across nodes

A
Coding

MNN

Lightweight deep learning engine for on-device inference and training, with runtimes for local LLMs and diffusion models

A
Coding

Nanocoder

An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your

A
Training

Olive

Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.

A
Interface

Open WebUI

Self-hosted, offline-capable AI platform for Ollama and OpenAI-compatible models with RAG, tools, and multi-user access control

A
Inference +1

Osaurus

Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity

A
Inference +2

Superlinked Inference Engine (SIE)

Self-hosted Kubernetes inference cluster serving LLMs, embeddings, rerankers, OCR and vision models with cluster-wide batching.

A
Inference +2

MLX-Serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mo

A
Inference +1

OpenSquilla

Token-efficient microkernel AI agent with an on-device model router, persistent memory and pluggable multi-provider support

A
Interface +1

Apfel

The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API key

A
Inference +1

Exo

Open-source distributed inference runtime that pools everyday devices into one local cluster to serve frontier models behind an OpenAI-compatible API.

A
Interface +2

Atomic Agent

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.

A