Collection
Run agents on your own machine
Runtimes, models and tooling that work on hardware you control.
68 tools · showing 1–24
Training Mlx
MLX: An array framework for Apple silicon
Voice whisper.cpp
C/C++ port of OpenAI's Whisper speech-recognition model, dependency-free and optimized for on-device inference
Deployment llama.cpp
LLM inference in C/C++ across CPU and GPU backends, using the GGUF format with quantization, a REST server, and a WebUI
Coding LiteRT
On-device runtime (formerly TensorFlow Lite) for running models at the edge.
Inference Manifest
Open-source LLM router exposing one OpenAI-compatible endpoint across API keys, subscriptions, and local models, with cost tracking
Coding OpenCodex
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, an
Inference +1LocalAI
Self-hosted engine that runs LLM, vision, voice, image, and video models on any hardware behind OpenAI-compatible APIs
Inference Ollama
Runs open large language models locally without an API key
oMLX
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Foundry Local
Foundry Local is an end-to-end local AI solution for building applications that run entirely on the user's device.
Coding Ante Preview
Ghost in your shell. Ante is a self-contained agent harness with a highly optimized core. It works like Claude Code or Codex, with none of t
Interface +1Jan
Desktop app for running open-weight LLMs locally or connecting to cloud providers, exposing an OpenAI-compatible local API
Deployment Mesh LLM
Distributed LLM inference that pools GPUs across machines and serves one OpenAI-compatible API, splitting large models across nodes
MNN
Lightweight deep learning engine for on-device inference and training, with runtimes for local LLMs and diffusion models
Coding Nanocoder
An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your
Olive
Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
Open WebUI
Self-hosted, offline-capable AI platform for Ollama and OpenAI-compatible models with RAG, tools, and multi-user access control
Inference +1Osaurus
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity
Inference +2Superlinked Inference Engine (SIE)
Self-hosted Kubernetes inference cluster serving LLMs, embeddings, rerankers, OCR and vision models with cluster-wide batching.
Inference +2MLX-Serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mo
Inference +1OpenSquilla
Token-efficient microkernel AI agent with an on-device model router, persistent memory and pluggable multi-provider support
Interface +1Apfel
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API key
Inference +1Exo
Open-source distributed inference runtime that pools everyday devices into one local cluster to serve frontier models behind an OpenAI-compatible API.
Atomic Agent
Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.
More ways in
Start with another goal.

Code with an agent
Agents and libraries that read, write and review code in your repo.
Browse tools

Build a personal assistant
Runtimes and skills for an agent that handles your inbox, calendar and daily errands.
Browse tools

Research and write from your own sources
Deep-research pipelines, drafting tools and retrieval over your own documents.
Browse tools

Automate your marketing
Agents that draft content, schedule posts, research leads and keep campaigns running.
Browse tools

Answer your customers
Support agents, help-desk integrations and the chat channels they answer on.
Browse tools

Create images, video and music
Generation and editing for imagery, animation, video and audio.
Browse tools

Give agents a voice
Speech recognition, synthesis and the parts of a spoken conversation.
Browse tools