Fast, local GGUF inference for the GPUs people already own. ZINC is one Zig binary with a command line, browser chat, model manager, and OpenAI-compatible API.
Get started · See every benchmark · Read the docs · Join Discord
ZINC beats the comparison llama.cpp build on prefill, decode, and combined time for all six models in the current Radeon AI PRO R9700 ROCm core suite. Both engines use the same GPU, GGUF files, prompts, reusable servers, warmups, and measured run counts.
That is a scoped, reproducible result—not a claim about every model or GPU. The live benchmark page includes all four workloads, raw samples, exact prompts, build revisions, and the checked-in JSON.
