Catalogue

Tool

Graphify

MemoryCoding

safishamsi

AI coding-assistant skill that turns a folder of code, docs, papers, and images into a queryable knowledge graph

ragknowledge-graphtree-sittercli

Tool

LocalAI

InferenceGenerative Media

mudler

Self-hosted engine that runs LLM, vision, voice, image, and video models on any hardware behind OpenAI-compatible APIs

local-firstopenai-compatiblellama-cppmultimodal

Tool

MemoryBear

Memory

SuanmoSuanyangTechnology

MemoryBear Equip AI with human-like memory capability

long-term-memoryknowledge-graphneo4jmultimodal

Platform

LanceDB

Memory

lancedb

Developer-friendly open-source embedded/serverless vector database for multimodal AI, built on the Lance columnar format for billion-scale retrieval.

vector-dbsemantic-searchmultimodalembedded-database

Framework

Pipecat

Voice

pipecat-ai

Python framework for real-time voice and multimodal conversational agents, with composable pipelines over WebSockets or WebRTC

real-timemultimodalwebrtcvoice-agent

Tool

mistral.rs

Coding

EricLBuehler

Rust LLM inference engine with multimodal support, automatic quantization, and OpenAI- and Anthropic-compatible serving

quantizationopenai-compatiblemultimodallora

Tool

Shelley

CodingInterface

boldsoftware

Shelley is a coding agent

coding-agentguimobilemulti-provider

Framework

Smolagents

Coding

huggingface

Hugging Face library for agents that write their actions as Python code, with sandboxed execution

huggingfacecoding-agentmultimodalsandbox

Tool

TwelveLabs

MemoryData Wrangling

twelvelabs-io

Video intelligence API (Marengo embeddings, Pegasus video-language model) with SDKs and MCP integration for video search and reasoning.

videomultimodalvector-dbvideo-searchsdk

Tool

Screenshot to Code

Coding

abi

Converts screenshots, mockups, and screen recordings into HTML, Tailwind, React, Vue, Bootstrap, or Ionic code

ui-generationtailwindmultimodalfigma

Tool

UI-TARS-desktop

Interface

bytedance

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

multimodalbytedancecomputer-use

Tool

AgnesAI-Models

Coding

AgnesAI-Labs

Official Agnes AI gateway and model catalog for OpenAI-compatible text, image, video, and agent workflows

openai-compatiblegatewaymultimodalagent-workflows

Tool

Inter-1

Inference

Signals API over an omni-modal model that detects confidence, frustration, engagement and nine more cues from video

multimodalsocial-signalsemotion-detection

Tool

Moondream

Inference

vikhyat

Small open-source vision-language model with a local server and client SDKs for VQA, captioning, pointing and object detection in agent pipelines.

vision-language-modelimage-captioningobject-detectionmultimodal

Miora

Generative MediaMemory

Creative studio app that generates multimodal assets on an editable canvas and turns accumulated memory into reusable skills

productivitycanvasmultimodalskillcreative-studio

App

Text Generation Webui

InferenceTrainingGenerative Media

oobabooga

A desktop app for local LLMs. Open source, no telemetry. Text, vision, tool-calling, web search. UI + API.

productivitydesktoplocal-firstgguftool-calling

Ultravox

VoiceGenerative Media

Speech-language model fusing Whisper audio embeddings into Llama 3.1 70B for direct voice-agent conversation

speech-to-speechmultimodalllamareal-time