This is an early release preview. You may encounter bugs.
PixelRAG logo
Unclaimed

Tool memory research

PixelRAG

The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

B 78/100 GitHub score ? This grade is derived from GitHub signals, not user votes. Open for the full breakdown.
Discussion

01 / Summary

About PixelRAG.

PixelRAG is the code release for the paper "PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation" from Berkeley's Sky Computing Lab, BAIR, and Berkeley NLP. It renders documents (web pages, PDFs, and images) as screenshot tiles and retrieves over the images directly, so tables, charts, layout, and infographics that HTML-to-text parsing discards remain available to the reader model.

Two pieces make this work: rendering documents to images instead of parsing them, and a Qwen3-VL-Embedding model fine-tuned with LoRA on screenshot data so that visual content is retrievable. The pipeline runs in stages: capture pages into tiles with headless Chromium, chunk and embed the tiles, build a FAISS index, and serve a search API on CPU or GPU. Indexing runs on Linux with CUDA or on Apple Silicon.

A hosted endpoint serves a pre-built index of 8.28 million Wikipedia pages with no API key and accepts text or image queries, and the pre-built FAISS indexes (Wikipedia pixel and text, and a news pixel index) are published on Hugging Face. The training code, data, and synthetic query pipeline are released so other embedding backbones can be adapted.

The renderer also ships as the pixelbrowse skill for Claude Code and as a plugin for OpenCode. Instead of fetching raw HTML, the agent screenshots a page and reads the image, with no MCP server or backend involved.

  • Screenshot rendering: web pages and PDFs rendered to image tiles through headless Chromium
  • Visual embeddings: a LoRA-fine-tuned Qwen3-VL-Embedding model that embeds page images for retrieval
  • Staged pipeline: chunk, embed, build a FAISS index, and serve, installable stage by stage
  • Hosted Wikipedia index: 8.28 million pages searchable by text or image query with no API key
  • Pre-built indexes: Wikipedia pixel, Wikipedia text, and news pixel FAISS indexes on Hugging Face
  • Bring your own documents: build an index from a local folder or PDF on CUDA or Apple Silicon
  • Agent browsing skill: the pixelbrowse skill lets Claude Code and OpenCode read pages as screenshots
  • Training release: training code, screenshot dataset, and the synthetic query and hard-negative pipeline

02 / Discussion CREDIBILITY-GATED

Discussion

Reading is open to everyone. Posting and voting need a verified identity or a GitHub grade of B or higher.

  • No discussions yet.

04 / Build

Build with PixelRAG.

Browse the catalog for frameworks, tools, and harnesses, each scored on real GitHub credibility.

Get PixelRAG →

Browse the catalog