MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl.
Are you the maintainer?
Claim this page →Jevcrawl
A web crawler for AI agents with no LLM in the crawl loop
01 / Summary
About Jevcrawl.
02 / Discussion CREDIBILITY-GATED
Discussion
Reading is open to everyone. Posting and voting need a verified identity or a GitHub grade of B or higher.
- No discussions yet.
03 / Related
More around Jevcrawl.
Similar tools
OKF Agent Memory
Git-native persistent memory for AI coding agents.
OpenBiliClaw
本地私有的跨平台 AI 内容发现 Agent——先深度理解你,再主动去 B站/小红书/抖音/YouTube/X/知乎/Reddit 找你会喜欢的内容。Local-first AI agent that learns who you are, then hunts content
Qmd
mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
ScrapeGraphAI
ScrapeGraphAI is known for pointing an LLM at a web page and getting structured JSON back. Convenient, until you scrape
04 / Build
Build with Jevcrawl.
Browse the catalog for frameworks, tools, and harnesses, each scored on real GitHub credibility.
Get Jevcrawl →