Firecrawl turns web pages into data an LLM can use: it searches the web, scrapes URLs, and crawls whole sites, returning clean markdown, HTML, screenshots, or structured JSON. It handles the parts of scraping that break naive fetchers, including rotating proxies, rate limits, JavaScript-rendered pages, and blocked content, and it parses web-hosted PDFs and DOCX files.
The core endpoints are Search (web results with full page content), Scrape (one URL to markdown, HTML, screenshots, or JSON), and Interact (scrape a page, then operate it with AI prompts or code). Further endpoints crawl every page of a site, map a site's URLs, batch-scrape thousands of URLs asynchronously, and run an Agent that finds and retrieves data from a plain-language prompt without needing URLs up front. The Agent runs on Firecrawl's own spark-2 model, with a low, medium, or high effort setting that changes its reasoning budget.
Firecrawl is available as a hosted API and as open source that can be self-hosted, and the cloud version adds features beyond the open-source build. Agents connect through an MCP server, a CLI, or an agent skill that works with Claude Code, Antigravity, OpenCode, and other coding agents.
Features
- Search: web search that returns the full content of each result
- Scrape: converts any URL to markdown, HTML, screenshots, or structured JSON
- Interact: acts on a scraped page through AI prompts or code, such as searching a site and clicking a result
- Crawl and map: fetches every page of a site in one request or lists all of its URLs, with search to rank them
- Batch scrape: scrapes thousands of URLs asynchronously
- Agent: gathers data from a prompt alone, optionally scoped to URLs and returned against a schema
- Actions: click, scroll, write, wait, and press before extracting content
- Media parsing: extracts content from web-hosted PDFs and DOCX files
- SDKs: Python, Node.js, Go, Java, Elixir, Rust, Ruby, .NET, and PHP
- Agent access: an MCP server, a CLI, and a skills catalog for coding agents
- Platform integrations: Lovable, Zapier, and n8n
