What it does
A web crawler and search API that turns URLs into clean markdown or structured JSON. It covers search, scraping, site mapping, crawling and extraction. You can run it yourself as a small Rust binary or use the managed API, and the MCP server connects it to your agent.
Use cases
- 01Turn a web page into clean markdown
- 02Crawl a site and map its pages
- 03Extract structured data from a list of URLs