What it does
This n8n workflow sends a list of URLs to the Firecrawl.dev API. It converts the HTML of each page to Markdown and extracts the links found on it. Requests are paced to respect rate limits, and URLs are processed in batches from your data source.
Use cases
- 01Turn a list of web pages into Markdown for an LLM
- 02Collect all the links found on a set of pages
- 03Process URLs from a database in controlled batches
Connects
HTTP Request