AcademyMCP serversData and reporting

WebReaper

Research, marketing and data teams that need web pages turned into clean text for analysis or for an assistant.

  • Listedour rating
  • 150gitHub stars
  • MITlicence
  • 7 days agolast update
git clone https://github.com/alex-on-ai/WebReaper.git
README.md

Loading the file...

What it does

A web scraper that returns clean Markdown and ships as a single binary with a bundled Claude Code skill. You can scrape a page, crawl a site or map its pages from the command line, and it is also available as a .NET library.

Use cases

  1. 01Turn a web page into Markdown for review
  2. 02Crawl a site to collect its content
  3. 03Map the pages of a competitor's website

Questions about
WebReaper.

What is WebReaper used for?

Research, marketing and data teams that need web pages turned into clean text for analysis or for an assistant. A web scraper that returns clean Markdown and ships as a single binary with a bundled Claude Code skill. You can scrape a page, crawl a site or map its pages from the command line, and it is also available as a .NET library.

How do I install WebReaper?

Run this in your terminal: git clone https://github.com/alex-on-ai/WebReaper.git

Is WebReaper open source?

Yes. The code is on GitHub (alex-on-ai/WebReaper) under the MIT licence.

Is WebReaper safe to use?

Our automatic scan flagged points to review, so read the code before installing it. Third party open source software. Sabemos AI does not maintain it. Check the code and permissions before you connect it to company data.