Crawler.sh
Free Local AEO & SEO Spider and a Markdown content extractor
About Crawler.sh
A fast, local-first web crawler and AEO & SEO analysis tool. Crawl entire sites in seconds from the terminal or a native desktop app, run automated SEO checks, extract content as clean Markdown, and export to JSON, CSV, or Sitemap XML.
Demo
Screenshots
Maker
Listed from Product Hunt. Claude Updates summarizes public launches and links back to the source.
