Project Awesome project awesome

Acquisition > Brozzler

A distributed web crawler (爬虫) that uses a real browser (Chrome or Chromium) to fetch pages and embedded urls and to extract links. (Stable)

Package GitHub
Back to Web Archiving