Web Crawler

Version 3.0.0: The Advanced Crawler Update! This is the biggest update to Web Crawler yet! We've completely rebuilt the engine to transform it from a simple scraper into a powerful, intelligent, multi-page crawling tool. Thank you for your feedback! ✨ New Major Features: Multi-Page Crawling: Unleash the crawler's true potential! You can now set a "Crawl Depth" to automatically navigate from page to page, extracting data from an entire website, not just a single page. Advanced Data Extraction Engine: The simple extractor is now a powerful and precise tool. You can now define a "Container" for repeating items (like product listings or blog posts) and specify multiple "Fields" to extract structured data (like Title, Price, and Image URL) all at once. Full Crawl Control: You are now in complete command of the crawling process. New Pause, Resume, and Stop buttons give you the flexibility to manage long-running tasks. Export to CSV: By popular demand! You can now export your extracted data directly to a CSV file, ready to be opened in Microsoft Excel or Google Sheets. The original JSON export is still available. 🚀 Improvements & Fixes: Smarter Scraping: The crawler now intelligently detects and ignores the content from "404 Not Found" error pages, giving you much cleaner and more relevant data. Interactive Tutorial: A new "Help" icon opens a tutorial that clearly explains how to use the new Advanced Data Extraction system, complete with visual examples. Upgraded Dark Mode: Dark Mode now works better than ever and will automatically match your system's theme on the first launch. You can always toggle it manually to suit your preference. We're excited for you to try out these powerful new features. As always, please use the "Send Feedback" button to let us know what you think or what you'd like to see next!