Website Crawler
- Android app
- Not listed
- Free plan
- Yes
- Paid plans from
- $10/mo
- Runs on
- api, Web
Summary
Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. For JavaScript-heavy sites, it offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. Users can define custom extraction with CSS or XPath selectors and JavaScript snippets. Results can be exported as CSV, Markdown, or JSON, and the API returns structured JSON. The service also provides uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations described include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 URLs per day and one project. Starter is 10.00 USD per month for 2,000 pages monthly and three projects; Growth is 20.00 USD per month, and Scale is 60.00 USD per month. The service handles publicly available HTML-page information and does not submit forms.
Who it is for
Website owners, site analysts, and researchers or students seeking web datasets may find its crawling, extraction, and export tools useful. It is also suited to teams that need scheduled audits or uptime alerts.
What is good
- Finds multiple on-page SEO issues
- Supports CSS and XPath extraction
- Exports CSV, Markdown, or JSON
- API returns structured JSON
- Free plan allows 10 URLs daily
What to know first
- Free-plan allowance is 10 URLs per day
- HTML mode processes raw HTML only
- Does not automatically submit forms
Verdict
Website Crawler combines audits, configurable extraction, exports, and monitoring in a web-based service. Check the crawl limits and mode behavior against the pages and data you need to process.
Website Crawler plans and pricing
All plansCompared on SEO tools
- Free plan
- Yeswebsitecrawler.org
- Paid from
- $20/mowebsitecrawler.org
- Scheduled audits
- Yeswebsitecrawler.org
- JavaScript crawling
- Yeswebsitecrawler.org
- On-page audits
- Yeswebsitecrawler.org
- Search visibility audits
- Yeswebsitecrawler.org
- API access
- Yeswebsitecrawler.org
Facts
- Product
- Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues.websitecrawler.org · 29 Sept 2026
- SEO audits
- The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems.websitecrawler.org · 29 Sept 2026
- Custom extraction
- Users can configure extraction with CSS or XPath selectors and JavaScript snippets.websitecrawler.org · 29 Sept 2026
- Exports and API
- Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data.websitecrawler.org · 29 Sept 2026
- Integrations
- The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel.websitecrawler.org · 29 Sept 2026
- Monitoring
- The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute.websitecrawler.org · 29 Sept 2026
- Security and privacy
- The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted.websitecrawler.org · 29 Sept 2026
- Crawl scope limit
- The service works with publicly available information on HTML pages and does not automatically fill in or submit forms.websitecrawler.org · 29 Sept 2026
- Free-plan limits
- The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings.websitecrawler.org · 29 Sept 2026
- Support
- The maker says it provides email support on weekdays and weekends and replies within two to three hours.websitecrawler.org · 29 Sept 2026
- Intended users
- The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects.websitecrawler.org · 29 Sept 2026
Best Website Crawler alternatives
See all 20
Where it ranks on Everything Xiaomi
- Best SEO Tools in 2026#89 of 245
- Best SEO Audit Software in 2026#7 of 35
Is Website Crawler yours?
Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.
Sources
- websitecrawler.org/about· checked 29 Sept 2026
- websitecrawler.org· checked 29 Sept 2026
- websitecrawler.org/pp· checked 29 Sept 2026
- websitecrawler.org/pricing· checked 29 Sept 2026