Website Crawler
Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues.
What Website Crawler is
Website Crawler is a cloud-based analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems. For JavaScript-heavy sites, it offers Chrome and HTML crawl modes; HTML mode processes raw HTML only. Users can define custom extraction with CSS or XPath selectors and JavaScript snippets. Results can be exported as CSV, Markdown, or JSON, and the API returns structured JSON. The service also provides uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan monitoring intervals range from five minutes to one minute. Integrations described include read-only Google Search Console access and Slack notifications to a selected channel. The free Basic plan allows 10 URLs per day and one project. Starter is $10 a month for 2,000 pages monthly and three projects; Growth is $20 a month, and Scale is $60 a month. The service handles publicly available HTML-page information and does not submit forms.
Good
- Finds multiple on-page SEO issues
- Supports CSS and XPath extraction
- Exports CSV, Markdown, or JSON
- API returns structured JSON
- Free plan allows 10 URLs daily
Watch out
- Free-plan allowance is 10 URLs per day
- HTML mode processes raw HTML only
- Does not automatically submit forms
Who it suits
Website owners, site analysts, and researchers or students seeking web datasets may find its crawling, extraction, and export tools useful. It is also suited to teams that need scheduled audits or uptime alerts.
Verdict
Website Crawler combines audits, configurable extraction, exports, and monitoring in a web-based service. Check the crawl limits and mode behavior against the pages and data you need to process.
Plans and prices
From Website Crawler's own pricing page, checked 29 Sep 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Basic | Free | 10 pages / day · No monthly quota · 1 project |
| Starter | $10 a month | 2,000 pages / month · 3 projects · $5 per 1000 pages · $10 / Month |
| Growth | $20 a month | 10,000 pages / month · 10 projects · $2 per 1000 pages · $20 / Month |
| Scale | $60 a month | 50000 pages / month · 50 projects · $1.2 per 1000 pages · $60 |
| Enterprise | Priced on request | Up to 1M pages / mo · 100 projects · Unlimited team members · Starting around $90 / month |
The facts
Each one read from Website Crawler's own pages, with the date it was checked.
What it does
- API access
- Yeschecked 21 Sep 2026
- Crawl scope limit
- The service works with publicly available information on HTML pages and does not automatically fill in or submit forms.checked 29 Sep 2026
- Custom extraction
- Users can configure extraction with CSS or XPath selectors and JavaScript snippets.checked 29 Sep 2026
- Exports and API
- Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data.checked 29 Sep 2026
- Integrations
- The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel.checked 29 Sep 2026
- Intended users
- The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects.checked 29 Sep 2026
- JavaScript crawling
- It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only.checked 29 Sep 2026
- Monitoring
- The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute.checked 29 Sep 2026
- Paid from
- 20checked 21 Sep 2026
- Product
- Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues.checked 29 Sep 2026
- Security and privacy
- The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted.checked 29 Sep 2026
- SEO audits
- The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems.checked 29 Sep 2026
- Support
- The maker says it provides email support on weekdays and weekends and replies within two to three hours.checked 29 Sep 2026
Money
- Free plan
- Yeschecked 21 Sep 2026
- Free-plan limits
- The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings.checked 29 Sep 2026
Alternatives to Website Crawler
- 1
DefiniteSEO
Free planOpen sourceAndroidiOSWebAPI9.0From $4.99 a month - 2
Marketing Miner
Free planAndroidiOSWebAPI8.8From €19 a month - 3
Rank Math SEO
Free planOpen sourceWebAPISelf-hosted8.7Free plan - 4
Yoast SEO
Free planOpen sourceWebAPISelf-hosted8.7From $118.80 a year - 5
Screaming Frog SEO Spider
Free planAPILinuxmacOSSelf-hosted8.6Free plan - 6
SEO PowerSuite
Free planAPILinuxmacOSWindows8.5From $349 a year