Website Crawling
Understanding Crawls
Learn how website crawls work and how to start scanning your site.
Updated December 9, 2025
What is a Crawl?
A crawl is an automated scan of your website that:
- Visits your homepage
- Finds all links
- Follows links to discover more pages
- Checks each link's status
- Reports broken links and issues
Starting a Crawl
1
Select Domain
Go to Domains and click your verified domain.
2
Click Start Crawl
Click the **Start Crawl** button.
3
Wait
Crawl runs automatically (5-20 minutes typical).
4
Review Results
Check dashboard for broken links.
Crawl Progress
While running, you'll see:
- Links checked so far
- Broken links found
- Estimated time remaining
- Live progress percentage
You can close the page - crawl continues in background!
Daily Limits
| Plan | Crawls/Day |
|---|---|
Free | 2 |
Solo | 5 |
Pro | 10 |
Agency | 25 |