Verifying Your Domain
Verify domain ownership using DNS TXT records to enable link health monitoring
Overview
Domain verification proves that you own or control the domain you want to monitor. This security measure prevents unauthorized users from crawling websites they don't own.
Verification is required before you can:
- Start your first crawl
- Access crawl history
- Generate SEO reports
- Use AI-powered features
Verification is a one-time process. Once verified, your domain stays verified unless you remove and re-add it.
How DNS Verification Works
When you add a domain to SEO Crawler, we generate a unique verification token. You prove ownership by adding this token as a DNS TXT record to your domain's DNS settings.
The Process:
1. You add domain to SEO Crawler ↓ 2. We generate unique verification token ↓ 3. You add TXT record to DNS ↓ 4. DNS propagates (up to 48 hours) ↓ 5. You click "Check DNS" ↓ 6. We verify the record exists ↓ 7. Domain is verified ✓
Step-by-Step Verification
Add Your Domain
Navigate to **Domains** → **Add Domain** and enter your domain name. Click **Continue** to proceed to the verification page.
Copy Your Verification Token
On the verification page, you'll see a unique verification token:
seo-crawler-verify=abc123def456...
Click the Copy Token button to copy it to your clipboard.
Your verification token is unique to your domain and account. Don't share it with others.
Access Your DNS Provider
Log in to your DNS provider (where you manage your domain's DNS records). Common providers include:
- Cloudflare - DNS dashboard
- GoDaddy - DNS Management
- Namecheap - Advanced DNS
- AWS Route 53 - Hosted zones
- Google Domains - DNS settings
If you're not sure who manages your DNS, check your domain registrar or ask your hosting provider.
Create TXT Record
Add a new DNS record with these exact settings:
| Field | Value |
|---|---|
Type | TXT |
Name | @ (or leave blank for root domain) |
Value | seo-crawler-verify=your-token-here |
TTL | 3600 (or default) |
For subdomains like blog.mysite.com, set the Name field to blog instead of @.
Save DNS Changes
Save the new TXT record in your DNS provider's dashboard. Changes may take a few minutes to process.
Wait for DNS Propagation
DNS changes can take anywhere from **5 minutes to 48 hours** to propagate globally. Most providers propagate within 10-30 minutes.
You don't need to stay on the verification page. You can close it and come back later to verify.
Check DNS Verification
Return to your domain's verification page and click **Check DNS**. If the record is found, your domain will be instantly verified!
If verification fails, see the troubleshooting section below.
Provider-Specific Guides
Verifying Subdomains
Subdomains like blog.mysite.com require the TXT record to be added to the subdomain, not the root domain.
For blog.mysite.com:
| Field | Value |
|---|---|
Type | TXT |
Name | blog |
Value | seo-crawler-verify=your-token |
Do NOT add the TXT record to @ for subdomains. Use the subdomain name in the Name field.
Verification Status
Your domain can have one of these verification statuses:
| Status | Badge | Meaning | Action Required |
|---|---|---|---|
Verified | 🟢 | Domain ownership confirmed | None - you can start crawling |
Pending | 🟡 | Verification in progress | Add TXT record and click "Check DNS" |
Failed | 🔴 | Verification could not complete | See troubleshooting below |
Checking DNS Propagation
You can manually check if your TXT record has propagated using these tools:
Command Line (Terminal/CMD):
# Linux/Mac dig TXT mysite.com # Windows PowerShell Resolve-DnsName -Type TXT mysite.com # Windows CMD nslookup -type=TXT mysite.com
Online Tools:
- DNS Checker - Check propagation globally
- What's My DNS - Global DNS propagation
- MX Toolbox - TXT record lookup
Look for a TXT record that starts with seo-crawler-verify= in the results.
Troubleshooting
Security & Privacy
Why Do We Require Verification?
Domain verification prevents:
- Unauthorized crawling - Users can't crawl websites they don't own
- Privacy violations - Protects website owners from unwanted monitoring
- Resource abuse - Prevents malicious use of our crawling infrastructure
- Data leakage - Ensures only authorized users see crawl data
Can I Remove the TXT Record After Verification?
No - The TXT record must remain in your DNS for continuous verification.
We periodically re-check the TXT record to ensure ongoing ownership. If the record is removed:
- Your domain becomes unverified
- You cannot start new crawls
- Existing data remains accessible
- You must re-verify to resume crawling
What If Someone Else Verified My Domain?
If you believe someone else has incorrectly verified your domain:
- Contact support immediately with proof of ownership
- We'll investigate and revoke unauthorized access
- You can then add and verify the domain yourself
Verification Token Management
Token Format
Verification tokens follow this format:
seo-crawler-verify=[32-character-random-string]
Example:
seo-crawler-verify=a1b2c3d4e5f6g7h8i9j0k1l2m3n4o5p6
Token Security
- Each domain gets a unique token
- Tokens are cryptographically random (UUID v4)
- Tokens are tied to your account and domain
- Tokens cannot be guessed or brute-forced
You don't need to keep your token secret, but don't share it unnecessarily.
Regenerating Tokens
You cannot regenerate verification tokens. If you need a new token:
- Delete the domain from your account
- Re-add the domain
- You'll receive a new verification token
After Verification
Once your domain is verified, you can:
Start Your First Crawl
Run a comprehensive link health scan.
<Card title="Configure Crawl Settings" icon="gear" href="/crawling/crawl-settings"
Customize crawl depth, exclusions, and more.
<Card title="Set Up Monitoring" icon="bell" href="/monitoring/alerts"
Get notified of broken links and SEO issues.
<Card title="API Integration" icon="code" href="/api/getting-started"
Integrate SEO Crawler into your workflow.
Quick Reference
TXT Record Template
Type: TXT Name: @ (or subdomain name) Value: seo-crawler-verify=[your-unique-token] TTL: 3600 (or default)
DNS Commands Cheat Sheet
# Check TXT records (Linux/Mac) dig TXT mysite.com # Check TXT records (Windows PowerShell) Resolve-DnsName -Type TXT mysite.com # Check specific subdomain dig TXT blog.mysite.com # Force fresh DNS lookup (Linux/Mac) dig TXT mysite.com @8.8.8.8
Common DNS Propagation Times
| Provider | Typical Time | Maximum Time |
|---|---|---|
Cloudflare | 2-5 minutes | 10 minutes |
AWS Route 53 | 5-10 minutes | 30 minutes |
Google Domains | 10-30 minutes | 2 hours |
GoDaddy | 10-30 minutes | 48 hours |
Namecheap | 10-30 minutes | 48 hours |
Other providers | 30-60 minutes | 48 hours |
Need Help?
Contact Support
Get help from our support team.
<Card title="Community Forum" icon="comments" href="/community"
Ask questions and share solutions.
Pro Tip: Add the TXT record immediately after creating your domain in SEO Crawler. By the time you finish reading the docs, DNS will likely have propagated!