How to Check Robots.txt & Sitemap Coverage in AmICited

If AI crawlers can’t read your site, none of your other optimization matters. The Robots.txt & Sitemaps check confirms the crawlers you care about are allowed in — and that your sitemaps actually point them to your content.

Where to find it

It’s the Robots.txt & Sitemaps section of Audit → Agent Accessibility.

What it checks

As the section explains, it looks at “whether the important AI and search crawlers are allowed to read the site, whether sitemaps are declared in robots.txt, and how many URLs those sitemaps list in total.” In short:

• Crawler access — are the major AI and search bots permitted (not disallowed) in robots.txt?
• Sitemap declaration — is a sitemap referenced from robots.txt so crawlers can find it?
• Sitemap coverage — how many URLs your sitemaps list in total.

How to use it

1. Confirm crawlers are allowed. If an important AI bot is blocked, fix the robots.txt rule — this is the highest-priority issue on the page.
2. Declare your sitemap. Make sure robots.txt points to your sitemap so agents can discover all your pages.
3. Check the URL count. A sitemap listing far fewer URLs than you have published means pages aren’t being advertised to crawlers.
4. Re-check after edits and confirm the Crawler access and Sitemap URLs tiles in the readiness summary turn healthy.

Crawler access is the foundation: get it right first, because everything else assumes the bots can actually reach your content.