What it does
Loads all XML sitemaps of a domain (from robots.txt, sitemap indexes recursively, gzip supported), takes inventory (URL count, lastmod quality, duplicates, foreign hosts, http URLs, size limits) and checks a stratified sample of URLs for status 200, redirects, noindex, robots.txt blocking and self-canonical. Only URLs on the own site of the sitemap (same host or subdomains) are fetched; URLs on other hosts are counted, not fetched. Use when asked whether a sitemap is clean or why sitemap URLs are not indexed. Returns findings with counts extrapolated to the whole sitemap and examples. Takes 10 to 40 seconds.
~25 s · up to 400 requests · v1.0.0