Header inspector

header_inspector

Compares status codes, raw HTTP headers and HTML head signals for several user agents.

What it does

Requests one URL with several user agents (browser, Googlebot, Bingbot, AI crawlers) and compares status codes, raw HTTP headers (X-Robots-Tag, Link canonical, caching, Vary, compression) and HTML head signals per UA. Use when asked whether bots see the same page as users, whether a site blocks AI crawlers, or which headers a URL really sends. Returns pass/warn/fail with findings, captured headers per UA and a diff matrix. Takes 2 to 6 seconds.

~4 s · up to 60 requests · v1.0.0

Call it from code

REST endpoint (POST)

https://tech-seo.de/api/v1/checks/header_inspector

MCP tool name

header_inspector

cURL

curl -X POST https://tech-seo.de/api/v1/checks/header_inspector \
  -H 'content-type: application/json' \
  -d '{"url":"https://example.com/"}'

Parameters and result format →