Bot verifier

bot_verifier

Checks whether an IP really belongs to the crawler its user agent claims, using published ranges and reverse DNS.

What it does

Verifies whether IP addresses really belong to the crawler their user agent claims (Googlebot, Bingbot, GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Applebot and others) using the operators' published IP ranges and forward-confirmed reverse DNS. Accepts IPs, IP plus user agent pairs, or raw access log lines. Use when asked whether bot traffic in logs is real, how much of it is spoofed, or before allowlisting or blocking a crawler. Returns pass/warn/fail with findings, a verdict per IP and totals per bot. Takes 1 to 15 seconds.

~8 s · up to 0 requests · v1.0.0

Call it from code

REST endpoint (POST)

https://tech-seo.de/api/v1/checks/bot_verifier

MCP tool name

bot_verifier

cURL

curl -X POST https://tech-seo.de/api/v1/checks/bot_verifier \
  -H 'content-type: application/json' \
  -d '{"ips":["66.249.66.1"]}'

Parameters and result format →

What the check looks at

Each IP is compared with the operators' published ranges and, where the operator documents it, forward-confirmed reverse DNS. The website that produced the log is never contacted.

Bot	Methods	Sources
`googlebot_image`search	ip_ranges, rdns	google_common (snapshot, 317)
`googlebot_video`search	ip_ranges, rdns	google_common (snapshot, 317)
`googlebot_news`search	ip_ranges, rdns	google_common (snapshot, 317)
`storebot`search	ip_ranges, rdns	google_common (snapshot, 317)
`googlebot`search	ip_ranges, rdns	google_common (snapshot, 317)
`google_special`ads	ip_ranges, rdns	google_special (snapshot, 272)
`google_user_triggered`other	ip_ranges, rdns	google_user_fetchers (snapshot, 1062), google_user_fetchers_google (snapshot, 502), google_user_agents (snapshot, 20)
`bingbot`search	ip_ranges, rdns	bingbot (snapshot, 28)
`chatgpt_user`ai_user_fetch	ip_ranges	openai_chatgpt_user (snapshot, 230)
`oai_searchbot`ai_search	ip_ranges	openai_searchbot (snapshot, 39)
`oai_adsbot`ads	ip_ranges	openai_adsbot (snapshot, 2)
`gptbot`ai_training	ip_ranges	openai_gptbot (snapshot, 18)
`claude_user`ai_user_fetch	ip_ranges	anthropic_bots (snapshot, 28)
`claude_searchbot`ai_search	ip_ranges	anthropic_bots (snapshot, 28)
`claudebot`ai_training	ip_ranges	anthropic_bots (snapshot, 28)
`perplexity_user`ai_user_fetch	ip_ranges	perplexity_user (snapshot, 4)
`perplexitybot`ai_search	ip_ranges	perplexity_bot (snapshot, 8)
`applebot`search	ip_ranges, rdns	applebot (snapshot, 24)
`duckduckbot`search	ip_ranges	duckduckbot (snapshot, 486)
`ccbot`ai_training	ip_ranges, rdns	ccbot (snapshot, 5)
`amazonbot`search	rdns	—
`yandexbot`search	rdns	—
`baiduspider`search	rdns	—
`meta_externalagent`ai_training	not verifiable	—
`facebookexternalhit`other	not verifiable	—
`bytespider`ai_training	not verifiable	—
`techseobot`other	not verifiable	—
`google_extended`ai_training	not verifiable	—
`applebot_extended`ai_training	not verifiable	—