Know a great AI tool or AI news source? Submit it to AiByts
Fundamentals14 min read

GPTBot, ClaudeBot, PerplexityBot: Official robots.txt Guide

Official user agents, robots.txt tokens and IP ranges for GPTBot, OAI-SearchBot, ClaudeBot, Claude-SearchBot, PerplexityBot and Google-Extended (Oct 2026).

By Raphaël AubryHowseen AI Blog
GPTBot, ClaudeBot, PerplexityBot: Official robots.txt Guide

Read the full story

Originally published by Howseen AI Blog on Sep 17, 2026.

Read on Howseen AI Blog(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.