Robots.txt Generator — Create a valid robots.txt for Blogger, WordPress, or any site in 20 seconds. Blocks AI scrapers (GPTBot, CCBot, ClaudeBot), allows Googlebot, and includes sitemaps. No signup, runs 100% in your browser.

What it does

  • Generates clean robots.txt with Allow/Disallow for Blogger
  • One-click block for GPTBot, CCBot, Google-Extended, ClaudeBot, Bytespider, Applebot-Extended
  • Auto-adds sitemap.xml and sitemap-pages.xml
  • Validates syntax before copy

How to use

  1. Enter your sitemap URLs (we prefill for Blogger)
  2. Choose which AI bots to block
  3. Click Generate → Copy
  4. Blogger → Settings → Crawlers → Custom robots.txt → Paste → Save

FAQ

Should I allow /search/label/ in Blogger?
Yes. Allow: /search/label/ helps Google discover topic pages. Block only /search?q= and updated-min/max.
Will blocking GPTBot hurt SEO?
No. GPTBot is for AI training, not search ranking. Blocking it does not affect Googlebot.