Robots.txt Generator

Build a valid robots.txt file from simple selections, including optional AI crawler blocking.

Allow all crawlers by default

Disallow paths (one per line)

Sitemap URL

Block specific AI crawlers

Blocking AI crawlers stops them from training on your content, but it may also reduce your visibility in AI-powered search and citations — see what GEO is.

Generated robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /api/

Sitemap: https://answerstack.vercel.app/sitemap.xml

Get the AI Automation & AI Search Starter Kit

A free checklist and template pack covering AI automation workflows, AEO/GEO content structure, and chatbot planning. One email a week, no spam.