Robots.txt Generator

Create a robots.txt file to control how search engines crawl your site.

Use * for all bots, or specify like 'Googlebot'

Comma separated paths to block

Comma separated to explicitly allow

Generated Robots.txt

robots.txt
User-agent: *
Allow: /
Disallow: /admin
Disallow: /private