Robots.txt Generator

Generate a robots.txt file for your site.

Sitemap URL

Allow all crawlers (Allow: /)

Paths to disallow (one per line)

# robots.txt for https://yoursite.com
User-agent: *
Allow: /
Disallow: /admin
Disallow: /private

Sitemap: https://yoursite.com/sitemap.xml