Robots.txt Generator
Create instructions for search engine crawlers.
Robots.txt tells search engine crawlers which pages or files the crawler can or can't request from your site.
Preview robots.txt
User-agent: * Disallow: /admin Disallow: /private Allow: /