toolitda
한EN

toolitda / robots.txt Generator

robots.txt Generator

Generate robots.txt rules with crawl allow/disallow paths and sitemap URL.

robots.txt Generator

Generate robots.txt content that defines crawler access rules and sitemap location.

Basic Settings

Enter a site URL to auto-fill the sitemap location. If you enter a sitemap URL directly, that value is used first.

Crawl rule

Allow crawling all pages and tell search engines the sitemap location.

Generated robots.txt

Use this as the content of /robots.txt at the site root.

Next Checks

  1. 1Place the generated content at /robots.txt in the site root.
  2. 2Check that sitemap.xml actually opens.
  3. 3Run URL inspection in the SEO tag checker to verify robots.txt and sitemap.xml status.
  4. 4Before launch, confirm that block-all rules are not left active.