GlobalFree to use

Robots.txt generator

Generate basic crawl rules and a sitemap reference. Robots.txt does not secure private pages or remove indexed URLs.

Your inputs stay in this tab. We do not receive your files, pasted text or calculation values.

Input

Your result

Your result will appear here.

How to use this tool

  1. Enter your values or choose a local file. Replace the example data with your own.
  2. Review options, units and assumptions, then run the tool.
  3. Check the result before copying or downloading it. Keep an original copy of important files.

Method & assumptions

Generate basic crawl rules and a sitemap reference. Robots.txt does not secure private pages or remove indexed URLs.

User-agent + Disallow + Sitemap

Worked example

User-agent: *
Disallow: /admin/
Sitemap: https://example.com/sitemap.xml

Limits & important notes

Output depends on your input and browser support. Keep the original. Large files may exceed your device’s memory.

Content updated:

Privacy & Free to use

Are my inputs stored?

Your inputs stay in this tab. We do not receive your files, pasted text or calculation values.

Is this tool free?

Yes. No signup or payment is required.

Processed in your browser

Useful next steps

JSON formatter & validator

Validate, pretty-print or minify JSON locally. Invalid data is never sent to a server.

Developer & SEO

CSV to JSON converter

Convert CSV headers and records to JSON, supporting quoted delimiters and line breaks.

Developer & SEO

JSON to CSV converter

Convert a flat array of objects to CSV. Formula-like strings receive a protective prefix for spreadsheet imports.

Developer & SEO