Skip to content
Local-SEO.com

Robots.txt generator

Choose what search engines and AI bots may read, then copy the file to the top folder of your website.

One per line, starting with /
AI bots allowed to read your site

Your robots.txt

# robots.txt made with Local-SEO.com
User-agent: *
Disallow: /wp-admin/
Disallow: /cart/
Disallow: /checkout/

Sitemap: https://yourbusiness.com/sitemap.xml

Where robots.txt goes

Upload the file so it opens at yourbusiness.com/robots.txt. Most website builders (WordPress, Wix, Squarespace) have a setting or plugin for this.

Be careful with "block everything"

Blocking all crawlers removes your site from Google. Only use it for staging or test sites.

Need this for many clients, with Google Maps Geo-Grids and branded reports? See what Local-SEO.com does.

More free tools