# See https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt for documentation # and https://www.google.com/webmasters/tools/robots-testing-tool for testing user-agent: * disallow: / user-agent: Googlebot allow: /