# To disallow all robots to the internal pages # See http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /