# All robots will spider the domain User-agent: * # Disallow directory /manager/ Disallow: /manager/ # Disallow directory /assets/ Disallow: /assets/ # Disallow directory /templates/ Disallow: /templates/