# All robots will spider the domain User-agent: * Disallow: Disallow: /assets/ Disallow: /billing/ Disallow: /desk/ Disallow: /livehelp/ Disallow: /manager/ Disallow: /status/ Disallow: /templates/