User-agent: * Disallow: /siteadmin/ Disallow: /custom/ Disallow: /includes/ Disallow: /processors/ Disallow: /crossdomain.xml