User-agent: dotbot Disallow: / User-agent: * Disallow: /bin/ Disallow: /CSS/ Disallow: /images/ Disallow: /includes/ Disallow: /JavaScript/ Disallow: /inside/ Disallow: /learn_more/ Disallow: /SpryAssets/ Disallow: /_style/ Disallow: /customError.aspx Disallow: /WebResource.axd$