# FULL access (All Spiders) User-agent: * Disallow: /cgi-bin Disallow: /includes/ Disallow: /subscribe/ Disallow: /images/ Disallow: /_vti_bin/ Disallow: /AWStats/ Disallow: /css/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /marketing/