User-agent: * Disallow: /site/admin/ Disallow: /site/other/ Disallow: /awstats/ Disallow: /bin/ Disallow: /site/Components/ Disallow: /site/controls/ Disallow: /site/DesktopModules/ Disallow: /site/Portals/ Disallow: /site/Providers/ Disallow: /site/Web References/