User-agent: * Disallow: /admins/ #this bans robots from admin folder Disallow: /aspnet_client/ Disallow: /backup/ Disallow: /bin/ Disallow: /Logs/ Disallow: /NewSite/ Disallow: /test/