User-agent: * Disallow: /cgi-bin/ Disallow: /bboard/ Disallow: /campus/ Disallow: /mail/ Disallow: /_common/ Disallow: /App_Browsers/ Disallow: /App_Code/ Disallow: /App_GlobalResources/ Disallow: /App_WebReferences/ Disallow: /aspnet_client/ Disallow: /AssetManagement/ Disallow: /bin/ Disallow: /images/ Disallow: /assets/ Disallow: /LatestChanges/ Disallow: /MasterSlave/ Disallow: /PrivateAssets/ Disallow: /SEO/ Disallow: /wiggets/ Disallow: /XmlFiles/ Disallow: /Workarea/ Disallow: /alumni/secure/ Disallow: /stargate/secure/ Disallow: /~employerportal/secure/ Disallow: /WebResource.axd # When googlebot hits WebResource.axd an error occurs, see http://forums.asp.net/t/934913.aspx # User-agent: Googlebot # Disallow: /*.axd$ # This has now been replaced by Disallow: /WebResource.axd for all user-agents, see http://jagbarcelo.blogspot.com/2009/08/solution-padding-invalid-cannot-be.html # Robots.txt syntax checker, see http://tool.motoricerca.info/robots-checker.phtml