# robots.txt for http://www.statcommunications.com/ User-agent: * # ____________________________________________________ # Temporary; to flush any cached pages upon next crawl Disallow: /site/ # no longer exists Disallow: /newsite/ # no longer exists # ________________________ # Public Website Ancillary Disallow: /downloads/ # customer support downloads & manuals Disallow: /resources/ # future directory for common resources # _________________ # STAT Internal Use Disallow: /x/ # redirect to ./techsite/ Disallow: /tech/ # tech stuff Disallow: /techsite/ # tech stuff Disallow: /oldsite/ # former STAT website # _________ # Scripting Disallow: /aspnet_client/ # ASP.NET client-side validation Disallow: /cgi-bin/ # Misc CGI scripts # _______________ # FrontPage Stuff Disallow: /_vti_bin/ # FrontPage Disallow: /_vti_cnf/ # FrontPage Disallow: /_vti_log/ # FrontPage Disallow: /_vti_map/ # FrontPage Disallow: /_vti_pvt/ # FrontPage Disallow: /_vti_txt/ # FrontPage Disallow: /_vti_script/ # FrontPage # __________________ # Who the hell knows Disallow: /_database/ # ? Disallow: /_uploads/ # ? Disallow: /_private/