# robots.txt, der 7 Oct 1996. # Updated: 16 Sep 1998: add rfcs ['cos not all robots obey the # tag in the rfc tree files]. # 2 Dec 1998: add /pubs/abstracts/. # 3 Dec 1998: add /pubs/authors/. # 22 Jan 1999: add /cgi-bin/. # 27 Feb 2001: add /teaching/qm/course-ans/ [because the pages aren't # always available]. # 26 Jan 2005: add /teaching/mechanics2/ [as lots of broken links]. # 5 Apr 2006: add /slides/, /minutes/, /computers/, /scanning/, # /3tschedule, /7tschedule (otherwise nottingham's # google can get to them, and make them publicly # available). # 6 Apr 2006: have /teaching/ on list, same reason as above. User-agent: * Disallow: /slides/ Disallow: /minutes/ Disallow: /computers/ Disallow: /scanning/ Disallow: /3tschedule/ Disallow: /7tschedule/ Disallow: /pubs/abstracts/ Disallow: /pubs/authors/ Disallow: /cgi-bin/ Disallow: /teaching/