# Robot exclusions file for www.hm-treasury.gov.uk # mainly just excludes useless directories containg stats or images. # # NOTE although this is a human readable file it is designed to be read by web # spiders, crawlers and other robots. If you do not fall into this category, # don't make the mistake of thinking that this file tells you anything remotely # interesting or useful about this site. # # Nov 1998 User-agent: * Disallow: /graphics/ Disallow: /wusage/ Disallow: /image/ Disallow: /stats/ Disallow: /cgi-bin/ Disallow: /links/