# Robots.txt file updated October 17, 2007 # All robots will spider the domain User-agent: * Disallow: # Disallow directory /A-ref-nopublish/ User-agent: * Disallow: /A-ref-nopublish/ # Disallow directory /keywords/ User-agent: * Disallow: /keywords/ # Disallow directory /psd/ User-agent: * Disallow: /psd/ # Disallow directory /template/ User-agent: * Disallow: /template/ # Disallow directory /av/ User-agent: * Disallow: /av/