# robots.txt for http://daedalus.caltech.edu/ User-agent: * #Do not allow search engines to index files below "www-root" #Note that indexing of user home pages is currently allowed. Disallow: /CGI-Executables/ Disallow: /groupmeet/ Disallow: /ErrorPages/ Disallow: /internal/ Disallow: /PNFIconGraphics/ Disallow: /intel/ Disallow: /graphics/ Disallow: /classes/ Disallow: /stats/