Changes User-agent: * # directed to all spiders (search engine robots) # directs robots NOT to read and index files in these directories or containing characters Disallow: /cgi-bin/ #all files in these directories Disallow: /web/ Disallow: /unaoregon/ Disallow: /art/ Disallow: /old/ Disallow: /original/