# robots.txt,v 1.0 2001/06/13 # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The webmaster for this site is # # Format is: # User-agent: # Disallow: | # Date By Reason # 20010613 Skifter First version of spider restriction implementet for website # ----------------------------------------------------------------------------- User-agent: * Disallow: / User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /scripts/ Disallow: /img/ Disallow: /perl Disallow: /cgi-bin/ User-agent: * Disallow: /home/http/vonhaller_test/docs/admin/ Disallow: /home/http/vonhaller_test/docs/img/ Disallow: /home/http/vonhaller_test/docs/uploads/ Disallow: /vonhaller_test