Robots.txt
Uit dotSearch
Versie door 87.215.139.10 (Overleg) op 17 mrt 2010 om 16:30
User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ Disallow: /~joe/junk.html Disallow: /~joe/foo.html Disallow: /~joe/bar.html
User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ Disallow: /~joe/junk.html Disallow: /~joe/foo.html Disallow: /~joe/bar.html
