Robots.txt: verschil tussen versies
Uit dotSearch
(Nieuwe pagina aangemaakt met ' User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ Disallow: /~joe/junk.html Disallow: /~joe/foo.html Disallow: /~joe/bar.html') |
|||
| Regel 1: | Regel 1: | ||
| − | + | <nowiki>User-agent: * | |
| − | User-agent: * | ||
Disallow: /cgi-bin/ | Disallow: /cgi-bin/ | ||
Disallow: /tmp/ | Disallow: /tmp/ | ||
| Regel 8: | Regel 7: | ||
Disallow: /~joe/foo.html | Disallow: /~joe/foo.html | ||
Disallow: /~joe/bar.html | Disallow: /~joe/bar.html | ||
| + | </nowiki> | ||
Versie van 17 mrt 2010 om 16:30
User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ Disallow: /~joe/junk.html Disallow: /~joe/foo.html Disallow: /~joe/bar.html
