| @@ -4,7 +4,7 @@ |
|
|
|
|
| ! Development
|
| -This is an example of a robots.txt during ''testing or developing'' a site. Add services like browsershots.org, validators, link checkers etc. Pages that [http://www.useragentstring.com/pages/useragentstring.php|list user agent strings] tell you the possible values for the "user-agent:" part. In the following example, all user agents except one will be excluded, so no search engine will index your content before launch:
|
| +This is an example of a robots.txt during ''testing or developing'' a site. Add services like browsershots.org, validators, link checkers etc. Pages that [http://www.useragentstring.com/pages/useragentstring.php|list user agent strings] [http://cvresumewriters.com/onlineresume.php|online resume writer] tell you the possible values for the "user-agent:" part. In the following example, all user agents except one will be excluded, so no search engine will index your content before launch: |
|
|
| {code source="ini" title="/robots.txt"}
|
|
|
|
|