@@ -1,6 +1,6 @@ |
A robots.txt is only needed if you want to __exclude__ a search engine or other service from some directory on your service. Bitweaver doesn't create a robots.txt file by default. If you need one, you have to create it. This file can only be in the root directory.
|
|
-If you cannot create such a file, [http://www.robotstxt.org/meta.html|use meta tags]. There are [http://www.thomsonchemmanoor.com/10-common-mistakes-using-robotstxt-on-your-website.html|pages online that discuss] [http://cheapautoinsurancequotes.biz/ |cheap auto insurance quotes] its value and its usage, or let you [http://www.robotstxt.org/checker.html|check for validity].
|
+If you cannot create such a file, [http://www.robotstxt.org/meta.html|use meta tags]. There are [http://www.thomsonchemmanoor.com/10-common-mistakes-using-robotstxt-on-your-website.html|pages online that discuss] its value and its usage, or let you [http://www.robotstxt.org/checker.html|check for validity]. |
|
|
! Development
|
|
|