| Monday, February 5, 2007 |
| Robots.txt Generator |
To use this tool to produce of a simple file of robots.txt for your Web site. This file enables you to hide files or directories which you do not wish the spiders of Search Engine to find. This tool of generator is designed to create the text for the file for you; you can then make changes after if you consider it necessary. To produce of a file of robot with this tool is ideal if you wish to block certain directories or files of the search engines.
To use the tool of generator, to write information required below and to click the button. You will then be shown the text for the file. Copy this with a file called robots.txt and the place on the root of your Web site (at the same place as your banner page). Imposing restrictions You can impose the restrictions on which the Web pages reject the indexing. By defect, the majority of the users will want to allow all the directories except their directory of /cgi-bin/, which generally holds of the manuscripts, and their /images/ directory of images.
To allow all the Web pages, to choose yes “all the Web pages make it possible,” then present each Web page or way of directory in the box of exclusion, one by the line.
Example: “http://www.yourdomain.com/cgi-bin/” (excludes the directory from /cgi-bin/) Example: “http://www.yourdomain.com/images/” (excludes the directory from /images/) Example: “http://www.yourdomain.com/welcome.html” (excludes the Web page from /welcome.html)
for try this tool you can visit here |
posted in 5:45 PM  |
|
|
|
|
