Free Software Downloads
Robots.txt editor 2
Audio & Multimedia category
check the available software downloads subcategories
Software Details:
Company : NetPromoter File download size: 2869 kb License : Shareware OS: Win98, WinME, WinNT 4.x, Windows2000, WinXP, Windows2003 Price: 99.90 Release date: 2004-05-01 |
Software Links:Homepage: software homepage Download link: Download Screenshot: View screenshot |
related: site optimization, log file analysis, spider visits, robots.txt editor, spider instructions
Robots.txt editor 2 description
This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions.
Robots.txt editor 2 review
This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions. The program does this by providing the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.