Check your speedRobots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which are parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; keep spiders out of sensitive and private areas of your Web site; track spider visits and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with.
Did you find this download useful?
7 out of 16 users found this download useful
People who downloaded this software also downloaded...
Altova DiffDog Enterprise Edition 2010
Perform differencing and merging for XML, databases, EDI, flat files, Excel 2007, and Web services.
Aurigma Graphics Processor 1.9
Build your applications upon an image processing component.
WebLoad Professional 8.3.0.105
Test and get detailed information on how your applications function under load.
Personal License Manager 1.1
Generate strong cryptographic licenses for your applications.
Cloaked Affiliate Link Builder 1.0
Cloak affiliate links on any web page or blog with modern browser technology.
Web Log Storming 2.3
Log and display Web site statistics as interactive charts and reports.
