share*it! Secure ordering

Robots.txt editor-professional website tool that enables you to generate the robots.txt file and track the visits your resource by search engine spiders. Robots.txt Editor

Features

This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions. The program does this by providing the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.


This industry-leading software will help you optimize and fine tune your web-site for search engines. No more wasting time creating your robots.txt file by hand and wondering if it's formatted properly.


You can easily:

  • Visually generate industry standard robots.txt files
  • Identify malicious and unwanted spiders and ban them from your site
  • Direct search engine crawlers to the appropriate pages for multilingual sites
  • Use robots.txt files for doorway page management
  • Keep spiders out of sensitive and private areas of your web site
  • Upload the correctly formatted robots.txt file directly to your FTP server not switching from Robots.txt Editor
  • Track spider visits
  • Create spider visits reports in HTML, Microsoft Excel CSV and XML formats

Controlling Spiders with Robots.txt Files


Robots.txt Editor is an easy-to-navigate visual editor that will enable you to specify different directives for selected spiders in specific areas of the site and generate the robots.txt file quickly and easily. No more wasting time creating your robots.txt file by hand and wondering if it's formatted properly. Used along with other web site promotional software, Robots.txt Editor enhances the efficiency and effectiveness of your optimization strategy.

Spider Visits Analysis

  • Uses log file analysis to detect spider visits and pages indexed
  • Provides log file analysis for unlimited number of log files at the same time
  • Mines logfiles either locally or via FTP
  • Allows browsing of your web server via FTP to find your logfile
  • Supports compressed log files
  • Supports logfiles from Windows, Linux and MAC web servers
  • Can add any new spiders found on your web site to Robots.txt Editor
  • Auto detects your log file format, and in the rare case where it can't, you can specifiy the format profile manually in Profile Manager
  • Indicates visually the pages requested by spiders by mistake (i.e., 404 Not Found) and redirected requests
  • Indicates pages and images that were accessed against the rules of project's robots.txt file
  • Exports spider and page visits into Microsoft Excel CSV (Comma Separated Values) file or XML format file
  • Exports raw log entries of spider visits to W3C Extended Log File
  • Exports all spider IP addresses so they can be used by cloaking software
  • Provides printable customizable reports in HTML format

Language:  
 
Robots.txt NetPromoter
Unit Price:   USD 99.90 
Total:   USD 99.90
 Info plus 0% sales tax/VAT to USD 99.90: USD 0.00
USD 99.90
Delivery:   License key by e-mail
Platform:   Windows 98, Windows Server 2003, Windows 95, Windows NT, Windows 2000, Windows XP x32
Version:   2.0
Language:   English
 
Download Demo
 
Buy now!
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. Easily and quickly, it allows a user to create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.
  By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more.
  Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with.