RoboGen
Standard Edition 1.51 has just been released. It fixes
a problem that some may have experienced while trying to utilize
RoboGen to create a ROBOTS.TXT file for their web site.
The problem was caused because the FTP server returned additional
information about the path location of its files. RoboGen
would not parse the information correctly and the user could
not select any files or directories to disallow.