This is version 2.0 of Walker, a program to traverse a single site's Gopher
tree.  It is invoked with:

$ walker host.domain port output-file

where host.domain is the fully qualified domain name of the target system,
port is the Gopher port number (defaults to 70) and output-file is the name
of the output file generated (defaults to walker.out).

The 'host.domain' name must be the name that is emitted by a Gopher
directory listing; if the host part of a Gopher directory selector does not
match this name, Walker will assume that the directory is for a remote link
and will not try to obtain the directory contents.

Walker will look for a configuration file on the target system (walker.ctl,
veronica.ctl or robots.txt) and will refrain from traversing those
directories that are disallowed.  See walker.ctl for the format of
this file.

The files walker.c, robots.c, *.opt, walker.mms and make_walker.com are
required to build walker.exe; "@build xxx" will build walker for the xxx
TCP/IP package.  Currently Walker will compile and run under DECC/Multinet,
DECC/UCX (and probably any TCP/IP package the emulates UCX), VAXC/Multinet,
and OSF/1.  It hasn't been tested, but should run on VAXC/UCX and generic
Unix systems that support a socket interface.

glance.c is a program that takes the Walker output file and generates a
"Gopher tree at a glance".

WWWglance.c is an equivalent program, but creates an HTML output file with
clickable links to the items in the tree.

walker_index.com will invoke build_index and generate a searchable database
of all the gopher titles found.

