Re: robots.txt file disallowing index.

- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: robots.txt file disallowing index.

By default, dpsearch cache robots data for 1 week, to change
this value, please use RobotsPeriod command:
RobotsPeriod 1d
or you can delete manualy the records from
"robots" table in search database to force indexer
reread robots.txt on next run.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cg
i-bin/simpleforum.cgi?fid=02;topic_id=1168096182