- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: adrian
Subject: robots.txt file disallowing index.
I can't seem to get my pages on my local website indexed. It
keeps telling me that robots.txt file has disallowed /. But
i deleted the robots.txt file and it's still telling me the
same thing.
Here is the full output:
indexer[1055]: indexer from dpsearch-4.43-mysql started
with '/usr/local/dpsearch/etc/indexer.conf'
indexer[1055]: URL: http://localhost/main.html
indexer[1055]: robots.txt: 'Disallow /'
indexer[1055]: Deleting http://localhost/main.html
indexer[1055]: URL: http://localhost/fiwimar
ket/
indexer[1055]: robots.txt: 'Disallow /'
indexer[1055]: Deleting http://localhost/fiwimar
ket/
indexer[1055]: Done (1 seconds, 0 documents, 0 bytes,
0.00 Kbytes/sec.)
indexer[1055]: Total 15 seconds, 0 documents, 0 bytes,
0.00 Kbytes/sec, 0.00 sec/doc, 0 bytes/doc.
I really need some help with this.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simplefo
rum.cgi?fid=02;post=
|