List Info

Thread: Crawling sites (authentication required)




Crawling sites (authentication required)
country flaguser name
United States
2007-10-22 10:07:21
Hi,

Recently I was able to crawl a few sites. But now I have to
crawl a site
that requires Authentication. Is there anyone who can
provide me some
information how I should do that?

Regards,
Sujith
-- 
View this message in context: http://www.nabble.com
/Crawling-sites-%28authentication-required%29-tf4670570.html
#a13342369
Sent from the Nutch - User mailing list archive at
Nabble.com.


Re: Crawling sites (authentication required)
user name
2007-10-22 11:47:20
What kind of of authentication is required? Do you have to
submit the
credentials by POST method or does it require
Basic/Digest/NTLM
authentication?

Regards,
Susam Pal

On 10/22/07, sujithq <sujith.quintelier.icmsgmail.com> wrote:
>
> Hi,
>
> Recently I was able to crawl a few sites. But now I
have to crawl a site
> that requires Authentication. Is there anyone who can
provide me some
> information how I should do that?
>
> Regards,
> Sujith
> --

[1-2]

about | contact  Other archives ( Real Estate discussion Medical topics )