List Info

Thread: Nutch with Hadoop 0.14.2




Nutch with Hadoop 0.14.2
country flaguser name
United States
2007-10-16 17:21:36
Hi,

I have a cluster running Hadoop 0.14.2. Would it be possible
for me  
to run Nutch with this instance of Hadoop as the data store?
If so,  
how can I point Nutch to this Hadoop instance? All the
tutorials I've  
seen use the Hadoop 0.12 included with Nutch, not an
existing  
installation.

Thanks,

Matei Zaharia

Re: Nutch with Hadoop 0.14.2
user name
2007-10-17 01:18:12
I got nutch working with hadoop 0.13 by putting the
0.13-core.jar in
lib and then moving the 12.3 jar to a different name.  I
followed
these upgrade instructions:
h
ttp://wiki.apache.org/lucene-hadoop/Hadoop_Upgrade and
it was pretty
simple.  However, when I went to go for 0.14.1 or 0.14.2 it
didn't
work...

On 10/16/07, Matei Zaharia <mateieecs.berkeley.edu>
wrote:
> Hi,
>
> I have a cluster running Hadoop 0.14.2. Would it be
possible for me
> to run Nutch with this instance of Hadoop as the data
store? If so,
> how can I point Nutch to this Hadoop instance? All the
tutorials I've
> seen use the Hadoop 0.12 included with Nutch, not an
existing
> installation.
>
> Thanks,
>
> Matei Zaharia
>

Re: Nutch with Hadoop 0.14.2
country flaguser name
United States
2007-10-18 01:24:20
I've gotten it to work with 0.14.2, but I had to make some
changes to  
the code in nutch-0.9 to have it compile. (Very small
changes due to  
modified API's; just look at the compile errors that pop
up). This  
was on a brand new cluster using 0.14.2 though, not on one I
upgraded.

On Oct 16, 2007, at 11:18 PM, Ned Rockson wrote:

> I got nutch working with hadoop 0.13 by putting the
0.13-core.jar in
> lib and then moving the 12.3 jar to a different name. 
I followed
> these upgrade instructions:
> h
ttp://wiki.apache.org/lucene-hadoop/Hadoop_Upgrade and
it was pretty
> simple.  However, when I went to go for 0.14.1 or
0.14.2 it didn't
> work...
>
> On 10/16/07, Matei Zaharia <mateieecs.berkeley.edu> wrote:
>> Hi,
>>
>> I have a cluster running Hadoop 0.14.2. Would it be
possible for me
>> to run Nutch with this instance of Hadoop as the
data store? If so,
>> how can I point Nutch to this Hadoop instance? All
the tutorials I've
>> seen use the Hadoop 0.12 included with Nutch, not
an existing
>> installation.
>>
>> Thanks,
>>
>> Matei Zaharia
>>


Re: Nutch with Hadoop 0.14.2
country flaguser name
United States
2007-10-18 01:46:03
All the reporter.setStatus messages need to have their try
{} catch {} 
blocks removed for nutch to work with 0.14

Matei Zaharia wrote:
> I've gotten it to work with 0.14.2, but I had to make
some changes to 
> the code in nutch-0.9 to have it compile. (Very small
changes due to 
> modified API's; just look at the compile errors that
pop up). This was 
> on a brand new cluster using 0.14.2 though, not on one
I upgraded.
> 
> On Oct 16, 2007, at 11:18 PM, Ned Rockson wrote:
> 
>> I got nutch working with hadoop 0.13 by putting the
0.13-core.jar in
>> lib and then moving the 12.3 jar to a different
name.  I followed
>> these upgrade instructions:
>> h
ttp://wiki.apache.org/lucene-hadoop/Hadoop_Upgrade and
it was pretty
>> simple.  However, when I went to go for 0.14.1 or
0.14.2 it didn't
>> work...
>>
>> On 10/16/07, Matei Zaharia <mateieecs.berkeley.edu> wrote:
>>> Hi,
>>>
>>> I have a cluster running Hadoop 0.14.2. Would
it be possible for me
>>> to run Nutch with this instance of Hadoop as
the data store? If so,
>>> how can I point Nutch to this Hadoop instance?
All the tutorials I've
>>> seen use the Hadoop 0.12 included with Nutch,
not an existing
>>> installation.
>>>
>>> Thanks,
>>>
>>> Matei Zaharia
>>>
> 

[1-4]

about | contact  Other archives ( Real Estate discussion Medical topics )