List Info

Thread: CheckSum errors?




CheckSum errors?
country flaguser name
United States
2007-10-19 11:22:59
I get the following error with the latest nigthy build of
nutch:
 
WARN  fs.FileSystem - Moving bad file
/data/nutch/crawl/tmp/mapred/local/reduce_ur2fab/map_1.out
to
/data/bad_files/map_1.out.-1786551$
WARN  mapred.LocalJobRunner - job_ofp9by
java.lang.RuntimeException:
org.apache.hadoop.fs.ChecksumException:
Checksum error:
crawl/tmp/mapred/local/reduce_ur2fab/map_1.out at
33316864

Someone else said this is because of a bad harddisk? But I
can't do
fsck because my data is being stored on a cifs mount.
When I did a chkdsk on the drive partion on the remote
machine there
are no errors. Is this anything else that can cause this
error?
 
Re: CheckSum errors?
user name
2007-10-19 13:03:15
Usually this is due to bad memory, not harddisk.

Dennis Kubes

Jeff Van Boxtel wrote:
> I get the following error with the latest nigthy build
of nutch:
>  
> WARN  fs.FileSystem - Moving bad file
>
/data/nutch/crawl/tmp/mapred/local/reduce_ur2fab/map_1.out
to
> /data/bad_files/map_1.out.-1786551$
> WARN  mapred.LocalJobRunner - job_ofp9by
> java.lang.RuntimeException:
org.apache.hadoop.fs.ChecksumException:
> Checksum error:
crawl/tmp/mapred/local/reduce_ur2fab/map_1.out at
> 33316864
>
> Someone else said this is because of a bad harddisk?
But I can't do
> fsck because my data is being stored on a cifs mount.
> When I did a chkdsk on the drive partion on the remote
machine there
> are no errors. Is this anything else that can cause
this error?
>  
>
>   

[1-2]

about | contact  Other archives ( Real Estate discussion Medical topics )