[
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-528?PAGE=COM.AT
LASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]
OWEN O'MALLEY RESOLVED HADOOP-528.
----------------------------------
RESOLUTION: CANNOT REPRODUCE
ASSIGNEE: (WAS: OWEN O'MALLEY)
I HAVEN'T SEEN THIS RECENTLY AND I SUSPECT IT WAS THE RACE
CONDITION IN CREATING THE DIRECTORIES THAT WE USED TO HAVE
WITH MKDIRS CALLING EXISTS AND THEN MKDIR.
> SOME HADOOP DISTCP TASK FAILS WITH
DFS.CLIENT.BUFFER.DIR NOT FOUND ERROR WHILE THE PROPERTY
EXISTS.
>
------------------------------------------------------------
---------------------------------------
>
> KEY: HADOOP-528
> URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-528
> PROJECT: HADOOP
> ISSUE TYPE: BUG
> COMPONENTS: MAPRED
> AFFECTS VERSIONS: 0.6.0
> REPORTER: SANJAY DAHIYA
>
> ON SOME NODES HADOOP DISTCP FAILS WITH FOLOWING ERROR.
THE PROPERTY DFS.CLIENT.BUFFER.DIR IS DEFINED IN
HADOOP-SITE.XML AND THE CORRESPONDING DIRECTORY IS ALSO
CREATED ON THE NODE BY FRAMEWORK. SAME CONFIGURATION WORKS
ON ALL OTHER NODES.
> IT COULD BE A TIMING ISSUE WHERE SOMEONE IS TRYING TO
READ THE DIR BEFORE ITS CREATED ON LOCAL DISK, I AM NOT SURE
OF THE CAUSE.
> JAVA.IO.IOEXCEPTION: NO VALID LOCAL DIRECTORIES IN
PROPERTY: DFS.CLIENT.BUFFER.DIR AT
ORG.APACHE.HADOOP.CONF.CONFIGURATION.GETFILE(CONFIGURATION.J
AVA:405) AT
ORG.APACHE.HADOOP.DFS.DFSCLIENT$DFSOUTPUTSTREAM.NEWBACKUPFIL
E(DFSCLIENT.JAVA:780) AT
ORG.APACHE.HADOOP.DFS.DFSCLIENT$DFSOUTPUTSTREAM.(DFSCLIENT.J
AVA:770) AT
ORG.APACHE.HADOOP.DFS.DFSCLIENT.CREATE(DFSCLIENT.JAVA:276)
AT
ORG.APACHE.HADOOP.DFS.DISTRIBUTEDFILESYSTEM.CREATERAW(DISTRI
BUTEDFILESYSTEM.JAVA:104) AT
ORG.APACHE.HADOOP.FS.FSDATAOUTPUTSTREAM$SUMMER.(FSDATAOUTPUT
STREAM.JAVA:56) AT
ORG.APACHE.HADOOP.FS.FSDATAOUTPUTSTREAM$SUMMER.(FSDATAOUTPUT
STREAM.JAVA:45) AT
ORG.APACHE.HADOOP.FS.FSDATAOUTPUTSTREAM.(FSDATAOUTPUTSTREAM.
JAVA:146) AT
ORG.APACHE.HADOOP.FS.FILESYSTEM.CREATE(FILESYSTEM.JAVA:270)
AT
ORG.APACHE.HADOOP.FS.FILESYSTEM.CREATE(FILESYSTEM.JAVA:177)
AT
ORG.APACHE.HADOOP.UTIL.COPYFILES$DFSCOPYFILESMAPPER.COPY(COP
YFILES.JAVA:186) AT
ORG.APACHE.HADOOP.UTIL.COPYFILES$DFSCOPYFILESMAPPER.MAP(COPY
FILES.JAVA:391) AT
ORG.APACHE.HADOOP.MAPRED.MAPRUNNER.RUN(MAPRUNNER.JAVA:46) AT
ORG.APACHE.HADOOP.MAPRED.MAPTASK.RUN(MAPTASK.JAVA:210) AT
ORG.APACHE.HADOOP.MAPRED.TASKTRACKER$CHILD.MAIN(TASKTRACKER.
JAVA:1066)
--
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.
|
