Task startup fail when localizeTask directory is full
-----------------------------------------------------
Key: HADOOP-1991
URL: htt
ps://issues.apache.org/jira/browse/HADOOP-1991
Project: Hadoop
Issue Type: Bug
Components: mapred
Reporter: Koji Noguchi
Priority: Minor
Fix For: 0.16.0
We had a job filling up one particular drive (different bug)
that resulted in all the subsequent tasks on that node to
fail with
java.io.IOException: Mkdirs failed to create
/vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710
030011_0001/task_200710030011_0001_m_007363_0
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localize
Task(TaskTracker.java:1284)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTa
sk(TaskTracker.java:1344)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTr
acker.java:647)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker
.java:640)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracke
r.java:1167)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracke
r.java:832)
at
org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:12
03)
at
org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1
888)
It'll be nice if localization also uses localdirallocator to
utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.
|
