List Info

Thread: Created: (HADOOP-2162) Provide last failure point when retry a mapper task




Created: (HADOOP-2162) Provide last failure point when retry a mapper task
country flaguser name
United States
2007-11-06 14:04:51
Provide last failure point when retry a mapper task
---------------------------------------------------

                 Key: HADOOP-2162
                 URL: htt
ps://issues.apache.org/jira/browse/HADOOP-2162
             Project: Hadoop
          Issue Type: New Feature
            Reporter: Yiping Han


Currently when a mapper failed and get restarted, the
restarted mapper can find out if itself is a retry or the
first try from the task name. We want to also know where in
the input the last try failed. 

With the last failure point, our mapper can then do
something different for the particular input. The failure
point does not necessary to be very accurate. The reason we
ask for this instead of let hadoop to deal with the failure
record is, in such a way we can do something special for the
failure record instead of simply skip it.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


[1]

about | contact  Other archives ( Real Estate discussion Medical topics )