[ https://issues.apache.org/jira/browse/HADOOP-1983?page=co
m.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1983:
----------------------------------
Attachment: pipe-flush.patch
This patch adds a flush method to the stream interface and
causes the progress method to call it.
> jobs using pipes interface with tasks not using java
output format have a good chance of not updating progress
and timing out
>
------------------------------------------------------------
------------------------------------------------------------
-----
>
> Key: HADOOP-1983
> URL: htt
ps://issues.apache.org/jira/browse/HADOOP-1983
> Project: Hadoop
> Issue Type: Bug
> Components: pipes
> Affects Versions: 0.15.0
> Reporter: Christian Kunz
> Fix For: 0.15.0
>
> Attachments: pipe-flush.patch
>
>
> When using C++-pipes interface, mappers/reducers not
emitting any key-values pairs, but running longer than
'mapred.task.timeout' might timeout even when they send
periodical status updates upstream.
> The cause of the problem is that all upstream messages
are buffered. Progress and status updates should be flushed
immediately.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.
|
