List Info

Thread: Does anyone have any experience with running a Map/Red node that is not also a DFS node?




Does anyone have any experience with running a Map/Red node that is not also a DFS node?
country flaguser name
United States
2008-01-18 17:29:30
We were thinking of doing this with some machines that do
not have 
decent disks but have plenty of netbandwidth.


---
Attributor is hiring Hadoop Wranglers, contact if
interested

Re: Does anyone have any experience with running a Map/Red node that is not also a DFS node?
user name
2008-01-20 10:29:36


On 1/18/08 3:29 PM, "Jason Venner" <jasonattributor.com> wrote:
> We were thinking of doing this with some machines that
do not have
> decent disks but have plenty of netbandwidth.


    We were doing it for a while, in particular for our data
loaders*....
but that was months and months ago.

    I don't remember any specific complaints about speed,
but you obviously
lose some of the data locality capabilities.  Depending upon
your workload
and how your network is configured (bandwidth -and-
latency), you might be
ok.


* - this is to force the data to get spread out amongst the
data nodes vs.
filling up the node that the data is being loaded from.


[1-2]

about | contact  Other archives ( Real Estate discussion Medical topics )