Re: http://rubymtl.org/ still alive?

Hi Josh,

> You have to split the data into separate, smaller 
> independently-treatable chunks in memory and then merge
the calculations 
> in the end (if that's possible on a single machine).
This entails an 
> optimized data representation or structure.
> 
> It looks like what you are trying to achieve is similar
to what Google 
> does, but they on it on a larger scale, spanning
multiple machines using 
> massively parallel architecture and algorithms.

Yep. Map/Reduce is exactly what I'd like to be able to do.
I'm going to 
be looking into Starfish tomorrow.

Edward

_______________________________________________
Rubymtl mailing list
Rubymtllists.artengine.ca
ht
tp://lists.artengine.ca/mailman/listinfo/rubymtl

Edward Ocampo-Gooding wrote:
> Yep. Map/Reduce is exactly what I'd like to be able to
do. I'm going to 
> be looking into Starfish tomorrow.

Fantastic. There's a Joel Spolsky article called "can
your language do 
this?" which describes map-reduce, and also look for
this as a 
potentially interesting resource:

Flexible Pattern Matching in Strings: Practical On-line
Search 
Algorithms for Texts and Biological Sequences by Gonzalo 
Navarro and Mathieu Raffinot

Best,

Josh

_______________________________________________
Rubymtl mailing list
Rubymtllists.artengine.ca
ht
tp://lists.artengine.ca/mailman/listinfo/rubymtl