Yahoo Labs recently announced an open source called S4: Simple Scalable Streaming System, available as open source. A paper describing S4 is available, as well as a site from which one can download the software (alpha version).
This is a distributed platform whose model is a kind of event processing network; the stream dataflow model where each node is "processing element", similar to IBM Infosphere Streams; The paper states that it was inspired by the MapReduce model, but I still need to read the details. It is interesting to follow the branch of distributed event processing platforms. It seems that this is a "programming in the large" model, where each processing element is written in Java (at least according to the paper's examples) it does not have its native language.
No comments:
Post a Comment