Tuesday, July 7, 2009

Live from DEBS 2009 II - our paper presentation

Stratification is one of the terms that computer scientists borrowed from Geology. In 2007, Ayelet Biger, my former M.Sc. student has done her thesis about Complex Event Processing Scalability by Partition which looked at semantic partition of an EPN graph to strata, where in each stratum all agents are independent and can run safely in parallel. Today we have reported about 2008 research project that took the stratification idea and developed a system to assign agents to machines in a distributed environment. Geetika Lakshmanan delivered the talk about this project today. I have posted it on Slidshare. Enjoy !

This project is an interesting example for a life-cycle of a project:
  • It started as an academic thesis;
  • It has flown to a research project within IBM Haifa Research Lab ;
  • After showing promising results in the lab, it evolved to a more "down to earth" project that deals with assignment of agents to machines and threads within the IBM product - WBE-XS (Websphere Business Events - Extreme Scale) which enable event processing on grid environment. This project has to take into account products and their implementation, deal with product instrumentation, and other stuff that pure research projects do not deal with.

While starting an idea in the academia and then going to a start-up has its magic, the work in IBM Research enables to get stuff from academic projects until impact through products, and using my hat as an adjunct professor in the Technion, this is possible. However -- as noted before, getting things pushed in a big company are not necessarily easy.

3 comments:

Rajeev Sampath said...

Hi,
I have been searching for the paper 'Complex Event Processing Scalability by Partition' in ACM and IEEE libraries, but couldn't find it yet. Can you please mention where it is published?

Thanks in advance.

Opher Etzion said...

Hello Rajeev. You can find the paper in the ACM digital library,
Its correct title is: A stratified approach for supporting high throughput event processing applications, in the Proceedings of DEBS 2009. The pointer in the ACM DL is: http://portal.acm.org/citation.cfm?id=1619258.1619265&coll=ACM&dl=ACM&CFID=62324473&CFTOKEN=83351471

Enjoy.

cheers,

Opher

Opher Etzion said...

BTW - the "Complex event processing scalability by partition" is a M.Sc. thesis, it is not published as a paper; however, the paper I've cited before is a derivative of that work.

cheers,


Opher