The EU FET Flagship program

Back at home. In the previous two days I have attended an EU conference in Brussels on FET (Future Emerging Technologies) Flagship. The EU is recently acting to diversify its R&D investments, and launch some new programs in addition to the traditional programs that will keep running. One of this new ways is PPP (Public/Private Partnership) that is aimed at short term more engineering oriented projects, while the FET flagship goes to the opposite direction: launch two very ambitious large 10-years projects, with around 1B Euro investment in each.

They have brought some examples of projects in that scale such as: Large Hardon Collider, The Human Genome project and some others, with varying degrees of success. The rule of the game is that 5-6 ideas will be given a year (and a funding of around 1.5M Euro each) to develop the program (including partnership around the world, funding sources -- the EU will fund only part, expect that national funding agencies will support it as well as others), and out of them 2 will be selected.

In the last couple of days I have heard a lot of talks about potential proposals, many of them will probably merge, others will disappear. The commission people are encouraging people to merge and share, they don't think it is reasonable to have more than 10-15 proposals. One of the important tests for the proposals is the grandmother test: If you can explain your grandmother in one sentence what it does in terms that your grandmother will understand, then you'll be able to sell the idea to politicians. IMHO most of the presentations I have heard fail to satisfy this property, especially all the ones which has technology in their center. The promising directions relate to Biology -- human brain, breakthrough in robotics, and socio-technical systems.

What is the relationship to the "event processing grand challenge"? --- this may be one of the vehicles to advance the grand challenges, however, since the two flagship projects will start in 2013 -- we need to find other avenues to start earlier.

Event processing is relevant to everything, the human brain is very much event-driven, robots are in many cases event-driven, social evolution is event-driven and more.

One of the challenges is to sell the contribution of event processing to these projects, in discussing with one of them, they thought that they indeed need to process events, but there is no research here, just hard dirty work of programing. I told them that our research issue is how to eliminate the hard dirty work of programming in conventional languages and provide for them something much more high-level with "easy clean work" instead. They have not thought of it this way, since we have not reached out to these communities yet, I gave the analogy that 40 years ago everybody has created home-made database, until the relational database changed the picture, this is exactly what we are doing, raising the level of abstraction.

Next --- see where this can fit and how it can intersect with the EP grand challenge, and determine how to position it (in my talk on live ecology I have equated event processing to the nervous system of a human body). My presentation on live ecology is now on slideshare.

More - later.

The event processing grand challenge - live ecology

Still travelling in Europe, I have spent one day in Luxembourg, serving as a reviewer in the Pronto project that deals with "event recognition for resource management", the highlight was showing us a nice demo of a van that was covered with sensors that track noise, density and location of the car, and can provide diagnostics about the comfort of passengers (too dense, too noisy) and the quality of driving (unsafe driving, sharp turns). I also discovered that one can miss train connections and not only flight connections, and arrived to the hotel in Luxembourg very late at night. From Luxembourg I continued in another 3 hours train ride to Brussels, from which I am writing now.

In Brussels I am attending an EU conference about the FET Flagship program. The European Commission is trying to diversify its programs in order to achieve more impact, and invest more in high risk - high impact long term research; there are several big consortia already established, and I will try to see whether the "event processing grand challenge" ideas, can fit into one or more of these, I am planned to deliver a short presentation today on "live ecology", taking the theme of making Asimov, my favorite writer, come to live with some of his amazing ideas, starting from Gaia ("The Foundation Edge"), a galaxy behaving like a single organism, and moving through the fantastic voyage, the blend between human and robot, and predicting the society's course (Psychohistory), and then hopefully return home later tonight.

The event processing grand challenge - take one

In the Dagstuhl seminar on event processing that ended 10 days ago we launched the "event processing grand challenge activity". You may be familiar with the DARPA grand challenge of driving driver-less car through the desert, you can see the two winner cars in the pictures above. We are not DARPA, and don't have money to distribute, but we would like to take the opposite direction, first define the grand challenge, and then convince funding authorities that they want to support it.

Why do we need this grand challenge? The research community has incubated the "event processing" area as we know today --- some research projects in the 1990-ies, such as: David Luckham's Rapide in Stanford, Mani Chandy's Infospheres in Caltech, John Bates' Apama in Cambridge, and our own Amit project in IBM Haifa Research Lab, followed by the various stream processing projects, like Jennifer Widom's stream project in Stanford, and later the Aurora project, to name a few (there are many more, of course).

The state of the practice is now in the hands of the software vendors, and event processing is becoming part of the main-stream of enterprise computing. However, software vendors are by nature advancing technology in an incremental fashion. On the other hand, there is a strong feeling that "event processing" has barely scratched the surface of its potential to impact society, this goes beyond current applications, and even beyond enterprise computing as we know it.

It is now the role of the research community to jump-start and incubate the step-function required to be achieved in order to get this kind of impact. We would like to have a call to the research community in event processing to focus on such a grand challenge, and as an incentive (and enabler) to get funding agencies worldwide to adopt it.

A substantial brain power have been invested in Dagstuhl, and in a follow-up to work on it, there have also been some people outside the community that deal with socio-technical systems and bio-informatics.

As a metaphor we can view many type of IT systems, social systems and biological system as a "live ecology", similar to a single organism with a lot of brains, eyes, ears, hands and feet.
Event processing serves as the nervous system, and events are what flow between the different players. This subsumes the "Internet of things" vision, where many sensors are connected, and also robots of various kinds as actuators, serving as hands. Such an infrastructure will enable changing the life as we know them.

We are working now on various scenarios that will be enabled by such an infrastructure; you can hear some thoughts about it in my talk next week in the OMG Event Processing community of practice that holds its first event processing symposium. Stay tuned for much more on that topic.