Workshop on event-based media integration and processing - the first day

This is the logo of the ACM multimedia 2013 conference that is taking place these days in Barcelona.

Co-located with this conference (we share the coffee in the coffee break) is the event-based media workshop which I am attending.  My talk is planned for today, so yesterday I was just a listener in the first day.   Here are some impressions:

The most interesting talk was the one by Ramesh Jain,  who is working on events in multimedia for a while.

Ramesh talked about cybernetics in society, and about smart systems defined as smart actions in respond to smartly detected situations.   He also talked about social networks and the Maslow's hierarchy of needs

Ramesh said that the social media concentrates on the third and fours layer - love/belonging and esteem,and posed as a challenge to get more focused on the basic needs - the two lower layers.  

Ramesh also talked about the 4V of big data,  Saying that the volume is the least important one -- as there are methods to partition the space, but the other three actually issue -- event processing in multimedia under uncertainty.  Ramesh mentioned  the Israeli company Waze (recently acquired by Google) as example of a smart social system.  

Some of the other talks concentrated about analysis of pictures that are put on social networks and try to identify the event they are describing, first see if they describe an event, and then identify the event - talking about sport events, public events, family events and more.   It is funny, since some of the event definitions view event as instantaneous occurrence - and then a sport event (say football game) is not an event since it takes (net) 90 minutes.  I guess that there are different views of events -- I'll mention it in my talk today.

On video streams and events

I have not written in this Blog for a while, last week I have been in a business trip in Brussels and Luxembourg, had a few hours to play tourist in Brussels and chose to go to mini-Europe, in the picture we see the France section - in the background the atomium, Brussels' iconic site.  Travelling in the train between Brussels and Luxembourg I had two observations:  the train accumulates delay, so it is better to  take a big slack of time if you rely on trains in Belgium, also it was interesting to see in stations the amount of people getting off to take advantage of the 2-3 minutes of stopping in order to smoke,  the amount of smokers in Europe in general, and in Belgium in particular is probably much higher than those we are used to in Israel (and other countries like USA and Canada).   

Getting back to the events business - I have noticed Rainer's posting in the complexevents forum, about video camera on the bus in Ireland that he experienced, actually there are various cameras on buses for various reasons - example video cameras installed on school buses whose aim according to the site is: 

•    Deter bullying, vandalism, and other offenses
•    Reinforce driver accountability
•    Document chain of events
•    Substantiate or refute claims
•    External stop arm activated video of passing motorists.

Realizing these goals there is a need to identify the events that need to be processed/notified/acted upon from the video stream.  Some are required in real-time - for example stop fights or eliminate accidents.  There are various other uses of use of video streams as source of events,  I guess that within the "Internet of Things" infrastructure, cameras are important part - while some work on detecting events out of streams exist (e.g. identify car license plate numbers for automatic tolls in roads),  more work is needed to fully exploit the opportunities here

On Streams and Events

The picture above is taken from a UCLA project that deals with multimedia stream systems. While the term "data streams" and later "event streams" that deals with continuous queries over structured data, have been introduced in the last decade in the database research community (with spin-off to products), the term "streams" has more general and more traditional meaning - referring to multimedia streams - video, voice, news etc... - which by nature belong to the family of unstructured data. In previous posting I discussed some of problems around "event stream processing", and around classification of event processing technologies. However, in this posting, I would like to point out that "stream processing" in its more traditional meaning is an important complementary technology to event processing.

First - the result of stream processing is in detection that an event has happened. Examples are: detection of vehicle's registration plate in automatic toll roads (we have in Israel one of these roads, there are other roads like this in Canada and Sweden - and maybe in more places), where the event "vehicle with registration plate X entered the highway in entrance Y in time T". This can be further processed (after correlating to the exit event) for billing purposes, but can also serve for security and other applications. In this case, from the event processing architectural view, the "stream processing" is done in a producer application, which generates events that are processed in the event processing system.

Second - the result of an event processing system can be an input to a stream, example: a game is being presented to the players as a video stream. Decisions made by the electornic player (or by the human player) can be assisted by an event processing system. The result of the decision can be movement of a player to a certain direction, and this is fed back to the video stream. In that case, the video stream is being processed in a consumer application, which gets event as an input.

Of course, a producer can also be a consumer, especially in games which are of iterative nature, thus an application is communicating with an event processing system in both side.

Since much of the events that happen in the universe is sensed thtough various unstructured media, the area of creating events out of multimedia streams, and embedding events to control the behavior of multimedia streams, will be one of the future major directions for the future, we can see some of this already hapening.