Nathan Marz, the guy that is behind the Storm Apache incubator project.
Storm has definitely became the most common stream processing platform. This year I am scheduled to teach a course about business intelligence, and my view of business intelligence includes the real-time business intelligence. The students will practice Storm.
Recently Nathan Marz wrote in his Blog about the history of Storm and lessons learned.
I think it is worth reading...
The opening speaker in the IoT summit yesterday was Richard Soley, the person behind Object Management Group. Richard talked about the "industrial Internet". He started his talk by having a nice slide in which the Internet now substitutes many thing we have done in the past
However, not everything changed by the Internet, since in many cases enterprises lack the "Internet thinking". Examples are: manufacturing, energy grids, jet engines, oil and gas exploration and more are handled exactly as were done before.
This is due to the fact that the people involved including technical people are stuck in the way of thinking of the past.
Richard talked about the Industrial Internet Consortium which is a separate entity and not part of OMG (a correction that Richard made to my original posting).
It has 85 members (at the time of the talk) and growing. It is intended to study testbeds in this area. The Internet of Things is a crucial component in the industrial internet game.
One more insight from Richard is that "people don't read". Everybody re-invents the wheel, since the current generation of professional people don't read and are not familiar with the state of the practice. This is consistent with our finding in the event processing area where people prefer to reinvent the wheel and don't even know the wheel exists. Another perspective of Richard's talk you can find in the article by Chris Taylor, who was the session organizer.
My talk on Internet of Things and Personalization is available on Slideshare. This is a shorter variation (with some additions) of my DEBS'14 tutorial. Enjoy!
I am also planned to deliver a variation of this talk twice more this week: in IBM Research at Yorktown Heights, and in Stony Brooks University.
I'll write more insights from the other talks - later.
I have not written for a while... Busy days. I'll write about my daily work in other opportunity.
Last week I've spent a couple of days in Athens, Greece, as a member of the advisory board of the Proasense project. This project deals with proactive computing, which a paradigm that I have been advocating for several years. There are now couple of EU projects I know (the other one is Speedd) in the proactive space. The proactive idea is that problems can be eliminated or mitigated before they happen. The Proasense project employs two interesting use cases: one in the manufacturing area, and the other in the oil drilling area, an application that we have investigated a couple of years ago.
I am still in the opinion that proactive computing will be a major paradigm in the future, and will follow this project during the next couple of years with interest.
Cisco that advocated the term "Internet of Everything" is now advocating the term "Fog Computing". these terms are related. According to Cisco the cloud computing model is being replaced by the fog model.
While in cloud computing all computation is done in a remote computing center, in fog computing the computation is distributed between local processing ("at the edge of the network") and remote processing. The relationship to the sensor world is straightforward. A site might have multiple sensors. Some of the processing can be processed locally, and some need to be processed in a remote place, furthermore, this may be dynamic and tuned in real-time. The picture above shows the before (cloud model) and after (fog model). The example is energy system. There may be processing done in a processor located in a single house which takes into considerations all sensors installed in the house. There are other types of processing that related to data from multiple houses and need to be processed in a place where all data is available.
Note that nothing is really new (besides the names). Cloud computing is a new name for an old computing model that was once called "service bureau". In the past the "cloud" was a single mainframe, and the edge where collection of dumb terminals. Now the cloud is a grid, and the edge has processing power, but the principle is the same. Fog is also an old principle of distributing the work reminding of N-tier middleware.
I guess that the fog model is indeed more appropriate for IoT scenario than cloud model, in some of the projects that we are now planning within the Institute of Technological Empowerment, are indeed fog based. The sensors are going to be communicating with a local processor (which may be as simple as a tablet) with some processing done on the local processor, and some on the cloud. This brings us back to the idea of event processing on mobile.
After cloud and fog, we are waiting also for some - wind, rain, and sleet....
Gartner published its hype cycle report recently. The "Internet of Things" is now at the top of the hype cycle, defined as "peak of inflated expectation". "Big Data" which has been there before, and now moved down the line of disillusionment. Another hype in the height is the "natural language question answering" that was hyped by IBM's Watson. In the upwords side we can see among other things: software-defined anything, connected home, and prescriptive analytics. Note that in the right-hand side there are technologies which are considered mature, such as: speech recognition, enterprise 3D printings and in-memory analytics. "Complex event processing" is moving slowly down the disillusionment path.
I was invited to give a talk in the Internet of Things summit that will take place in INTEROP, in NYC September 29.
My talk will be about "The Internet of Things and Personalization", the area I am investigating nowadays.
Other speakers will be Richard Soley, CEO of OMG, and John Morris, VP of ComplexIT.
The moderator is Chris Taylor from TIBCO, a well known writer in this area.
Anybody that wishes to meet me in the NYC area during that week - please let me know.
