tag:blogger.com,1999:blog-4285729513030543746.post5257389372861570577..comments2024-03-27T00:26:40.551-07:00Comments on Real Time View: I need data I can digest, in small bites, please!Richard Bucklehttp://www.blogger.com/profile/17723428627971060930noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-4285729513030543746.post-23949368882689886442014-07-28T07:22:10.556-07:002014-07-28T07:22:10.556-07:00That middleware had better be fast because hey bab...That middleware had better be <b><i>fast</i></b> because hey baby, it's an InfiniBand world that is emerging. That middleware had also be asynchronous because blocking to wait for something (i.e. a queue, resources, write completion etc.) is not an option. Speaking of resources, these resources are typically shared so a mechanism is needed for synchronization (i.e. serialized access, group notifications, publish-subscribe etc.) The final requirement is that this middleware needs to be usable by applications. I am envisioning an OLTP application that generates an actionable event that need not be part of a transaction but does need to be dispatched in a very light-weight manner. SQL-based pub-sub is not going to cut it.<br /><br />Justin and I were talking last week about the notion that Big Data needs to intersect with Fast Data. <br /><br />Finally, look at what is in place <b>right now</b>. We have Moonshot that supports Mellanox InfiniBand cards and integrating it with Windows and Linux is already a done deal with open-source VMA. Nonstop, VMS and HP-UX need to be able to play in that space because though they may not be presently available on Moonshot, there is no reason why they cannot have a fiber connection into a Moonshot platform. This means its access to Moonshot resources will be just as fast as that of all the processors residing in the Moonshot cabinet. What is missing is higher-level middleware solutions that can leverage this plumbing. If HP builds this, they will come. Other thoughts?Dean E Malonehttp://www.caleb-ltd.comnoreply@blogger.comtag:blogger.com,1999:blog-4285729513030543746.post-66930522770865581652014-07-28T07:19:24.829-07:002014-07-28T07:19:24.829-07:00I see the need for a few critical pieces to make t...I see the need for a few critical pieces to make this possible. The watchword here is "building blocks." It starts with the plumbing. Middleware is needed to move data from its source to its destination. In the case of NonStop, that is shaping up to be seen as Nonstop-to-HAVEn platforms. Dean Malonehttp://www.caleb-ltd.comnoreply@blogger.comtag:blogger.com,1999:blog-4285729513030543746.post-26856177118942599602014-07-24T10:56:17.481-07:002014-07-24T10:56:17.481-07:00This blog highlights an opportunity I faced a numb...This blog highlights an opportunity I faced a number of years ago while running extremely high volumes of airline shopping queries through NonStop being monitored by IR. We were literally dumping valuable log data in the bit bucket. Locked within the log data was what the traveling public was asking for, what they were shown, and what they bought with regards to air travel. This stream of data, well actually more like a raging torrent of data, could have been analyzed and used to create actionable, real time business intelligence for airlines with an application built on Webaction’s real-time enterprise data app platform. A lot has changed in the last decade – it will be interesting to see which companies can exploit the capabilities afforded by new, and perhaps some reborn technologies.Scott Healyhttp://www.linkedin.com/in/scottahealynoreply@blogger.com