• Blog
  • About
  • Archives

elemental links

brenda michelson's technology advisory practice

Archives for September 2008

CIO Magazine | SOA Consortium Case Study Contest: And the winners are…

September 24, 2008 By brenda michelson

This morning at the SOA Consortium meeting in Orlando, Richard Soley announced the winners of the CIO Magazine | SOA Consortium case study contest.  The goal was to highlight business success stories and lessons learned to provide proof points and insights for other organizations considering or pursuing SOA adoption. To qualify for the contest, the SOA project must have been completed with demonstrated business results.

There was one overall winner, and five industry recognition winners.  To see the winners and learn more about their stories jump to SOA Consortium Insights or the SOA Consortium website. 

 

[Disclosure: The SOA Consortium is a client of my company, Elemental Links]

Filed Under: services architecture, soa

Event Processing Technical Society (EPTS) Symposium take-aways

September 22, 2008 By brenda michelson

Before I fully immerse myself in the SOA Consortium this week, I wanted to augment my “reporting” on last week’s EPTS symposium with a little analysis.

My EPTS Take-Aways

True Industry Collaboration – As Opher mentioned, 41 of the 70 attendees were event processing vendors, representing a many of the technology providers in the space: Aleri, Coral8, Event Zero, IBM, iLog, Nastel, Oracle, Progress Apama, RuleML, Streambase, Tibco, and West Global.  What impressed me is these vendors attended the symposium not to one up each other, but to work together to move both the technology and market forward.  While I didn’t attend the follow-on business meeting, I learned that several new working groups have been proposed to explore important topics including event processing languages, reference architectures, benchmarks, university curriculums and interoperability.  These are in addition to the current EP glossary and use case efforts.

Cross Industry Applicability – While Capital Markets and “secret agencies” are fertile grounds for event processing applications, the market doesn’t begin and end there.  Many participants, myself included, brought forward event processing examples related to business intelligence, business visibility & responsiveness, passenger transportation, freight & logistics, information dissemination, healthcare (epidemic, patient monitoring, RFID in-body monitoring), ambient intelligence (smart homes, smart cities, personalized mobile information systems), workplace safety, homeland security (storm evacuation, first responder systems, terrorism situational awareness, power / fuel / water system monitoring, and environmental systems.

Hype is Relatively Low – I made this point in my panel presentation, and frankly, I think it surprised many of the attendees who are immersed in event processing, and therefore partake in high, but localized hype.  So, for my practitioner readers, I apologize in advance for sparking a hype wave.  However, if the EPTS sticks to its mission, and truly collaborates on (as Seth Grimes mentioned) bringing some ‘precision’ to the space, then the hype could very well be productive, rather than destructive. 

Forthcoming Battles – Speaking of destructive, two battles are imminent.  One, the language wars: (a) SQL vs. procedural vs. Rules and (b) mine vs. yours.  Second, what are the boundaries of event processing?  Is information dissemination in or out?  Same with sensor applications?  Does it depend on the use of an event processing engine?  As Mani Chandy asked, is event processing the engine, or the result?

Early for Standards – While standards are good for practitioners and market adoption, standards for standards sake are a mistake.  And yes, I am thinking of the ‘early and often’ delivery of WS* standards as I type this.  So, in a way, I was relieved to hear that EPTS isn’t knocking down the doors of standards bodies with ‘must haves’.  However, I hope the group doesn’t back burner the standards conversation, because if they don’t take the lead, someone else might, and that could be troublesome for all parties.

 

[Disclosure: None of the vendors mentioned in this post are current clients of Elemental Links, but that can change 😉 ]

Filed Under: circuit, event driven architecture, event processing

EPTS Event Processing Symposium, Live Blogging Day 2: Event Processing Standards Panel

September 18, 2008 By brenda michelson

Panel: Event Processing Standards? – What? When? Why? How they are related to other standards?

Moderator: Roy Schulte, Gartner

Panelists:

  • Adrian Paschke (RuleML)
  • Bob Marcus (SRI)
  • Chris Ferris (IBM)
  • Louis Lovas (Progress/Apama)
  • Paul Vincent (TIBCO)

Roy opens sharing Gartner taxonomy of relationships between Web Architecture, SOA and Event Processing.  SOA & Web overlap in Web Oriented Architecture, SOA & Event Processing overlap in Event Driven SOA.  (No overlap charted between Web & Event, but there probably is one.)

Next, Roy talks about how SOA adoption accelerated with WS* standards.  As well, he points out important Web Standards such as HTTP, REST & Atom (maybe more, slide moved to fast).

Points out the neither WS* or Web standards address application portability of CEP.  Nor, were they expect to.

Questions for panel:

  • Are protocol standards for messaging important?  If so, Atom, SOAP, WS-RM, WS-Eventing, WS-Notification, AMQP, DDS, other?
  • Do we need standards for event schemas?
  • (slide moved to quick)
  • (slide moved to quick)

Paul Vincent, Tibco

What areas of interest?

  • Model language standard
  • Execution Semantics standard
  • Middleware channel standard
  • event payloads / DSLs
  • Framework / Service standard

Tibco, what, when and why depend on customer interest/demand.  Shows laundry list of current standards and activities that may apply.

Adrian Pashcke, RuleML

Shares another list of existing standards that may apply.  Some standards overlap with Paul’s list.  Lots of functional overlap on and between the lists. Adrian is second of five panelists, I have a bad feeling about where this is going.

Bob Marcus, SRI

6 Points for Event Processing

  • Explosion in EP applications caused by data deluge
  • Cloud platform will be a major part of the solution for many users
  • An enterprise cloud computing group has been formed which could provide a forum for Event Processing as a Service
    • Specify data sources to monitor
    • Specify QoS, resources to use
    • Need a standard complex event definition language for user queries

 

Louis Lovas, Technical Fellow, Progress / Apama

Starts with the integration challenge, including many message protocols and many message semantics (data formats, business transaction/semantics), capital markets are fragmented — racing to microsecond, leads to proprietary protocols, SOA standards abound and sensor devices have little standardization on data formats.

Standards lead to reduced implementation costs, improved vendor software tooling and specialized components for industries.  Warns against blindly applying SOA standards to event processing.  End up with bunch of JMS messages, not events.

“Language is most contentious issue facing EP industry.  Streaming SQL does not equal CEP.”

Louis throws another standard into the mix, STAC Benchmark council.

 

Chris Ferris, IBM

Chris asks, “are we ready to create standard?”  Will standards created now allow products to be put in place for next 5-15 years?  Is there a framework that can be developed now and extended over time?

Semantics will be the key.  Dealing with information from organizations in which you (event processor) have no control.  How to connect the dots between the various semantic schemes?

 

Q&A

1. What should EPTS do in respect to pushing requirements to standards organization?  Is it time?  Or, still too early?  Should group be working on event format?  Panel discussing origins of SOAP & WSDL and how ‘ecosystem was created’.  Now, I’m scared.  Oh good, so is another panelist, calling out shift to REST because of WS* complexity.

Unfortunately, I need to cut out to catch my train.  I’ll ping Roy to learn about the panel outcome.

Filed Under: event driven architecture, event processing

EPTS Event Processing Symposium, Live Blogging Day 2: Event Processing Standards Keynote

September 18, 2008 By brenda michelson

Standards keynote: The role and influence of standards Chris Ferris,IBM Distinguished Engineer, CTO Industry Software Standards, IBM Software Group

Objective to discuss standards in general, as informational to EP society as it considers standards.  As for EPTS’ role in standards:

“Work with existing standards development organizations such as OMG, OASIS and W3C to disseminate and where necessary incubate a set of consistent; standards in the areas of: event formats, event processing interoperability, event processing (meta) modeling and (meta) languages; EPTS does not plan to develop standards itself.”

Back to Chris’ talk:

Open Standards

  • improve information sharing
  • simplify integration of disparate technology
  • promote interoperability

What is a meaningful gauge?

  • Broad adoption
  • public interfaces/public input
  • path to long term stewardship

What to watch out for

  • “based on standards”
  • “leverages open standards”
  • “standardized on a particular product”

Why are standards important?  For technology adopters, standards create choice, flexibility, speed, agility and skills.  “Open standards give us the most options and the best chance to gain real interoperability”.  “Taking care of your customers first will take care of your business!” (obligatory dig on vendors with “closed standards”)

Chris then shared IBM’s approach to standards development, from idea generation to innovation to standardization to ecosystem exploitation.  He provided industry standards development tips to EPTS members, which were helpful to the group, but not relevant to the majority of my blog readers. 

IBM notes the following standards as relevant to EP:

  • WS-Eventing* 
  • WS-Notification*
  • StreamSQL

*the joint IBM-Microsoft work to bring WS-Eventing & WS-Notification together as WS-EventNotification (pdf) has stopped.  New WS-Eventing work has been proposed to W3C.

Filed Under: circuit, event driven architecture, event processing

EPTS Event Processing Symposium, Live Blogging Day 2: CTO & Researchers Panel

September 18, 2008 By brenda michelson

Jerry Baulier, CTO of Aleri

Current cutting edge work:

– Evolving authoring paradigms & languages / computational model

  • convergence of relational data flow & rule based paradigms
  • multiple authoring languages – SQL, Visual directed graphs, lower level textual
  • enhancements to the relational paradigm to include pattern matching & procedural programmable streams
  • increased state management constructs

– Hybrid Analytics

  • real-time ep integrated with historical analytics
  • extending into OLAP

– Visualization, Sensor data & authoring extensions

Mani Chandy, Cal Tech, sensor detection projects, are they also CEP?

  • Nuclear detection – handheld sensor devices to detect dirty bomb prior to explosion
  • predict shaking from earthquake – once it starts
    • crowd sourcing data collection, people attaching sensors to their computers at home;

Malcolm Lockhart, CTO, Event Zero

“Event processing is ‘Dessert topping and floor wax'”, many event processing domains:

  • Industry – utilities and manufacturing
  • Business class – BAM, BPM, MDM
  • Speciality – intelligence and defense
  • Future Internet – semantic web, massive pub-sub, content based networking

Event Processing Topologies:

  • Monolithic CEP, few endpoints, single location
  • Event Processing Network, many known endpoints — This is Today
  • Event Cloud, unknown numbers of endpoints

John Bates, Progress Apama

– Monitor, analyze and act on everything.

– Event processing for “augmented life”, (graphic of windshield notifying driver of location based information)

– Event processing for “extended life” – RFID pill that updates on all human vitals, used during fun run; could extend to medication delivery

Technology Visions for EP

  • new application paradigm
  • Events as “first class” objects
  • Event-driven SOA, millions of modules producing & consuming events
  • real-time BI
  • graphical programming
  • voice-based adhoc programming
  • next generation “pattern discovery”
  • globally federated applications
  • complex rules tracking millions of objects
  • federated event schemas across application boundaries
  • EP that “follows you in the cloud”

Albert Mavashev, Nastel, Applying CEP & Monitoring to Complex SOA

  • CEP can observe how businesses actually behave, observe pattern of activity, determine if normal, or not, and act
  • CEP in the cloud
  • Virtual grid of event processing engines to deliver QOS

John Morril, Coral8

directions customers are dragging them into:

  • More power, CEP GRIDs — Wall Street firm for risk management, risk as a service, (started a bit late)
  • Sophistication requires increased control – stats, optimization, tuning
  • deployability – managing a large network of CEP engines/applications
  • user empowerment & integration – data streams, external apps and downstream tools – metadata exchange notion in adapters
    • example of metadata exchange with existing BI tools, leverage existing tools and reports

Q&A

1. Event processing/CEP as a service, real or work-in-progress?  Event processing platforms are work in progress.  But, event processed results are available as a service — airlines as an example.

2. How are vendors dealing with integration problems? John Bates – traditional adapters.  Need a semantic type integration to better inter-operate events and services. 

3. What is event processing? Mani Chandy – are we focusing on technology, or the results?  what do we care about most?  We, as EPTS.

4. What academic work needs to be done on GRID & Event Processing? Panelists & audience point to Google’s MapReduce as foundation.

5. Projects like Active Badge and protecting privacy?  John Bates was on that project, and mentioned how issues arose such as who should know how long was so-and-so in bathroom.  (no).  But, pervasiveness of cameras and sensors bring up need for new regulation.  Jerry Baulier, many good RFID based applications such as child protection and location.  Albert Mavashev, privacy issues increase as move to cloud (outside bounds of enterprise).  Malcolm Lockhart, spend a lot of time on event integrity, including who can use, store and see.

6. Unique challenges for security in CEP? Malcolm – describing security model is biggest challenge, access control per event, but it is data in motion, not at rest.

7. Should event processing engines stand alone? Or, will engines be embedded in other software (infrastructure or application)?  Panelists agree that hybrid model will exist.  Today, mostly stand alone, but embedded in some software such as systems management.

8. Event as first class citizen? John Bates, generally means not being an adjunct of databases.  Events can be generated, acted upon by any programmer or business user. 

9. David Luckham asks, “Is content based routing on the Internet (Internet scale) a feasible goal? Routing messages more efficiently, only get the messages that you want, brings precision.”  Not yet.

Filed Under: circuit, event driven architecture, event processing

Next Page »

Brenda M. Michelson

Brenda Michelson

Technology Architect.

Trusted Advisor.

(BIO)

  • Email
  • LinkedIn
  • RSS
  • Twitter

Recent Posts

  • Experts Sketch
  • PEW Research: Tech Saturation, Well-Being and (my) Remedies
  • technology knowledge premise
  • The Curse of Knowledge
  • better problems and technology knowledge transfer

Recent Tweets

  • “…where the process of drawing itself can take us. We can follow a suggestion, a squiggle, shadow, or smudge, and s… https://t.co/oRg0x2LoXG November 30, 2022 5:05 pm
  • On the waiting list for Post, join me (on the waitlist) via https://t.co/U8wYK707f6 November 24, 2022 4:17 pm
  • Meet the longtime librarian being honored at the National Book Awards : NPR https://t.co/S44VQeJg83 November 13, 2022 2:51 pm
© 2004-2022 Elemental Links, Inc.