• Blog
  • About
  • Archives

elemental links

brenda michelson's technology advisory practice

Link Collection- July 17, 2011

July 17, 2011 By brenda michelson

  • Preview of Storm: The Hadoop of Realtime Processing – BackType Technology

    Curious to see what happens with Storm, post-Twitter acquisition of BackType

    “There are three broad use cases for Storm:

    1. Stream processing: This is the traditional realtime processing use case: process messages and update a variety of databases.

    2. Continuous computation: Storm can be used to do a continuous computation and stream out the results as they’re computed. For example, we used Storm the other day to compute trending users on Twitter off of the Twitter firehose. Every second, Storm streams out the 50 users with the most retweets in the last few minutes with perfect accuracy. We stream this information directly into a webpage which visualizes and animates the trending users in realtime.

    3. Distributed RPC: Distributed RPC is perhaps the most unexpected and most compelling use case for Storm. There are a lot of queries that are both hard to precompute and too intense to compute on the fly on a single machine.”

    tags: storm backtype oss real-time

  • The challenges of streaming real-time data – O’Reilly Radar

    “You would be shocked at the ratio of engineers who can’t build event-driven, asynchronous data processing applications, to those who can, yet this is a big part of this space.”

    “…Jud Valeski: “Big data” as we talk about it today has been slayed by lots of cool abstractions (e.g. Hadoop) that fit nicely into the way we think about the stack we all know and love. “Big streams,” on the other hand, challenge the parallelization primitives folks have been solving for “big data.” There’s very little overlap, unfortunately. So, on the software solution side, better and more widely used frameworks are needed…”

    tags: real-time streaming event-driven

Posted from Diigo. The rest of my favorite links are here.

Share this:

  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to email this to a friend (Opens in new window)

Filed Under: links

Brenda M. Michelson

Brenda Michelson

Technology Architect.

Trusted Advisor.

(BIO)

  • Email
  • LinkedIn
  • RSS
  • Twitter

Recent Posts

  • Experts Sketch
  • PEW Research: Tech Saturation, Well-Being and (my) Remedies
  • technology knowledge premise
  • The Curse of Knowledge
  • better problems and technology knowledge transfer

Recent Tweets

  • Why Strangers Are Good for Us https://t.co/t4hVuJp4Hr June 12, 2022 2:28 pm
  • https://t.co/vyUtnBwhTO June 8, 2022 10:11 pm
  • “We find ourselves not by being The most seen, but the most seeing.” - Amanda Gorman, Compass, from Call Us What We Carry June 3, 2022 3:43 pm
© 2004-2022 Elemental Links, Inc.
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.