This week on Active Information, I expanded on a random thought that popped into my head while watching the Patriots-Broncos game. Go Pats!
Football and Weekend Data Warriors
This week on Active Information I riffed on a WSJ article that riffed on Daniel Kahneman‘s Thinking, Fast and Slow, which led me into the data scientist shortage and analytics-as-a-service.
Alas, as I didn’t lead with any of those buzzwords in the title, the post is sadly under-read. Anyway, the link and blurb follow. I’m off to hone my buzzword skills.
Quite possibly, we will find ourselves in a “there’s an algorithm to decide that” world. But, until the talent shortage is stemmed, we’ll need to get our rationality delivered.
Event Processing at the Large Hadron Collider | Complex Event Processing (CEP) Blog
Paul Vincent on events and Higgs boson:
“Earlier this month Dr Neil Geddes gave a fascinating presentation at the BCS on “Data Processing at the Large Hadron Collider”, describing how LHC experiments create 1 Billion events per sec of which they can record in detail 100 events per sec.”
Predicts 2012: Information Infrastructure and Big Data
I would edit this to be: “Make event-driven architecture and complex event processing first-class citizens”, but I can live with the following from Gartner:
“Make event-driven architecture and complex event processing first-class citizens in data modeling work and metadata repositories.”
Disruptions: Resolved in 2012: To Enjoy the View Without Help From an iPhone – NYTimes.com
I get my best ideas during dog walks… not to mention, some really out there ideas as well.
“Jonah Lehrer, a neuroscientist and the author of the soon-to-be-released book, “Imagine: How Creativity Works,” said in a phone interview that our brains often needed to become inattentive to figure out complex issues. He said his book discussed an area of the brain scientists call “the default network” that was active only when the rest of the brain was inactive — in other words, when we were daydreaming.
Letting the mind wander activates the default network, he said, and allows our brains to solve problems that most likely can’t be solved during a game of Angry Birds.”
My latest posts on the HPIO Active Information blog:
Streaming through a Computational World — (most popular post to date)
To take advantage of the computational world, or the nearer term internet of things, we need to infuse smarts throughout our data collection networks. We need to employ up-front and intermediate filters, traffic cops, aggregators, pattern detectors, and intelligent agents. We need to get over being data hoarders, and have the astuteness to leave data behind.
Busting cultural resistance via experimentation platforms — (changing change)
Culture, mistrust of the data, lack of interest. These very human factors are adoption barriers for 46% of the respondents. Yet, these barriers aren’t new. Nor, confined to big data and advanced analytics. To change a culture, you need to bring proof to the table. And proof requires hands-on experimentation and real-world data. We need data to prove that we need data. How will we get that?
Five big data predictions for 2012 – O’Reilly Radar
FINALLY! –> Streaming data processing: “Over the next few years we’ll see the adoption of scalable frameworks and platforms for handling streaming, or near real-time, analysis and processing. In the same way that Hadoop has been borne out of large-scale web applications, these platforms will be driven by the needs of large-scale location-aware mobile, social and sensor use.
For some applications, there just isn’t enough storage in the world to store every piece of data your business might receive: at some point you need to make a decision to throw things away. Having streaming computation abilities enables you to analyze data or make decisions about discarding it without having to go through the store-compute loop of map/reduce.
Emerging contenders in the real-time framework category include Storm, from Twitter, and S4, from Yahoo.”
“They work very hard to stay very small. Even top-tier talent is turned aside or denied. The emphasis has shifted from “how do we successfully scale the team?” to “how do we successfully scale the team’s influence and deliverables?” Instead of seeing an explosion of virtual teams, what’s emerged are teams cleverly using digital and social media to extend their reach both inside the enterprise and out. Key suppliers and channels are contacted on an “as needed” basis”
Clive Thompson on Why Kids Can’t Search | Magazine
“Today the question is, why can’t Johnny search?
Who’s to blame? Not the students. If they’re naive at Googling, it’s because the ability to judge information is almost never taught in school. Under 2001’s No Child Left Behind Act, elementary and high schools focus on prepping their pupils for reading and math exams. And by the time kids get to college, professors assume they already have this skill. The buck stops nowhere. This situation is surpassingly ironic, because not only is intelligent search a key to everyday problem-solving, it also offers a golden opportunity to train kids in critical thinking.”
Don’t Let What You Know Limit What You Imagine – Bill Taylor – Harvard Business Review
“Many organizations, she argues, struggle with a “paradox of expertise” in which deep knowledge of what exists in a marketplace or a product category makes it harder to consider what-if strategies that challenge long-held assumptions. “When it comes to innovation,” she writes, “the same hard-won experience, best practice, and processes that are the cornerstones of an organization’s success may be more like millstones that threaten to sink it.” “
Scott Aaronson – Quantum Computing Promises New Insights – NYTimes.com
The goal in quantum computing is to choreograph a computation so that the amplitudes leading to wrong answers cancel each other out, while the amplitudes leading to right answers reinforce.
My latest posts on the HPIO Active Information blog:
Ready or not, here comes Big Data
Sometimes though, a trend is so compelling (e-commerce, mobility), in-your-face (social media) or simple to comprehend (cloud), that it leaps into mainstream media and takes on a life of its own. Instead of playing the role of serial advocate, corporate IT leaders and architects are suddenly in a game of catch-up.
Rx for AstraZeneca: Real-world evidence
Rethinking their prelaunch process, and data needs, AstraZeneca proposed a data collaboration with customers.
And one of my favorites:
Why do we still have titled CIOs, yet no clear candidate C-level executive to manage the organization’s information agenda?
5th Anniversary Edition
Event-Driven Architecture Overview
Except where marked by a copyright notice, content on this blog is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.
