Fast Data: Tools and Peopleware

Please log in to watch this conference skillscast.

For decades, many have argued for and against Dearden’s “Myth of real-time management information” HBR 1966. At best most organizations have had only partial data, and insufficient storage and processing, limiting their ability to be a real-time enterprise. Thanks to massive compute power, memory and storage it is now finally possible for modern enterprises to capture and process the totality of their data current and past. Given they have real-time data the challenge becomes how to clean, transform, query, analyze and present this in meaningful, actionable real-time information. In this talk, we discuss the challenges of working with the real-time data deluge from sensor IoT to Big Data.

We take a brief look at the world of big data tools, event processing, and skills as they exist today. We then discuss our experience building Ivy, an interactive visual analytics environment for Thinkers. Thinkers are the key enablers for a real-time enterprise and need a capability to Think-Compute-See and actively participate in problem solutions. We discuss user requirements for acquisition, preparation and visualization and our challenges developing solutions consumable by Thinkers that are built on state of the art software technologies fast data technologies.

YOU MAY ALSO LIKE:

• Coevolution of Architecture and Code - Closing the Gap? (SkillsCast recorded in September 2022)
• Rust Nation 23 (in London on 16th - 17th February 2023)
• F# eXchange 2023: In-Person (in London on 7th - 8th March 2023)
• Haskell In Person: Bring Your Project, Get help with your code & socialise (in Berlin on 1st February 2023)
• How to teach IntelliJ IDEA to your juniors (Online Meetup on 2nd February 2023)
• Teaching Haskell...To High Schoolers! (SkillsCast recorded in December 2022)
• Teaching Haskell...To High Schoolers! (SkillsCast recorded in December 2022)