Please log in to watch this conference skillscast.

In this talk though we'll focus on Scalding - a library, developed at Twitter, but used by many others - including eBay - to simplify and bring back the joy to Big Data by using a thin layer of Scala on top of Cascading to build-up data processing "as if it was a simple map { transformation } in plain Scala!

Hadoop and all it's eco system has settled down for good in our hearts and / or minds. It's quite old and has proven to be quite reliable for certain kinds of tasks. Yet one problem still remains - writing Map Reduce jobs in plain Java is really a pain.

The API is clunky and does it's best to hide the actual algorithm beneath tons of boilerplate. Throughout the years many tools and aproaches have shown up - Hadoop's own Streaming API or the great Cascading library.

We'll dive into code examples as well as look into how Scalding actually works, so you can try it out on your cluster when you come back to work on Monday (and smile a bit more when asked to write a Job next time!)

YOU MAY ALSO LIKE:

• Workshop: End-to-end asynchronous back-pressure with Akka Streams (SkillsCast recorded in December 2015)
• Fast Track to Machine Learning with Louis Dorard (in London on 15th - 17th July 2019)
• Lightbend Scala Language - Professional (in London on 9th - 10th September 2019)
• Infiniteconf 2019 - A one-day community celebration of Big Data, Machine Learning and AI (in London on 4th July 2019)
• ProgNET London 2019 (in London on 11th - 13th September 2019)
• Disruptive innovation: what it really means to the construction sector (in London on 9th July 2019)
• Power BI July (in London on 9th July 2019)
• Using Watson to talk to traditional systems without breaking the bank! (SkillsCast recorded in June 2019)
• Achieve 100% Analytics Adoption with a New Class of Enterprise Intelligence (SkillsCast recorded in June 2019)