Keynote: Spark+Hadoop and how it relates to Scala
Please log in to watch this conference skillscast.
Scala seems to be, suddenly, an important language within the Apache Hadoop ecosystem, with the arrival of Scala-based projects like Apache Kafka and Apache Spark -- which is in essence "distributed Scala". In fact, it's not a surprising marriage: Hadoop has been building on functional paradigms and immutability in its way for years through MapReduce/HDFS, and projects like Crunch and Cascading. This talk will give a Hadoop-centric take on the evolution of Scala, its benefits to Hadoop-related projects, why it succeeds where other languages don't in Hadoop, and some quirks that remain barriers to its further adoption in "big data".
YOU MAY ALSO LIKE:
- What “50 Years of Data Science” leaves out (SkillsCast recorded in April 2017)
- Lightbend Scala Language - Professional (in London on 9th - 10th September 2019)
- Lightbend Scala Language - Expert (in London on 11th - 13th September 2019)
- Scala eXchange London 2019 (in London on 12th - 13th December 2019)
- Workshop: Improving compile times (in London on 23rd July 2019)
- London Java Community July (in London on 24th July 2019)
- Why API Design Matters, and Why Yours Sucks! (and mine sucks too!) (SkillsCast recorded in June 2019)
- The Elements of Tagless Final Style (SkillsCast recorded in May 2019)
Thanks to our sponsors
Keynote: Spark+Hadoop and how it relates to Scala
Sean Owen
Sean is Director of Data Science at Cloudera in London. Before Cloudera, he founded Myrrix Ltd (now, the Oryx project) to commercialize large-scale real-time recommender systems on Apache Hadoop. He is an Apache Spark committer and co-authored Advanced Analytics on Spark. He was a committer and VP for Apache Mahout, and co-author of Mahout in Action. Previously, Sean was a senior engineer at Google.
Please log in to watch this conference skillscast.
Scala seems to be, suddenly, an important language within the Apache Hadoop ecosystem, with the arrival of Scala-based projects like Apache Kafka and Apache Spark -- which is in essence "distributed Scala". In fact, it's not a surprising marriage: Hadoop has been building on functional paradigms and immutability in its way for years through MapReduce/HDFS, and projects like Crunch and Cascading. This talk will give a Hadoop-centric take on the evolution of Scala, its benefits to Hadoop-related projects, why it succeeds where other languages don't in Hadoop, and some quirks that remain barriers to its further adoption in "big data".
YOU MAY ALSO LIKE:
- What “50 Years of Data Science” leaves out (SkillsCast recorded in April 2017)
- Lightbend Scala Language - Professional (in London on 9th - 10th September 2019)
- Lightbend Scala Language - Expert (in London on 11th - 13th September 2019)
- Scala eXchange London 2019 (in London on 12th - 13th December 2019)
- Workshop: Improving compile times (in London on 23rd July 2019)
- London Java Community July (in London on 24th July 2019)
- Why API Design Matters, and Why Yours Sucks! (and mine sucks too!) (SkillsCast recorded in June 2019)
- The Elements of Tagless Final Style (SkillsCast recorded in May 2019)
Thanks to our sponsors
Keynote: Spark+Hadoop and how it relates to Scala
Sean Owen
Sean is Director of Data Science at Cloudera in London. Before Cloudera, he founded Myrrix Ltd (now, the Oryx project) to commercialize large-scale real-time recommender systems on Apache Hadoop. He is an Apache Spark committer and co-authored Advanced Analytics on Spark. He was a committer and VP for Apache Mahout, and co-author of Mahout in Action. Previously, Sean was a senior engineer at Google.