Adaptive Recommender Systems with Apache Spark

Please log in to watch this conference skillscast.

At Elsevier, Adam and Anna have augmented their CF-based research article recommender system with a ‘Learning to Rank’ (LTR) machine learning model that uses a rich array of article features to modify and re-rank recommendations. In addition, this model is constantly adapting to real user feedback, so that recommendation quality improves over time with no manual intervention.

In this talk, we will explore the implementation of the CF algorithm and adaptive LTR model in Apache Spark to produce demonstrably higher quality recommendations to our users, and look at how Spark allows developers and data scientists to work together on a web-scale production system.

YOU MAY ALSO LIKE:

• Embrace the Implicit (SkillsCast recorded in December 2018)
• Scala Days 2023 (Online Conference on 1st - 30th December 2023)
• LJC Live with Andrzej Grzesik and Karsten Silz (in London on 16th February 2023)
• Take a load off: how strong platform engineering moves an organisation forward (Online Meetup on 23rd February 2023)
• Taming the Context Beast (SkillsCast recorded in October 2022)
• The Middle Way for Static Typing in Spark DataFrames (SkillsCast recorded in October 2022)