Count-Min Sketch in Real Data Applications
Please log in to watch this conference skillscast.
Queries such as whether a user has seen a tweet, the number of unique users who have favourited a tweet, or the number of times a tweet was seen over a period of time, are all hard to answer exactly due to having huge datasets and tight time constraints. However, the exact number is often not necessary as long as the errors are bounded. Certain algebraic data structures enable approximate answers to the queries mentioned, owing to distributed computations performed over them that are guaranteed to be correct because of their algebraic properties.
Take a look at Algebird and Summingbird.
YOU MAY ALSO LIKE:
- Scala Days 2023 (Online Conference on 1st - 30th December 2023)
- LJC Live with Andrzej Grzesik and Karsten Silz (in London on 16th February 2023)
- Take a load off: how strong platform engineering moves an organisation forward (Online Meetup on 23rd February 2023)
- Taming the Context Beast (SkillsCast recorded in October 2022)
- The Middle Way for Static Typing in Spark DataFrames (SkillsCast recorded in October 2022)
Thank you to our sponsors and partners
Platinum
Gold
Silver
Bronze
Partners
Count-Min Sketch in Real Data Applications
Laura Bledaite
Laura is a data scientist at Twitter with a taste for functional programming. She mostly writes Scala, though she really admires O'Caml as well. Laura knows a bit about recommender systems, statistics and math. She did her BSc in Financial and Actuarial Mathematics in Vilnius University, where with several friends she wrote a thesis about The Role of Tail Index in Analysis of Currency Returns.