Chitchat: Decentralised Cluster Membership with Failure Detection in Rust

Cluster membership management is one of the critical aspects of a distributed system. To put it simply, nothing can work if nodes don’t know about each other and what service or resource each can offer.

In this talk, first, we briefly describe Quickwit’s previous cluster management implementation. Then deeply explore the new implementation based on the scuttlebutt algorithm while highlighting our motivations and what the current rust ecosystem offers. The algorithm presented here is also what powers Apache Cassandra cluster feature. We finally conclude by presenting a couple of tricks we used to overcome some implementation challenges while contrasting with the solutions adopted by Apache Cassandra.

YOU MAY ALSO LIKE:

• Teaching Haskell...To High Schoolers! (SkillsCast recorded in December 2022)
• Teaching Haskell...To High Schoolers! (SkillsCast recorded in December 2022)