Please log in to watch this conference skillscast.
Kafka has become the de facto platform for reliable and scalable distribution of high-volumes of data. However, as a developer, it can be challenging to figure out the best architecture and consumption patterns for interacting with Kafka while delivering quality of service such as high availability and delivery guarantees. It can also be difficult to understand the various streaming patterns and messaging topologies available in Kafka.
In this talk, Jaakko will share with you the patterns the team has successfully employed in production and provide the tools and guidelines for other developers to choose the most appropriate fit for given data processing problem. The key points for the presentation are: patterns for building reactive data pipelines, high availability and message delivery guarantees, clustering of application consumers, topic partition topology, offset commit patterns, performance benchmarks, and custom reactive, asynchronous, non-blocking Kafka driver.
YOU MAY ALSO LIKE:
- Domain Models in Practice with Marco Heimeshoff (Online Workshop on 6th - 10th June 2022)
- Hands‑on Microservices Architecture and Design Workshop with Chris Richardson (Online Workshop on 7th - 17th June 2022)
- Java Forum (Online Conference on 31st August 2022)
- iSAQB Software Architecture Gathering — Digital 2022: 2-Day Sessions Ticket (Online Conference on 16th - 17th November 2022)
- LDN Talks May 2022 - Quickwit Takeover (in London on 30th May 2022)
- WebAssembly for Java Developers (Online Meetup on 8th June 2022)
- Gravitee APIM Behind Istio Service Mesh (SkillsCast recorded in May 2022)
- Enabling Microservice Success (SkillsCast recorded in May 2022)
Staging reactive data pipelines using Kafka as the backbone
Jaakko Pallari
I work as a software engineer at Cake Solutions Ltd. I have a passion for robust systems, functional programming, and free and open source software. I started my career working as a web developer, and these days I'm responsible for developing backend solutions for global IoT platforms using Scala and the SMACK (Spark, Mesos, Akka, Cassandra, and Kafka) stack.