Sustainability Supporting Data Variability: Keeping Core Components Clean while Dealing with Data Variability

A SkillsCast for this session is not available.

A big challenge in building complex, data-intensive systems is how to sustainably support data variation along with schema and feature evolution. This talk examines strategies, practices, and patterns drawn from real experiences that support new and evolving data-processing requirements while keeping the core architecture clean. As complex systems evolve to meet varying data formats, they can devolve into poorly architected Big Balls of Mud filled with special-case logic and one-off processing. Alternatively, you can isolate core components of your system and protect them from entanglements and unnecessary complexity by designing them to operate on common data formats while providing extension mechanisms that enable processing variations.

YOU MAY ALSO LIKE:

• The Science of Queues: Performance Monitoring for Themes Parks and Distributed Systems (SkillsCast recorded in December 2020)
• Solving Problems like a Game Designer (SkillsCast recorded in December 2020)