Compression, Dedupe, Encryption, Conundrums in Cloud

This SkillsCast is currently only available to registered attendees of Software Architecture Gathering Digital 2021

It will be freely available to all Skills Matter members once the Software Architecture Gathering Digital 2021 early-access window expires on January 14, 2022.

Cloud storage footprint is in exabytes and exponentially growing and companies pay billions of dollars to store and retrieve data. In this talk, we will cover some of the space and time optimizations, which have historically been applied to on-premise file storage, and how they would be applied to objects stored in Cloud. Deduplication and compression are techniques that have been traditionally used to reduce the amount of storage used by applications. Data encryption is table stakes for any remote storage offering and today, we have client-side and server-side encryption support by Cloudproviders. Combining compression, encryption, and deduplication for object stores in Cloud is challenging due to the nature of overwrites and versioning, but the right strategy can save millions for an organization. We will cover some strategies for employing these techniques depending on whether an organization prefers client side or server side encryption, and discuss online and offline deduplication of objects. Companies such as Box, and Netflix, employ a subset of these techniques to reduce their cloud footprint and provide agility in their cloud operations.

YOU MAY ALSO LIKE:

• Deploying Microservices and Traditional Applications with Kubernetes (with Jérôme Petazzoni) (Online Course on 28th March - 1st April 2022)
• How to end-to-end encrypt all application layer communication - with Ockam (SkillsCast recorded in October 2021)
• Understanding Microservices: A Guide for the Monolithic Developer (SkillsCast recorded in October 2021)