Xvakdgmxgfdvoadditmw
SkillsCast

The Agile Data Warehouse - Beginners

6th July 2017 in London at CodeNode

There are 42 other SkillsCasts available from Infiniteconf 2017 - the conference on Big Data and Fast Data

Please log in to watch this conference skillscast.

Https s3.amazonaws.com prod.tracker2 resource 41088130 skillsmatter conference skillscast o9nohu

How can a small team with a limited budget enable the analysis of large volumes of data in a world of constantly changing requirements?

Lindsey and Phil will share with you how the Guardian has used a range of technologies including Apache Spark and PrestoDB on AWS to support simple ingestion and fast querying of a wide range of datasets. Learn why it’s important to decouple storage from compute and raw data sources from optimised query formats and why there’s still no single perfect solution.

YOU MAY ALSO LIKE:

Thanks to our sponsors

The Agile Data Warehouse - Beginners

Philip Wills

Phil is a Senior Developer Manager at the Guardian.

Lindsey Dew

Lindsey is a Data Engineer working at Deliveroo and is passionate about developing processes and systems to drive data-driven decisions across an organisation. She previously worked on the data technology team at the Guardian.

SkillsCast

Please log in to watch this conference skillscast.

Https s3.amazonaws.com prod.tracker2 resource 41088130 skillsmatter conference skillscast o9nohu

How can a small team with a limited budget enable the analysis of large volumes of data in a world of constantly changing requirements?

Lindsey and Phil will share with you how the Guardian has used a range of technologies including Apache Spark and PrestoDB on AWS to support simple ingestion and fast querying of a wide range of datasets. Learn why it’s important to decouple storage from compute and raw data sources from optimised query formats and why there’s still no single perfect solution.

YOU MAY ALSO LIKE:

Thanks to our sponsors

About the Speakers

The Agile Data Warehouse - Beginners

Philip Wills

Phil is a Senior Developer Manager at the Guardian.

Lindsey Dew

Lindsey is a Data Engineer working at Deliveroo and is passionate about developing processes and systems to drive data-driven decisions across an organisation. She previously worked on the data technology team at the Guardian.