It's time to face the fact that Data Warehouses, as we know them, are changing. The increasing power of automatically scaling systems and the rapidly dropping cost of storage are challenging how we decide which data to keep and how we push it out to those who need it. In this session we'll run through the architecture of the modern warehouse, from our structured/unstructured Azure Data Lake architecture to our platform as a service Azure Data Warehouse and the various tools bringing the two together. Expect a general overview of these new Azure components, a little BI theory and practical demonstrations of setting up Data Lake, writing U-SQL, linking up Data Warehouse and exposing data to users, all from the ground up (demo gods permitting)
YOU MAY ALSO LIKE:
- Security in the Age of Big Data (Data Anonymisation & Encryption) (in London on 21st October 2019)
- IWDS 26: Evaluating and improving our Data Science models (in London on 21st October 2019)
- Automating Elaborate-Transform-Load for Busy Data Scientists (SkillsCast recorded in October 2019)
- Apache Druid: the fast, real-time, open-source analytics data store (SkillsCast recorded in September 2019)
Warehouse of the Future: Lakes Vs Marts
Principal BI Consultant with Adatis. Simon has been working with the Microsoft BI Stack for a decade, starting off building traditional warehouses with SSIS and SSAS but bringing in alternative technologies where needed. Simon is a strong advocate of the use of modern development practices in the SQL World (we actually are developers, whether we like it or not). Most recently, he has turned his head to the clouds, advocating new methods of getting insight to the right people. Whether it's getting to grips with Data Lakes, to shifting your current SSIS packages into the cloud, hopefully he can help.