Designing with Delta Lake and Spark
Piethein Strengholt

#Data_Architecture
#Delta_Lake
#Spark
#Medallion
To deliver the insights that give them a competitive advantage, organizations increasingly turn to the proven Medallion architecture. Yet implementing a robust data architecture can be difficult, particularly when it comes to using the Medallion architecture's Bronze, Silver, and Gold layers—done wrong, it can hamper your ability to make data-driven decisions. This practical guide helps you build a Medallion architecture the right way with Azure Databricks and Microsoft Fabric.
Drawing on hands-on experience from the field, Piethein Strengholt demystifies common assumptions and complex problems you'll face when embarking on a new data architecture. Architects and engineers of all stripes will find answers to the most typical questions along with insights from real organizations about what's worked, what hasn't, and why.
You'll learn:
Table of Contents
Part I. Understanding the Medallion Framework
Chapter 1. The Evolution of Data Architecture
Chapter 2. Laying the Groundwork
Chapter 3. Demystifying the Medallion Architecture
Part II. Crafting the Medallion Layers
Chapter 4. Building a Medallion Foundation with Microsoft Fabric
Chapter 5. Construct the Bronze Layer
Chapter 6. Build the Silver Layer
Chapter 7. Streamline the Gold Layer
Part Ill. Real-World Case Studies
Chapter 8. Case Study: Data, Analytics and Business Strategy at AP Pension
Chapter 9. Case Study: Amadeus, a Tech Leader in the Travel Industry
Chapter 10. Case Study: Strategic Data Transformation at ZEISS
Part IV. Scaling, Governance, and the Future of Medallion Architectures
Chapter 11. Scaling the Medallion Architecture
Chapter 12. Medallion Governance and Security
Chapter 13. Future Medallion Architectures with Generative Al
Piethein Strengholt is the chief data officer for Microsoft Netherlands. He acts as a counterpart to CDOs and is a driving force in the community and the product group. Piethein is also a prolific blogger and regularly speaks about the latest trends in data management, including the data mesh concept, data governance, and strategy at scale.









