The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system.

Summary

The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system.

About the technology

Microsoft Azure provides dozens of services that simplify storing and processing data. These services are secure, reliable, scalable, and cost efficient.

About the book

Azure Storage, Streaming, and Batch Analytics shows you how to build state-of-the-art data solutions with tools from the Microsoft Azure platform. Read along to construct a cloud-native data warehouse, adding features like real-time data processing. Based on the Lambda architecture for big data, the design uses scalable services such as Event Hubs, Stream Analytics, and SQL databases. Along the way, you’ll cover most of the topics needed to earn an Azure data engineering certification.

What's inside

• Configuring Azure services for speed and cost
• Constructing data pipelines with Data Factory
• Choosing the right data storage methods

About the reader

For readers familiar with database management. Examples in C# and PowerShell.

About the author

Richard Nuckolls is a senior developer building big data analytics and reporting systems in Azure.

Table of Contents

1 What is data engineering?

2 Building an analytics system in Azure

3 General storage with Azure Storage accounts

4 Azure Data Lake Storage

5 Message handling with Event Hubs

6 Real-time queries with Azure Stream Analytics

7 Batch queries with Azure Data Lake Analytics

8 U-SQL for complex analytics

9 Integrating with Azure Data Lake Analytics

10 Service integration with Azure Data Factory

11 Managed SQL with Azure SQL Database

12 Integrating Data Factory with SQL Database

13 Where to go next

Review

"A detailed tour through Azure's capabilities. A must-read for anyone looking to use Azure for data engineering."

--Mike Fowler, Claranet

"If you have any questions about storage, streaming, or batch analytics with Azure, you won't after reading this book."--Taylor Dolezal, HashiCorp

"An excellent reference for anyone using Azure for analytics."

--Srihari Sridharan, AthenaHealth

"If you are implementing data solutions on Azure, this is the book you need."

--Pablo Acuña, Accenture

About the Author

Richard Nuckolls is a Microsoft Certified Solution Developer and Azure enthusiast. During his 20 years of experience, he's done server and database administration, desktop and web development, and more recently has led teams in building production content management systems and web-scale analytics systems in Azure.