Learning to build distributed systems is hard, especially if they are large scale. It's not that there is a lack of information out there. You can find academic papers, engineering blogs, and even books on the subject. The problem is that the available information is spread out all over the place, and if you were to put it on a spectrum from theory to practice, you would find a lot of material at the two ends but not much in the middle.

That is why I decided to write a book that brings together the core theoretical and practical concepts of distributed systems so that you don't have to spend hours connecting the dots. This book will guide you through the fundamentals of large-scale distributed systems, with just enough details and external references to dive deeper. This is the guide I wished existed when I first started out, based on my experience building large distributed systems that scale to millions of requests per second and billions of devices.

If you are a developer working on the backend of web or mobile applications (or would like to be!), this book is for you. When building distributed applications, you need to be familiar with the network stack, data consistency models, scalability and reliability patterns, observability best practices, and much more. Although you can build applications without knowing much of that, you will end up spending hours debugging and re-architecting them, learning hard lessons that you could have acquired in a much faster and less painful way.

However, if you have several years of experience designing and building highly available and fault-tolerant applications that scale to millions of users, this book might not be for you. As an expert, you are likely looking for depth rather than breadth, and this book focuses more on the latter since it would be impossible to cover the field otherwise.

The second edition is a complete rewrite of the previous edition. Every page of the first edition has been reviewed and where appropriate reworked, with new topics covered for the first time.

Review

"The book brings together theory and real world practice by discussing how large scale applications are built from the ground up. Although I was familiar with some of the content, it's the first time I have seen it woven so well together into a coherent story. If you have to read one book about the topic, start with this one!"

-- Mauro Doglio, Software Engineer at Microsoft

"Fantastic guidebook! Makes sense of a complex subject. Thoroughly explains key concepts with great illustrations. Shows how to design, build, and operate distributed applications. It addresses important topics such as communication, security, coordination, time, consistency, transactions, scalability, partitioning, caching, failures, circuit breakers, load balancing, operations, and monitoring. This book puts it all together, and provides a solid architectural reference source." 

-- Doug Warren, Technical Editor at Reedsy

"This interesting book mixes together academic concepts with real life experience in building distributed systems at scale. Such systems present many challenges, and the book will have you tackle some of the most important ones: load balancing compute nodes, distributed data access and synchronization, resiliency mechanisms, and many more."

-- Vamis Xhagjika, Senior Engineering Manager at Vonage

From the Author

The digital version (PDF and EPUB) is available from the book's homepage at understandingdistributed.systems/