کتاب The Hundred-Page Language Models Book راهنمایی فشرده برای درک و پیاده‌سازی مدل‌های زبانی مدرن است. این کتاب مباحثی چون اصول یادگیری ماشین، مدل‌های زبانی کلاسیک و مدرن، پیاده‌سازی RNN و Transformer با PyTorch، و مهارت‌هایی مانند تنظیم دقیق (fine-tuning) و مهندسی پرامپت را پوشش می‌دهد. مطالب با ریاضیات شهودی، کدهای عملی در Google Colab و مثال‌های تصویری ارائه شده‌اند. مناسب برای توسعه‌دهندگان و دانشمندان داده با تجربه برنامه‌نویسی در پایتون.

محتوای کتاب:

• مفاهیم پایه‌ای یادگیری ماشین و شبکه‌های عصبی
• روش‌های نمایش متن و مدل‌سازی زبانی پایه
• پیاده‌سازی RNN و معماری Transformer با PyTorch
• راهنمای عملی برای تنظیم دقیق مدل‌های زبانی و مهندسی پرامپت
• بررسی خطاهای مدل (مانند توهمات) و روش‌های ارزیابی آن‌ها
• منابع تکمیلی برای موضوعات پیشرفته از طریق book's wiki

آندری بورکوف (Andriy Burkov) متخصص یادگیری ماشین و هوش مصنوعی است. او نویسنده‌ی کتاب‌های محبوب The Hundred-Page Machine Learning Book و The Hundred-Page Language Models Book است. آندری با سابقه‌ای قوی در صنعت و پژوهش، در زمینه‌ی مدل‌های یادگیری عمیق و کاربردهای هوش مصنوعی تجربه دارد. او دانش فنی را با زبانی ساده و کاربردی ارائه می‌دهد و آثارش مورد تأیید متخصصان برجسته‌ی حوزه‌ی AI قرار گرفته است.

Master language models through mathematics, illustrations, and code―and build your own from scratch!

The Hundred-Page Language Models Book by Andriy Burkov, the follow-up to his bestselling The Hundred-Page Machine Learning Book (now in 12 languages), offers a concise yet thorough journey from language modeling fundamentals to the cutting edge of modern Large Language Models (LLMs). Within Andriy's famous "hundred-page" format, readers will master both theoretical concepts and practical implementations, making it an invaluable resource for developers, data scientists, and machine learning engineers.

The Hundred-Page Language Models Book allows you to:

- Master the mathematical foundations of modern machine learning and neural networks

- Build and train three architectures of language models in Python

- Understand and code a Transformer language model from scratch in PyTorch

- Work with LLMs, including instruction finetuning and prompt engineering

Written in a hands-on style with working Python code examples, this book progressively builds your understanding from basic machine learning concepts to advanced language model architectures. All code examples run on Google Colab, making it accessible to anyone with a modern laptop.

About the technology

Language models have evolved from simple n-gram statistics to become one of the most transformative technologies in AI, rivaling only personal computers in their impact. This book spans the complete evolution—from count-based methods to modern Transformer architectures—delivering a thorough understanding of both how these models work and how to implement them.

About the book

The Hundred-Page Language Models Book takes a unique approach by introducing language modeling concepts gradually, starting with foundational methods before advancing to modern architectures. Each chapter builds upon the previous one, making complex concepts accessible through clear explanations, diagrams, and practical implementations.

What's inside

• Essential machine learning and neural network fundamentals
• Text representation techniques and basic language modeling
• Implementation of RNNs and Transformer architectures with PyTorch
• Practical guidance on finetuning language models and prompt engineering
• Important considerations on hallucinations and ways to evaluate models
• Additional resources for advanced topics through the book's wiki

The complete code and additional resources are available through the book's website at thelmbook.com/wiki.

Table of Contents

Chapter 1. Machine Learning Basics

Chapter 2. Language Modeling Basics

Chapter 3. Recurrent Neural Network

Chapter 4. Transformer

Chapter 5. Large Language Model

Chapter 6. Further Reading

About the reader

Readers should have programming experience in Python. While familiarity with PyTorch and tensors is helpful, it's not required. College-level math knowledge is beneficial, but the book presents mathematical concepts intuitively with clear examples and diagrams.

Endorsements from tech and AI leaders

Vint Cerf, Internet pioneer and Turing Award recipient: "This book cleared up a lot of conceptual confusion for me about how Machine Learning actually works - it is a gem of clarity."

Tomáš Mikolov, the author of word2vec and FastText: "The book is a good start for anyone new to language modeling who aspires to improve on state of the art."

Florian Douetteau, co-founder and CEO at Dataiku: "Andriy paints for us, in 100 marvelous strokes, the journey from linear algebra basics to the implementation of transformers."

Jerry Liu, co-founder and CEO at LlamaIndex: "This is one of the most comprehensive yet concise handbooks out there for truly understanding how LLMs work under the hood."

More endorsements from AI leaders on thelmbook.com.

About the Author

Andriy Burkov holds a Ph.D. in Artificial Intelligence and is a recognized expert in machine learning and natural language processing. As a machine learning expert and leader, Andriy has successfully led dozens of production-grade AI projects in different business domains at Fujitsu and Gartner. His previous books have been translated into a dozen languages and are used as textbooks in many universities worldwide. His work has impacted millions of machine learning practitioners and researchers worldwide.