How to Scale Your Model: A Systems View of LLMs on TPUs
Overview & Synopsis
This book takes a very practical, systems-oriented approach to explain the performance side of Large Language Models (LLMs) like how Tensor Processing Units (TPUs) (and GPUs) work under the hood, how these devices communicate, and how LLMs actually run on real hardware. It also covers parallelism strategies for both training and inference to efficiently scale models at massive sizes.
Indexed from repository: FreeComputerBooks.com
(
freecomputerbooks.com)
Document Information
| Document Title | How to Scale Your Model: A Systems View of LLMs on TPUs |
|---|---|
| Author / Organization | Jacob Austin, et al. |
| Subject & Discipline | Natural Language Processing (NLP), Computational Linguistics, Machine Learning, Deep Learning and Neural Networks, Artificial Intelligence |
| Categories | Natural Language Processing (NLP) |
| Resource Verification | External Reading Page / Repository |
| Alternative Mirrors & Links | |
| Original Host Website |
FreeComputerBooks.com
(freecomputerbooks.com)
|
| File Format | application/pdf (Portable Document Format) |
| Language | ENGLISH |
| Catalog ID | DOC-108451 |
| Original Source Link | Visit Source Page on freecomputerbooks.com » |