A comprehensive, hands-on guide to install, administer, and configure settings in YARN
If you have a working knowledge of Hadoop 1.x but want to start afresh with YARN, this book is ideal for you. You will be able to install and administer a YARN cluster and also discover the configuration settings to fine-tune your cluster both in terms of performance and scalability. This book will help you develop, deploy, and run multiple applications/frameworks on the same shared YARN cluster.
YARN is the next generation generic resource platform used to manage resources in a typical cluster and is designed to support multitenancy in its core architecture. As optimal resource utilization is central to the design of YARN, learning how to fully utilize the available fine-grained resources (RAM, CPU cycles, and so on) in the cluster becomes vital.
This book is an easy-to-follow, self-learning guide to help you start working with YARN. Beginning with an overview of YARN and Hadoop, you will dive into the pitfalls of Hadoop 1.x and how YARN takes us to the next level. You will learn the concepts, terminology, architecture, core components, and key interactions, and cover the installation and administration of a YARN cluster as well as learning about YARN application development with new and emerging data processing frameworks.
Chapter 1. Need for YARN
Chapter 2. YARN Architecture
Chapter 3. YARN Installation
Chapter 4. YARN and Hadoop Ecosystems
Chapter 5. YARN Administration
Chapter 6. Developing and Running a Simple YARN Application
Chapter 7. YARN Frameworks
Chapter 8. Failures in YARN
Chapter 9. YARN – Alternative Solutions
Chapter 10. YARN – Future and Support