Hadoop YARN "Hello World" application on your own Hadoop cluster
Practical guide of how Hadoop YARN works
Step-by-step learn the fundamental components of YARN architecture (using YARN "Hello World" application with Hadjo)
YARN "Hello World" application - the point where you kick start your own development...
There is an abundance of information on the internet about how Yarn works and its architecture. But you browse, you read and finally get sick of it. Why? Because it is mainly theoretical, a lot of entities are described and as a result you feel that something is missing to put the pieces together. After this step by step tutorial you will get a fundamental understanding of YARN architecture and be introduced how to develop your own YARN application. Steps of the tutorial:
- Run a cluster of 3 nodes - 1 master and 2 slaves (a few mouse clicks) - in Part I
- Execute the provided "Hello World" YARN application on the Hadoop cluster (a few mouse clicks). The business code prints "Hello World!" in the console - Part I
- Get introduced to the main components of YARN - for better understanding we shall use "Hello World" you will have executed - in Part II:
- ResourceManager - what it is in general and its role during the execution of "Hello World" YARN application
- NodeManager - what it is in general and its role during the execution of "Hello World" YARN application
- ApplicationMaster - what it is in general and its role during the execution of "Hello World" YARN application
- Container - what it is in general and its role during the execution of "Hello World" YARN application
- Get to know YARN "Hello World" application - a skeleton and starting point for your own YARN application development