i

Hadoop Tutorial

Node Manager

  • In a Hadoop cluster, it takes care of individual nodes and handles user jobs and workflows on the specified node.

  • It registers with the Resource Manager and then sends heartbeats with the health status of the node.

  • The primary objective is to handle application containers assigned to it by the resource manager.

  • This keeps the Resource Manager up-to-date.

  • Application Master requests the Node Manager's allocated container by sending it a Container Launch Context (CLC) which includes all the application that needs to be run. The Node Manager creates and starts the process of the requested container.

  • Monitor the use of the resources (memory, CPU) of each container.

  • Performs Log management.

  • It also destroys the resource manager's container as directed.