Apache Hadoop

  1. Yet Another Resource Negotiator (YARN)
    1. YARN Architecture
      1. ResourceManager
        1. Global Resource Management
          1. Scheduler Component
            1. ApplicationsManager Component
              1. Resource Allocation Policies
              2. NodeManager
                1. Per-Node Resource Management
                  1. Container Lifecycle Management
                    1. Resource Monitoring
                      1. Health Checking
                      2. ApplicationMaster
                        1. Per-Application Coordination
                          1. Resource Negotiation
                            1. Task Management
                              1. Progress Tracking
                              2. Container Concept
                                1. Resource Isolation
                                  1. Execution Environment
                                    1. Resource Allocation Unit
                                  2. YARN Job Execution
                                    1. Application Submission
                                      1. Client Interaction
                                        1. Application Registration
                                          1. Resource Requirements
                                          2. Resource Allocation Process
                                            1. Resource Request Handling
                                              1. Container Assignment
                                                1. Resource Negotiation
                                                2. Application Execution
                                                  1. Container Launch
                                                    1. Task Scheduling
                                                      1. Progress Monitoring
                                                      2. Job Completion
                                                        1. Status Reporting
                                                          1. Resource Cleanup
                                                            1. Application Termination
                                                          2. YARN Scheduling
                                                            1. FIFO Scheduler
                                                              1. First-In-First-Out Policy
                                                                1. Simple Queue Management
                                                                2. Capacity Scheduler
                                                                  1. Hierarchical Queues
                                                                    1. Resource Partitioning
                                                                      1. Multi-Tenancy Support
                                                                        1. Queue Configuration
                                                                        2. Fair Scheduler
                                                                          1. Fair Share Calculation
                                                                            1. Resource Preemption
                                                                              1. Dynamic Resource Allocation
                                                                            2. YARN Benefits
                                                                              1. Resource Management Decoupling
                                                                                1. Multi-Framework Support
                                                                                  1. Improved Scalability
                                                                                    1. Better Resource Utilization

                                                                                  Previous

                                                                                  3. Hadoop Distributed File System (HDFS)

                                                                                  Go to top

                                                                                  Next

                                                                                  5. MapReduce Programming Model