Big Data Technologies

  1. Core Principles of Distributed Systems
    1. Distributed Computing Fundamentals
      1. Scalability
        1. Horizontal Scaling
          1. Adding More Nodes
            1. Load Balancing
              1. Elastic Scaling
              2. Vertical Scaling
                1. Increasing Node Resources
                  1. Limitations of Vertical Scaling
                    1. Cost Considerations
                  2. Parallelism
                    1. Task Parallelism
                      1. Data Parallelism
                        1. Pipeline Parallelism
                          1. Embarrassingly Parallel Problems
                          2. Fault Tolerance and Redundancy
                            1. Replication
                              1. Checkpointing
                                1. Failover Mechanisms
                                  1. Recovery Strategies
                                    1. Byzantine Fault Tolerance
                                  2. Key Architectural Concepts
                                    1. Shared-Nothing Architecture
                                      1. Independence of Nodes
                                        1. Data Locality
                                          1. Communication Patterns
                                          2. Commodity Hardware Clusters
                                            1. Cost Advantages
                                              1. Failure Rates and Management
                                                1. Hardware Heterogeneity
                                                2. Master-Slave Architecture
                                                  1. Coordination Patterns
                                                    1. Single Point of Failure Mitigation
                                                    2. Peer-to-Peer Architecture
                                                      1. Decentralized Control
                                                        1. Self-Organization
                                                      2. The CAP Theorem
                                                        1. Consistency
                                                          1. Strong Consistency
                                                            1. Eventual Consistency
                                                              1. Weak Consistency
                                                                1. Causal Consistency
                                                                2. Availability
                                                                  1. System Uptime
                                                                    1. Service Guarantees
                                                                      1. Graceful Degradation
                                                                      2. Partition Tolerance
                                                                        1. Network Partitions
                                                                          1. Trade-offs in Distributed Systems
                                                                            1. Split-Brain Scenarios
                                                                          2. Data Partitioning and Sharding
                                                                            1. Partitioning Strategies
                                                                              1. Range Partitioning
                                                                                1. Hash Partitioning
                                                                                  1. List Partitioning
                                                                                    1. Composite Partitioning
                                                                                    2. Shard Rebalancing
                                                                                      1. Dynamic Rebalancing
                                                                                        1. Consistent Hashing
                                                                                        2. Hotspot Management
                                                                                          1. Load Distribution
                                                                                            1. Shard Splitting
                                                                                          2. Data Replication Strategies
                                                                                            1. Synchronous Replication
                                                                                              1. Asynchronous Replication
                                                                                                1. Quorum-Based Replication
                                                                                                  1. Multi-Master Replication
                                                                                                    1. Chain Replication
                                                                                                    2. Consensus Algorithms
                                                                                                      1. Raft Algorithm
                                                                                                        1. Paxos Algorithm
                                                                                                          1. Byzantine Agreement

                                                                                                        Previous

                                                                                                        1. Introduction to Big Data

                                                                                                        Go to top

                                                                                                        Next

                                                                                                        3. The Hadoop Ecosystem