Concurrent and Parallel Programming

  1. Parallel Programming Patterns and Algorithms
    1. Embarrassingly Parallel Problems
      1. Definition and Characteristics
        1. Examples and Applications
        2. Master/Worker Pattern
          1. Master Process Coordination
            1. Worker Process Execution
              1. Load Balancing Strategies
              2. Fork/Join Pattern
                1. Recursive Task Splitting
                  1. Task Joining
                    1. Result Aggregation
                      1. Work Stealing in Fork/Join Frameworks
                      2. MapReduce Pattern
                        1. Map Phase
                          1. Data Partitioning
                            1. Parallel Mapping
                            2. Shuffle Phase
                              1. Data Redistribution
                              2. Reduce Phase
                                1. Aggregation
                                  1. Result Computation
                                  2. Fault Tolerance in MapReduce
                                  3. Parallel Sorting Algorithms
                                    1. Parallel Merge Sort
                                      1. Parallel Quicksort
                                        1. Bitonic Sort
                                          1. Performance Considerations in Parallel Sorting
                                          2. Parallel Search Algorithms
                                            1. Search in Distributed Systems
                                            2. Parallel Graph Algorithms
                                              1. Parallel Shortest Path Algorithms

                                            Previous

                                            5. Parallel Programming Concepts

                                            Go to top

                                            Next

                                            7. Advanced Topics