Optimization Theory

  1. Heuristic and Metaheuristic Methods
    1. Local Search Algorithms
      1. Hill Climbing
        1. Steepest Ascent
          1. First Improvement
            1. Random Restart
            2. Simulated Annealing
              1. Cooling Schedules
                1. Acceptance Probability
                  1. Parameter Tuning
                  2. Tabu Search
                    1. Tabu List Management
                      1. Aspiration Criteria
                        1. Intensification and Diversification
                      2. Population-Based Metaheuristics
                        1. Genetic Algorithms
                          1. Representation and Encoding
                            1. Selection Mechanisms
                              1. Tournament Selection
                                1. Roulette Wheel Selection
                                  1. Rank-Based Selection
                                  2. Crossover Operators
                                    1. Single-Point Crossover
                                      1. Multi-Point Crossover
                                        1. Uniform Crossover
                                        2. Mutation Operators
                                          1. Replacement Strategies
                                          2. Evolution Strategies
                                            1. (μ + λ) and (μ, λ) Strategies
                                              1. Self-Adaptation
                                                1. Covariance Matrix Adaptation
                                                2. Particle Swarm Optimization
                                                  1. Velocity and Position Updates
                                                    1. Inertia Weight
                                                      1. Acceleration Coefficients
                                                        1. Topology and Neighborhoods
                                                        2. Ant Colony Optimization
                                                          1. Pheromone Trail Updates
                                                            1. Heuristic Information
                                                              1. Ant System Variants
                                                              2. Differential Evolution
                                                                1. Mutation and Crossover
                                                                  1. Parameter Control
                                                                2. Hybrid Approaches
                                                                  1. Memetic Algorithms
                                                                    1. Matheuristics
                                                                      1. Variable Neighborhood Descent
                                                                      2. Performance Analysis
                                                                        1. Convergence Properties
                                                                          1. Parameter Sensitivity
                                                                            1. Benchmarking and Comparison
                                                                              1. No Free Lunch Theorems

                                                                            Previous

                                                                            9. Stochastic Optimization

                                                                            Go to top

                                                                            Next

                                                                            11. Multi-Objective Optimization