Operations Research and Optimization

  1. Nonlinear Programming
    1. Introduction to Nonlinear Programming
      1. Nonlinear Objective Functions
        1. Nonlinear Constraints
          1. Local versus Global Optima
            1. Computational Challenges
            2. Convexity in Optimization
              1. Convex Sets
                1. Definition and Properties
                  1. Convex Hull
                    1. Extreme Points
                    2. Convex Functions
                      1. Definition and Properties
                        1. First-Order Conditions
                          1. Second-Order Conditions
                            1. Operations Preserving Convexity
                            2. Importance of Convexity
                              1. Global Optimality
                                1. Algorithmic Advantages
                                  1. Duality Theory
                                2. Unconstrained Optimization
                                  1. Optimality Conditions
                                    1. First-Order Necessary Conditions
                                      1. Second-Order Conditions
                                        1. Global Optimality
                                        2. Line Search Methods
                                          1. Exact Line Search
                                            1. Inexact Line Search
                                              1. Armijo Rule
                                                1. Wolfe Conditions
                                                2. Gradient-Based Methods
                                                  1. Steepest Descent Method
                                                    1. Convergence Properties
                                                      1. Step Size Selection
                                                      2. Newton's Method
                                                        1. Newton Direction
                                                          1. Hessian Matrix Requirements
                                                            1. Convergence Rate
                                                              1. Modified Newton Methods
                                                              2. Quasi-Newton Methods
                                                                1. BFGS Method
                                                                  1. DFP Method
                                                                    1. Secant Conditions
                                                                      1. Hessian Approximations
                                                                      2. Conjugate Gradient Methods
                                                                        1. Conjugate Directions
                                                                          1. Fletcher-Reeves Method
                                                                            1. Polak-Ribiere Method
                                                                          2. Constrained Optimization
                                                                            1. Optimality Conditions
                                                                              1. Lagrange Multiplier Method
                                                                                1. Karush-Kuhn-Tucker Conditions
                                                                                  1. Constraint Qualifications
                                                                                    1. Second-Order Conditions
                                                                                    2. Penalty Methods
                                                                                      1. Exterior Penalty Functions
                                                                                        1. Interior Penalty Functions
                                                                                          1. Barrier Methods
                                                                                            1. Exact Penalty Functions
                                                                                            2. Lagrangian Methods
                                                                                              1. Augmented Lagrangian
                                                                                                1. Method of Multipliers
                                                                                                  1. Dual Ascent
                                                                                                  2. Sequential Quadratic Programming
                                                                                                    1. QP Subproblems
                                                                                                      1. Merit Functions
                                                                                                        1. Trust Region Methods
                                                                                                        2. Active Set Methods
                                                                                                          1. Working Set Strategy
                                                                                                            1. Constraint Addition and Deletion
                                                                                                              1. Degeneracy Handling
                                                                                                            2. Special Classes of Nonlinear Programs
                                                                                                              1. Quadratic Programming
                                                                                                                1. Convex Quadratic Programs
                                                                                                                  1. Active Set Methods
                                                                                                                    1. Interior Point Methods
                                                                                                                    2. Geometric Programming
                                                                                                                      1. Posynomial Functions
                                                                                                                        1. Dual Problem
                                                                                                                          1. Signomial Programs
                                                                                                                          2. Separable Programming
                                                                                                                            1. Piecewise Linear Approximation
                                                                                                                              1. Special Ordered Sets
                                                                                                                              2. Fractional Programming
                                                                                                                                1. Linear Fractional Programming
                                                                                                                                  1. Dinkelbach's Algorithm

                                                                                                                              Previous

                                                                                                                              5. Integer Programming

                                                                                                                              Go to top

                                                                                                                              Next

                                                                                                                              7. Dynamic Programming