Mathematical optimization

Simulation-based optimization

Simulation-based optimization (also known as simply simulation optimization) integrates optimization techniques into simulation modeling and analysis. Because of the complexity of the simulation, the objective function may become difficult and expensive to evaluate. Usually, the underlying simulation model is stochastic, so that the objective function must be estimated using statistical estimation techniques (called output analysis in simulation methodology). Once a system is mathematically modeled, computer-based simulations provide information about its behavior. Parametric simulation methods can be used to improve the performance of a system. In this method, the input of each variable is varied with other parameters remaining constant and the effect on the design objective is observed. This is a time-consuming method and improves the performance partially. To obtain the optimal solution with minimum computation and time, the problem is solved iteratively where in each iteration the solution moves closer to the optimum solution. Such methods are known as ‘numerical optimization’ or ‘simulation-based optimization’. In simulation experiment, the goal is to evaluate the effect of different values of input variables on a system. However, the interest is sometimes in finding the optimal value for input variables in terms of the system outcomes. One way could be running simulation experiments for all possible input variables. However, this approach is not always practical due to several possible situations and it just makes it intractable to run experiments for each scenario. For example, there might be too many possible values for input variables, or the simulation model might be too complicated and expensive to run for suboptimal input variable values. In these cases, the goal is to find optimal values for the input variables rather than trying all possible values. This process is called simulation optimization. Specific simulation–based optimization methods can be chosen according to Figure 1 based on the decision variable types. Optimization exists in two main branches of operations research: Optimization parametric (static) – The objective is to find the values of the parameters, which are “static” for all states, with the goal of maximizing or minimizing a function. In this case, one can use mathematical programming, such as linear programming. In this scenario, simulation helps when the parameters contain noise or the evaluation of the problem would demand excessive computer time, due to its complexity. Optimization control (dynamic) – This is used largely in computer science and electrical engineering. The optimal control is per state and the results change in each of them. One can use mathematical programming, as well as dynamic programming. In this scenario, simulation can generate random samples and solve complex and large-scale problems. (Wikipedia).

Simulation-based optimization
Video thumbnail

13_2 Optimization with Constraints

Here we use optimization with constraints put on a function whose minima or maxima we are seeking. This has practical value as can be seen by the examples used.

From playlist Advanced Calculus / Multivariable Calculus

Video thumbnail

Introduction to Optimization

A very basic overview of optimization, why it's important, the role of modeling, and the basic anatomy of an optimization project.

From playlist Optimization

Video thumbnail

Simulation: The Challenge for Data Science

While machine learning has recently had dramatic successes, there is a large class of problems that it will never be able to address on its own. To test a policy proposal, for example, often requires understanding a counterfactual scenario that has never existed in the past, and that may

From playlist Turing Seminars

Video thumbnail

Discrete multi-fidelity optimization

This video is #9 in the Adaptive Experimentation series presented at the 18th IEEE Conference on eScience in Salt Lake City, UT (October 10-14, 2022). In this video, Sterling Baird @sterling-baird presents on discrete multi-fidelity optimization. In discrete multi-fidelity optimization, t

From playlist Optimization tutorial

Video thumbnail

Machine Learning for Computational Fluid Dynamics

Machine learning is rapidly becoming a core technology for scientific computing, with numerous opportunities to advance the field of computational fluid dynamics. This paper highlights some of the areas of highest potential impact, including to accelerate direct numerical simulations, to i

From playlist Data Driven Fluid Dynamics

Video thumbnail

Towards a Model-Based Approach | Systems Engineering, Part 2

See all the videos in this playlist: https://www.youtube.com/playlist?list=PLn8PRpmsu08owzDpgnQr7vo2O-FUQm_fL The role of systems engineering is to help find and maintain a balance between the stakeholder needs, the management needs, and the engineering needs of a project. So we can thin

From playlist Systems Engineering

Video thumbnail

Segev Wasserkug - Democratizing Optimization Modeling: Status, Challenges, and Future Directions

Recorded 28 February 2023. Segev Wasserkug of IBM Research, Israel, presents "Democratizing Optimization Modeling: Status, Challenges, and Future Directions" at IPAM's Artificial Intelligence and Discrete Optimization Workshop. Note: IBM does not endorse any third parties referenced in the

From playlist 2023 Artificial Intelligence and Discrete Optimization

Video thumbnail

Continuous multi-fidelity optimization

This video is #8 in the Adaptive Experimentation series presented at the 18th IEEE Conference on eScience in Salt Lake City, UT (October 10-14, 2022). In this video, Sterling Baird @sterling-baird presents on continuous multifidelity optimization. Continuous multi-fidelity optimization is

From playlist Optimization tutorial

Video thumbnail

A solar system, a simulation made with Excel

An Excel simulation of the solar system. You can see how things are recursively computed: the mutual gravity force from the locations, the accelerations, the velocities, and finally the updated locations. The solar eclipse is also shown. This is clip is intended to illustrate Chapter 24 Ap

From playlist Physics simulations

Video thumbnail

RubyConf 2022: Simulated Annealing: The Most Metal Algorithm Ever 🤘 by Chris Bloom

Simulated annealing is a fascinating algorithm that's designed to help find a particular type of solution (near-optimal, aka "good enough") to a particular type of problem (constrained optimization). It's inspired by the science of metallurgy, and because it's grounded in a real-world proc

From playlist RubyConf 2022: Mini and Houston

Video thumbnail

HLCS | Interpretable and Explainable Data-Driven Methods for Physical Simulations

Description: A data-driven model can be built to accurately accelerate computationally expensive physical simulations, which is essential in multi-query problems, such as uncertainty quantification, design optimization, optimal control, and inverse problems. It is important to build interp

From playlist Hartree–Livermore Computational Science (HLCS)

Video thumbnail

Bayesian optimisation for likelihood-free cosmological (...) - Leclercq - Workshop 2 - CEB T3 2018

Leclercq (Imperial College) / 22.10.2018 Bayesian optimisation for likelihood-free cosmological inference ---------------------------------- Vous pouvez nous rejoindre sur les réseaux sociaux pour suivre nos actualités. Facebook : https://www.facebook.com/InstitutHenriPoincare/ Twitter

From playlist 2018 - T3 - Analytics, Inference, and Computation in Cosmology

Video thumbnail

Simulating the economy as we simulate the climate... - Pollitt - Workshop 3 - CEB T3 2019

Pollitt (Cambridge Econometrics) / 04.12.2019 Simulating the economy as we simulate the climate: why most economists get it wrong ---------------------------------- Vous pouvez nous rejoindre sur les réseaux sociaux pour suivre nos actualités. Facebook : https://www.facebook.com/I

From playlist 2019 - T3 - The Mathematics of Climate and the Environment

Video thumbnail

DDPS | libROM: Library for physics-constrained data-driven physical simulations | Youngsoo Choi

A data-driven model can be built to accurately accelerate computationally expensive physical simulations, which is essential in multi-query problems, such as inverse problem, uncertainty quantification, design optimization, and optimal control. In this talk, two types of data-driven mode

From playlist Data-driven Physical Simulations (DDPS) Seminar Series

Video thumbnail

Michael Hyland: "Integrating State-of-the-Art Mobility-on-Demand Fleet Models into Transportatio..."

Mathematical Challenges and Opportunities for Autonomous Vehicles 2020 Workshop III: Large Scale Autonomy: Connectivity and Mobility Networks "Integrating State-of-the-Art Mobility-on-Demand Fleet Models into Transportation System Simulation Tools for Policy Analysis" Michael Hyland - Uni

From playlist Mathematical Challenges and Opportunities for Autonomous Vehicles 2020

Video thumbnail

Optimizing HEV Models

Learn about HEV modeling and simulation. In this video, you will: - Get an introduction to optimization and learn about MATLAB® and Simulink® optimization tools. - Learn how to simultaneously optimize control and component parameters. - Find a common set of control parameters for various

From playlist Hybrid Electric Vehicles

Video thumbnail

DDPS | Data-driven methods for fluid simulations in computer graphics

Fluid phenomena are ubiquitous to our world experience: winds swooshing through trembling leaves, turbulent water streams running down a river, and cellular patterns generated from wrinkled flames are some few examples. These complex phenomena capture our attention and awe due to the beaut

From playlist Data-driven Physical Simulations (DDPS) Seminar Series

Video thumbnail

Method of Simulated Moments (MSM)

MIT 15.879 Research Seminar in System Dynamics, Spring 2014 View the complete course: http://ocw.mit.edu/15-879S14 Instructor: William Chernicoff, George Miller, Sergey Naumov, Jim Qian Video tutorial created by students as part of the class final project. License: Creative Commons BY-NC

From playlist MIT 15.879 Research Seminar in System Dynamics, Spring 2014

Video thumbnail

What in the world is a linear program?

What is a linear program and why do we care? Today I’m going to introduce you to the exciting world of optimization, which is the mathematical field of maximizing or minimizing an objective function subject to constraints. The most fundamental topic in optimization is linear programming,

From playlist Summer of Math Exposition 2 videos

Video thumbnail

MIT 6.S091: Introduction to Deep Reinforcement Learning (Deep RL)

First lecture of MIT course 6.S091: Deep Reinforcement Learning, introducing the fascinating field of Deep RL. For more lecture videos on deep learning, reinforcement learning (RL), artificial intelligence (AI & AGI), and podcast conversations, visit our website or follow TensorFlow code t

From playlist Introduction to Deep Learning

Related pages

Derivative-free optimization | Tabu search | Dynamic programming | Heuristic (computer science) | Parametric programming | Artificial intelligence | Optimal control | Response surface methodology | Stochastic approximation | Linear programming