Optimization algorithms and methods | Stochastic optimization

Stochastic programming

In the field of mathematical optimization, stochastic programming is a framework for modeling optimization problems that involve uncertainty. A stochastic program is an optimization problem in which some or all problem parameters are uncertain, but follow known probability distributions. This framework contrasts with deterministic optimization, in which all problem parameters are assumed to be known exactly. The goal of stochastic programming is to find a decision which both optimizes some criteria chosen by the decision maker, and appropriately accounts for the uncertainty of the problem parameters. Because many real-world decisions involve uncertainty, stochastic programming has found applications in a broad range of areas ranging from finance to transportation to energy optimization. (Wikipedia).

Video thumbnail

Basic stochastic simulation b: Stochastic simulation algorithm

(C) 2012-2013 David Liao (lookatphysics.com) CC-BY-SA Specify system Determine duration until next event Exponentially distributed waiting times Determine what kind of reaction next event will be For more information, please search the internet for "stochastic simulation algorithm" or "kin

From playlist Probability, statistics, and stochastic processes

Video thumbnail

Jana Cslovjecsek: Efficient algorithms for multistage stochastic integer programming using proximity

We consider the problem of solving integer programs of the form min {c^T x : Ax = b; x geq 0}, where A is a multistage stochastic matrix. We give an algorithm that solves this problem in fixed-parameter time f(d; ||A||_infty) n log^O(2d) n, where f is a computable function, d is the treed

From playlist Workshop: Parametrized complexity and discrete optimization

Video thumbnail

Stochastic Normalizing Flows

Introduction to the paper https://arxiv.org/abs/2002.06707

From playlist Research

Video thumbnail

"Data-Driven Optimization in Pricing and Revenue Management" by Arnoud den Boer - Lecture 1

In this course we will study data-driven decision problems: optimization problems for which the relation between decision and outcome is unknown upfront, and thus has to be learned on-the-fly from accumulating data. This type of problems has an intrinsic tension between statistical goals a

From playlist Thematic Program on Stochastic Modeling: A Focus on Pricing & Revenue Management​

Video thumbnail

Mini Batch Gradient Descent | Deep Learning | with Stochastic Gradient Descent

Mini Batch Gradient Descent is an algorithm that helps to speed up learning while dealing with a large dataset. Instead of updating the weight parameters after assessing the entire dataset, Mini Batch Gradient Descent updates weight parameters after assessing the small batch of the datase

From playlist Optimizers in Machine Learning

Video thumbnail

"Diffusion Approximation and Sequential Experimentation" by Victor Araman

We consider a Bayesian sequential experimentation problem. We identify environments in which the average number of experiments that is conducted per unit of time is large and the informativeness of each individual experiment is low. Under such regimes, we derive a diffusion approximation f

From playlist Thematic Program on Stochastic Modeling: A Focus on Pricing & Revenue Management​

Video thumbnail

Iterative stochastic numerical methods for statistical sampling: Professor Ben Leimkuhler

I study the design, analysis and implementation of algorithms for time-dependent phenomena and modelling for problems in engineering and the sciences. My previous works have helped to establish the foundations of molecular simulation, providing efficient deterministic and stochastic numeri

From playlist Data science classes

Video thumbnail

L21.3 Stochastic Processes

MIT RES.6-012 Introduction to Probability, Spring 2018 View the complete course: https://ocw.mit.edu/RES-6-012S18 Instructor: John Tsitsiklis License: Creative Commons BY-NC-SA More information at https://ocw.mit.edu/terms More courses at https://ocw.mit.edu

From playlist MIT RES.6-012 Introduction to Probability, Spring 2018

Video thumbnail

An introduction to multilevel Monte Carlo methods – Michael Giles – ICM2018

Numerical Analysis and Scientific Computing Invited Lecture 15.7 An introduction to multilevel Monte Carlo methods Michael Giles Abstract: In recent years there has been very substantial growth in stochastic modelling in many application areas, and this has led to much greater use of Mon

From playlist Numerical Analysis and Scientific Computing

Video thumbnail

Elias Khalil - Neur2SP: Neural Two-Stage Stochastic Programming - IPAM at UCLA

Recorded 02 March 2023. Elias Khalil of the University of Toronto presents "Neur2SP: Neural Two-Stage Stochastic Programming" at IPAM's Artificial Intelligence and Discrete Optimization Workshop. Abstract: Stochastic Programming is a powerful modeling framework for decision-making under un

From playlist 2023 Artificial Intelligence and Discrete Optimization

Video thumbnail

Jorge Nocedal: "Tutorial on Optimization Methods for Machine Learning, Pt. 3"

Graduate Summer School 2012: Deep Learning, Feature Learning "Tutorial on Optimization Methods for Machine Learning, Pt. 3" Jorge Nocedal, Northwestern University Institute for Pure and Applied Mathematics, UCLA July 18, 2012 For more information: https://www.ipam.ucla.edu/programs/summ

From playlist GSS2012: Deep Learning, Feature Learning

Video thumbnail

47 Prof. Raju K George

PROGRAM NAME :WINTER SCHOOL ON STOCHASTIC ANALYSIS AND CONTROL OF FLUID FLOW DATES Monday 03 Dec, 2012 - Thursday 20 Dec, 2012 VENUE School of Mathematics, Indian Institute of Science Education and Research, Thiruvananthapuram Stochastic analysis and control of fluid flow problems have

From playlist Winter School on Stochastic Analysis and Control of Fluid Flow

Video thumbnail

Stochastic Model of Cargo Positioning by a Team of Antagonistic Motor Proteins by Ambarish Kunwar

PROGRAM STATISTICAL BIOLOGICAL PHYSICS: FROM SINGLE MOLECULE TO CELL (ONLINE) ORGANIZERS: Debashish Chowdhury (IIT Kanpur), Ambarish Kunwar (IIT Bombay) and Prabal K Maiti (IISc, Bengaluru) DATE: 07 December 2020 to 18 December 2020 VENUE: Online 'Fluctuation-and-noise' are themes tha

From playlist Statistical Biological Physics: From Single Molecule to Cell (Online)

Video thumbnail

Stochastic Mechanisms of Cell-Size Regulation in Bacteria by Anatoly Kolomeisky

PROGRAM STATISTICAL BIOLOGICAL PHYSICS: FROM SINGLE MOLECULE TO CELL (ONLINE) ORGANIZERS: Debashish Chowdhury (IIT Kanpur), Ambarish Kunwar (IIT Bombay) and Prabal K Maiti (IISc, Bengaluru) DATE: 07 December 2020 to 18 December 2020 VENUE: Online 'Fluctuation-and-noise' are themes tha

From playlist Statistical Biological Physics: From Single Molecule to Cell (Online)

Video thumbnail

Alternate minimization algorithms for scaling problems, and their analysis - Rafael Oliveira

Optimization, Complexity and Invariant Theory Topic: Alternate minimization algorithms for scaling problems, and their analysis Speaker: Rafael Oliveira Affiliation: University of Toronto Date: June 5. 2018 For more videos, please visit http://video.ias.edu

From playlist Mathematics

Video thumbnail

Integrating Inference with Stochastic Process Algebra Models - Jane Hillston, Edinburgh

ProPPA is a probabilistic programming language for continuous-time dynamical systems, developed as an extension of the stochastic process algebra Bio-PEPA. It offers a high-level syntax for describing systems of interacting components with stochastic behaviours where some of the parameters

From playlist Logic and learning workshop

Video thumbnail

Unit 3 Debate: Tomer Ullman and Laura Schulz

MIT RES.9-003 Brains, Minds and Machines Summer Course, Summer 2015 View the complete course: https://ocw.mit.edu/RES-9-003SU15 Instructor: Tomer Ullman, Laura Schulz Speakers debate what makes a good theory of the world, the potential role of stochastic search in theory formation, goal-o

From playlist MIT RES.9-003 Brains, Minds and Machines Summer Course, Summer 2015

Video thumbnail

Evolution in a Changing World by Kavita Jain

PROGRAM STATISTICAL BIOLOGICAL PHYSICS: FROM SINGLE MOLECULE TO CELL ORGANIZERS: Debashish Chowdhury (IIT-Kanpur, India), Ambarish Kunwar (IIT-Bombay, India) and Prabal K Maiti (IISc, India) DATE: 11 October 2022 to 22 October 2022 VENUE: Ramanujan Lecture Hall 'Fluctuation-and-noise' a

From playlist STATISTICAL BIOLOGICAL PHYSICS: FROM SINGLE MOLECULE TO CELL (2022)

Video thumbnail

Definition of a Surjective Function and a Function that is NOT Surjective

We define what it means for a function to be surjective and explain the intuition behind the definition. We then do an example where we show a function is not surjective. Surjective functions are also called onto functions. Useful Math Supplies https://amzn.to/3Y5TGcv My Recording Gear ht

From playlist Injective, Surjective, and Bijective Functions

Related pages

Entropic value at risk | Mathematical optimization | Correlation gap | Law of large numbers | FortSP | AIMMS | Central limit theorem | Dynamic programming | Expected shortfall | Robust optimization | Uncertainty | SAMPL | Value at risk | Probability distribution | AMPL | Mathematical model | Stochastic dynamic programming | Chance-constrained portfolio selection | CPLEX | GNU Linear Programming Kit | Scenario optimization | Stochastic optimization | Algebraic modeling language