Information theory | Network theory

Maximal entropy random walk

Maximal entropy random walk (MERW) is a popular type of biased random walk on a graph, in which transition probabilities are chosen accordingly to the principle of maximum entropy, which says that the probability distribution which best represents the current state of knowledge is the one with largest entropy. While standard random walk chooses for every vertex uniform probability distribution among its outgoing edges, locally maximizing entropy rate, MERW maximizes it globally (average entropy production) by assuming uniform probability distribution among all paths in a given graph. MERW is used in various fields of science. A direct application is choosing probabilities to maximize transmission rate through a constrained channel, analogously to Fibonacci coding. Its properties also made it useful for example in analysis of complex networks, like link prediction, community detection,robust transport over networks and centrality measures. Also in image analysis, for example for detecting visual saliency regions, object localization, tampering detection or tractography problem. Additionally, it recreates some properties of quantum mechanics, suggesting a way to repair the discrepancy between diffusion models and quantum predictions, like Anderson localization. (Wikipedia).

Maximal entropy random walk
Video thumbnail

All Pairs Shortest Paths - Intro to Algorithms

This video is part of an online course, Intro to Algorithms. Check out the course here: https://www.udacity.com/course/cs215.

From playlist Introduction to Algorithms

Video thumbnail

Entropy production during free expansion of an ideal gas by Subhadip Chakraborti

Abstract: According to the second law, the entropy of an isolated system increases during its evolution from one equilibrium state to another. The free expansion of a gas, on removal of a partition in a box, is an example where we expect to see such an increase of entropy. The constructi

From playlist Seminar Series

Video thumbnail

Entropy: The Heat Death of The Universe

Entropy: The Heat Death of The Universe - https://aperture.gg/heatdeath Sign up with Brilliant for FREE and start learning today: https://brilliant.org/aperture "Maximum Entropy" Hoodies — Available Now: https://aperture.gg/entropy As the arrow of time pushes us forward, each day the univ

From playlist Science & Technology 🚀

Video thumbnail

Find the Shortest Path - Intro to Algorithms

This video is part of an online course, Intro to Algorithms. Check out the course here: https://www.udacity.com/course/cs215.

From playlist Introduction to Algorithms

Video thumbnail

Find the Shortest Path - Intro to Algorithms

This video is part of an online course, Intro to Algorithms. Check out the course here: https://www.udacity.com/course/cs215.

From playlist Introduction to Algorithms

Video thumbnail

Topics in Combinatorics lecture 10.0 --- The formula for entropy

In this video I present the formula for the entropy of a random variable that takes values in a finite set, prove that it satisfies the entropy axioms, and prove that it is the only formula that satisfies the entropy axioms. 0:00 The formula for entropy and proof that it satisfies the ax

From playlist Topics in Combinatorics (Cambridge Part III course)

Video thumbnail

Stanford CS330: Multi-Task and Meta-Learning, 2019 | Lecture 11 - Sergey Levine (UC Berkeley)

For more information about Stanford’s Artificial Intelligence professional and graduate programs, visit: https://stanford.io/ai Sergey Levine (UC Berkeley) Guest Lecture in Stanford CS330 http://cs330.stanford.edu/

From playlist Stanford CS330: Deep Multi-Task and Meta Learning

Video thumbnail

Harmonic Measures and Poisson Boundaries for Random Walks on Groups (Lecture 3) by Giulio Tiozzo

PROGRAM: PROBABILISTIC METHODS IN NEGATIVE CURVATURE ORGANIZERS: Riddhipratim Basu (ICTS - TIFR, India), Anish Ghosh (TIFR, Mumbai, India), Subhajit Goswami (TIFR, Mumbai, India) and Mahan M J (TIFR, Mumbai, India) DATE & TIME: 27 February 2023 to 10 March 2023 VENUE: Madhava Lecture Hall

From playlist PROBABILISTIC METHODS IN NEGATIVE CURVATURE - 2023

Video thumbnail

A better description of entropy

I use this stirling engine to explain entropy. Entropy is normally described as a measure of disorder but I don't think that's helpful. Here's a better description. Visit my blog here: http://stevemould.com Follow me on twitter here: http://twitter.com/moulds Buy nerdy maths things here:

From playlist Best of

Video thumbnail

MagLab Theory Winter School 2018: Israel Klich - Motzkin Spin Chains

The National MagLab held it's sixth Theory Winter School in Tallahassee, FL from January 8th - 13th, 2018.

From playlist 2018 Theory Winter School

Video thumbnail

Thermodynamic Uncertainty Relations by Supriya Krishnamurthy

DISCUSSION MEETING : STATISTICAL PHYSICS OF COMPLEX SYSTEMS ORGANIZERS : Sumedha (NISER, India), Abhishek Dhar (ICTS-TIFR, India), Satya Majumdar (University of Paris-Saclay, France), R Rajesh (IMSc, India), Sanjib Sabhapandit (RRI, India) and Tridib Sadhu (TIFR, India) DATE : 19 December

From playlist Statistical Physics of Complex Systems - 2022

Video thumbnail

Dynamics-Aware Unsupervised Discovery of Skills (Paper Explained)

This RL framework can discover low-level skills all by itself without any reward. Even better, at test time it can compose its learned skills and reach a specified goal without any additional learning! Warning: Math-heavy! OUTLINE: 0:00 - Motivation 2:15 - High-Level Overview 3:20 - Model

From playlist Papers Explained

Video thumbnail

Rick Kenyon - The multinomial Ising model

The multinomial Ising model on a graph $G=(V,E)$ is the Ising model on the N-fold “blow-up” $G_N$ of $G$, whose vertices are $V\times[N]$, and edges connect $(u,i)$ to $(v,j)$ iff $u$ and $v$ are adjacent. In the limit of large $N$ we find the critical temperature, phase transitions,

From playlist 100…(102!) Years of the Ising Model

Video thumbnail

The dynamics of regularized flows on convex bodies -James Lee

Optimization, Complexity and Invariant Theory Topic: The dynamics of regularized flows on convex bodies Speaker: James Lee Affiliation: University of Washington Date: June 7. 2018 For more videos, please visit http://video.ias.edu

From playlist Mathematics

Video thumbnail

Harmonic Measures and Poisson Boundaries for Random Walks on Groups (Lecture 2) by Giulio Tiozzo

PROGRAM: PROBABILISTIC METHODS IN NEGATIVE CURVATURE ORGANIZERS: Riddhipratim Basu (ICTS - TIFR, India), Anish Ghosh (TIFR, Mumbai, India), Subhajit Goswami (TIFR, Mumbai, India) and Mahan M J (TIFR, Mumbai, India) DATE & TIME: 27 February 2023 to 10 March 2023 VENUE: Madhava Lecture Hall

From playlist PROBABILISTIC METHODS IN NEGATIVE CURVATURE - 2023

Video thumbnail

Breaking of Ensemble Equivalence in dense random graphs by Nicos Starreveld

Large deviation theory in statistical physics: Recent advances and future challenges DATE: 14 August 2017 to 13 October 2017 VENUE: Madhava Lecture Hall, ICTS, Bengaluru Large deviation theory made its way into statistical physics as a mathematical framework for studying equilibrium syst

From playlist Large deviation theory in statistical physics: Recent advances and future challenges

Video thumbnail

Maxwell-Boltzmann distribution

Entropy and the Maxwell-Boltzmann velocity distribution. Also discusses why this is different than the Bose-Einstein and Fermi-Dirac energy distributions for quantum particles. My Patreon page is at https://www.patreon.com/EugeneK 00:00 Maxwell-Boltzmann distribution 02:45 Higher Temper

From playlist Physics

Video thumbnail

Two manifestations of rigidity in point sets: forbidden regions... by Subhroshekhar Ghosh

PROGRAM :UNIVERSALITY IN RANDOM STRUCTURES: INTERFACES, MATRICES, SANDPILES ORGANIZERS :Arvind Ayyer, Riddhipratim Basu and Manjunath Krishnapur DATE & TIME :14 January 2019 to 08 February 2019 VENUE :Madhava Lecture Hall, ICTS, Bangalore The primary focus of this program will be on the

From playlist Universality in random structures: Interfaces, Matrices, Sandpiles - 2019

Related pages

Eigenvector centrality | Graph (discrete mathematics) | Stochastic process | Centrality | Perron–Frobenius theorem | Golden ratio | Periodic graph (graph theory) | Biased random walk on a graph | Ergodic theory | Adjacency matrix | Principle of maximum entropy | Random walk | Conditional probability | Markov chain | Entropy rate | Stochastic matrix | Discrete Laplace operator | Infinitesimal | Fibonacci coding | Entropy coding | Ising model | Bra–ket notation