Information theory

Redundancy (information theory)

In information theory, redundancy measures the fractional difference between the entropy H(X) of an ensemble X, and its maximum possible value . Informally, it is the amount of wasted "space" used to transmit certain data. Data compression is a way to reduce or eliminate unwanted redundancy, while forward error correction is a way of adding desired redundancy for purposes of error detection and correction when communicating over a noisy channel of limited capacity. (Wikipedia).

Video thumbnail

(IC 1.6) A different notion of "information"

An informal discussion of the distinctions between our everyday usage of the word "information" and the information-theoretic notion of "information". A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Attribution for image of TV static:

From playlist Information theory and Coding

Video thumbnail

(IC 1.1) Information theory and Coding - Outline of topics

A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Overview of central topics in Information theory and Coding. Compression (source coding) theory: Source coding theorem, Kraft-McMillan inequality, Rate-distortion theorem Error-correctio

From playlist Information theory and Coding

Video thumbnail

Geometric bounds for dissipation (Lecture 3) by Ben Machta

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Introduction to Quantum Entaglement by Albion Lawrence

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Information Theory Meets Quantum Physics: The magic of wave dynamics by Apoorva Patel

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

From information theory to learning via Statistical Physics by Florent Krzakala

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Sloppiness and Parameter Identifiability, Information Geometry by Mark Transtrum

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Computational Differential Geometry, Optimization Algorithms by Mark Transtrum

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Sergio Verdu - Information Theory Today

Founded by Claude Shannon in 1948, information theory has taken on renewed vibrancy with technological advances that pave the way for attaining the fundamental limits of communication channels and information sources. Increasingly playing a role as a design driver, information theory is b

From playlist NOKIA-IHES Workshop

Video thumbnail

Shannon 100 - 26/10/2016 - Elisabeth GASSIAT

Entropie, compression et statistique Elisabeth Gassiat (Université de Paris-Sud) Claude Shannon est l'inventeur de la théorie de l'information. Il a introduit la notion d'entropie comme mesure de l'information contenue dans un message vu comme provenant d'une source stochastique et démon

From playlist Shannon 100

Video thumbnail

Intro to Information Theory | Digital Communication | Information Technology

Shannon Entropy in Information theory. Compression and digital communication in systems and technology. The Entropy of English. The video we did over on Mark's channel! https://youtu.be/VF5MGLRlXVw Subscribe to Mark's channel Alliterative! https://www.youtube.com/user/Alliterative Hi! I

From playlist Computer Science

Video thumbnail

From information theory to learning via Statistical Physics: Introduction: by Florent Krzakala

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Foundations of General Relativity - Andrew Strominger

General Relativity at 100: Institute for Advanced Study and Princeton University Celebrate the Enduring Reach, Power and Mysteries of Einstein’s Theory Andrew Strominger - November 5, 2015 https://www.ias.edu/gr100 Albert Einstein’s general theory of relativity, a pillar of modern physi

From playlist General Relativity at 100

Video thumbnail

Christophe Ritzenthaler : Les codes correcteurs

Recording during the thematic meeting : "Hommage à Claude Shannon" the November 2, 2016 at the Centre International de Rencontres Mathématiques (Marseille, France) Filmmaker: Guillaume Hennenfent, Emilie Cornillaux Find this video and other talks given by worldwide mathematicians on CIRM

From playlist Hommage/Tribute - Claude Shannon - Nov 2016

Video thumbnail

Supersymmetric Gauge Dynamics, Part 3 - Nathan Seiberg

Supersymmetric Gauge Dynamics, Part 3 Nathan Seiberg Institute for Advanced Study July 30, 2010

From playlist PiTP 2010

Video thumbnail

Shannon 100 - 27/10/2016 - Vincent GRIPON

Vers une théorie de l'information mentale Vincent Gripon (Télécom Bretagne) Dans les réseaux de neurones du néocortex viennent s'imprimer nos souvenirs par le biais du mécanisme de plasticité synaptique. Celui-ci nous permet de stocker des éléments d'information variés à l'échelle d'une

From playlist Shannon 100

Video thumbnail

Shannon 100 - 27/10/2016 - Gérard BATTAIL

En suivant Shannon : de la technique à la compréhension de la vie Gérard Battail (Télécom ParisTech ER) L’application de la théorie de l’information à la biologie est le thème principal de cette conférence. Shannon, étudiant au MIT, a soutenu en 1940 une thèse intitulée An algebra for th

From playlist Shannon 100

Video thumbnail

Entanglement entropy, quantum field theory, and holography by Matthew Headrick

26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical

From playlist US-India Advanced Studies Institute: Classical and Quantum Information

Video thumbnail

Error correction | Journey into information theory | Computer Science | Khan Academy

How can we communicate in the presence of noise? Watch the next lesson: https://www.khanacademy.org/computing/computer-science/informationtheory/moderninfotheory/v/seti?utm_source=YT&utm_medium=Desc&utm_campaign=computerscience Missed the previous lesson? https://www.khanacademy.org/comp

From playlist Journey into information theory | Computer Science | Khan Academy

Related pages

Communication channel | Channel capacity | Joint entropy | Mutual information | Logarithm | Stochastic process | Hartley function | Total correlation | Data compression ratio | Ergodicity | Negentropy | Information theory | Overcompleteness | Entropy rate | Forward error correction | Stationary process | Expected value | Cardinality | Entropy (information theory) | Error detection and correction