In information theory, redundancy measures the fractional difference between the entropy H(X) of an ensemble X, and its maximum possible value . Informally, it is the amount of wasted "space" used to transmit certain data. Data compression is a way to reduce or eliminate unwanted redundancy, while forward error correction is a way of adding desired redundancy for purposes of error detection and correction when communicating over a noisy channel of limited capacity. (Wikipedia).
(IC 1.6) A different notion of "information"
An informal discussion of the distinctions between our everyday usage of the word "information" and the information-theoretic notion of "information". A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Attribution for image of TV static:
From playlist Information theory and Coding
(IC 1.1) Information theory and Coding - Outline of topics
A playlist of these videos is available at: http://www.youtube.com/playlist?list=PLE125425EC837021F Overview of central topics in Information theory and Coding. Compression (source coding) theory: Source coding theorem, Kraft-McMillan inequality, Rate-distortion theorem Error-correctio
From playlist Information theory and Coding
Geometric bounds for dissipation (Lecture 3) by Ben Machta
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Introduction to Quantum Entaglement by Albion Lawrence
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Information Theory Meets Quantum Physics: The magic of wave dynamics by Apoorva Patel
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
From information theory to learning via Statistical Physics by Florent Krzakala
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Sloppiness and Parameter Identifiability, Information Geometry by Mark Transtrum
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Computational Differential Geometry, Optimization Algorithms by Mark Transtrum
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Sergio Verdu - Information Theory Today
Founded by Claude Shannon in 1948, information theory has taken on renewed vibrancy with technological advances that pave the way for attaining the fundamental limits of communication channels and information sources. Increasingly playing a role as a design driver, information theory is b
From playlist NOKIA-IHES Workshop
Shannon 100 - 26/10/2016 - Elisabeth GASSIAT
Entropie, compression et statistique Elisabeth Gassiat (Université de Paris-Sud) Claude Shannon est l'inventeur de la théorie de l'information. Il a introduit la notion d'entropie comme mesure de l'information contenue dans un message vu comme provenant d'une source stochastique et démon
From playlist Shannon 100
Intro to Information Theory | Digital Communication | Information Technology
Shannon Entropy in Information theory. Compression and digital communication in systems and technology. The Entropy of English. The video we did over on Mark's channel! https://youtu.be/VF5MGLRlXVw Subscribe to Mark's channel Alliterative! https://www.youtube.com/user/Alliterative Hi! I
From playlist Computer Science
From information theory to learning via Statistical Physics: Introduction: by Florent Krzakala
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Foundations of General Relativity - Andrew Strominger
General Relativity at 100: Institute for Advanced Study and Princeton University Celebrate the Enduring Reach, Power and Mysteries of Einstein’s Theory Andrew Strominger - November 5, 2015 https://www.ias.edu/gr100 Albert Einstein’s general theory of relativity, a pillar of modern physi
From playlist General Relativity at 100
Christophe Ritzenthaler : Les codes correcteurs
Recording during the thematic meeting : "Hommage à Claude Shannon" the November 2, 2016 at the Centre International de Rencontres Mathématiques (Marseille, France) Filmmaker: Guillaume Hennenfent, Emilie Cornillaux Find this video and other talks given by worldwide mathematicians on CIRM
From playlist Hommage/Tribute - Claude Shannon - Nov 2016
Supersymmetric Gauge Dynamics, Part 3 - Nathan Seiberg
Supersymmetric Gauge Dynamics, Part 3 Nathan Seiberg Institute for Advanced Study July 30, 2010
From playlist PiTP 2010
Shannon 100 - 27/10/2016 - Vincent GRIPON
Vers une théorie de l'information mentale Vincent Gripon (Télécom Bretagne) Dans les réseaux de neurones du néocortex viennent s'imprimer nos souvenirs par le biais du mécanisme de plasticité synaptique. Celui-ci nous permet de stocker des éléments d'information variés à l'échelle d'une
From playlist Shannon 100
Shannon 100 - 27/10/2016 - Gérard BATTAIL
En suivant Shannon : de la technique à la compréhension de la vie Gérard Battail (Télécom ParisTech ER) L’application de la théorie de l’information à la biologie est le thème principal de cette conférence. Shannon, étudiant au MIT, a soutenu en 1940 une thèse intitulée An algebra for th
From playlist Shannon 100
Entanglement entropy, quantum field theory, and holography by Matthew Headrick
26 December 2016 to 07 January 2017 VENUE: Madhava Lecture Hall, ICTS Bangalore Information theory and computational complexity have emerged as central concepts in the study of biological and physical systems, in both the classical and quantum realm. The low-energy landscape of classical
From playlist US-India Advanced Studies Institute: Classical and Quantum Information
Error correction | Journey into information theory | Computer Science | Khan Academy
How can we communicate in the presence of noise? Watch the next lesson: https://www.khanacademy.org/computing/computer-science/informationtheory/moderninfotheory/v/seti?utm_source=YT&utm_medium=Desc&utm_campaign=computerscience Missed the previous lesson? https://www.khanacademy.org/comp
From playlist Journey into information theory | Computer Science | Khan Academy