Entropy in Compression - Computerphile

What's the absolute minimum you can compress data to? - Entropy conjures up visions of chemistry and physics, but how does it apply to binary codes and computer science? Professor David Brailsford continues his discussion of compression. Addendum: the formula at 4:40 is the "weighted average bits for that state" rather than the total number of bits - (log^2) Original Professor Brailsford film on compression: http://youtu.be/Lto-ajuqW3w Professor Brailsford on Error Detection: http://youtu.be/-15nx57tbfc http://www.facebook.com/computerphile https://twitter.com/computer_phile This video was filmed and edited by Sean Riley. Computer Science at the University of Nottingham: http://bit.ly/nottscomputer Computerphile is a sister project to Brady Haran's Numberphile. See the full list of Brady's video projects at:http://periodicvideos.blogspot.co.uk/...