Entropy in Compression - Computerphile

What's the absolute minimum you can compress data to? - Entropy conjures up visions of chemistry and physics, but how does it apply to binary codes and computer science? Professor David Brailsford continues his discussion of compression.
Addendum: the formula at 4:40 is the "weighted average bits for that state"
rather than the total number of bits - (log^2)
Original Professor Brailsford film on compression: • Compression - Computer...
Professor Brailsford on Error Detection: • Error Detection and Fl...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscomputer
Computerphile is a sister project to Brady Haran's Numberphile. See the full list of Brady's video projects at:periodicvideos.blogspot.co.uk/...