Revision #179 → #1315 · back to history
addedFair coin flip informationc41025d2a18f
addedNyquist's line-speed relation403a2ff77bf4
addedHartley's measure of information3d36f7a38199
addedp log p convention at zeroa434ac29b87c
addedShannon entropy33a9cbfdb0e6
addedSelf-information (surprisal)3b15d6305235
addedLess probable symbol has larger surprisalb4922762fff4
added1000-bit transmission63bc59d62e9c
addedMaximum entropy at equiprobabilitydce2b52c8de8
addedTotal entropy of i.i.d. source8c47481c1194
addedBinary entropy function772ac28a4248
addedBinary entropy maximum at p=0.5323aa513377e
addedJoint entropye4c0a94d9d8a
addedJoint entropy of independent variables2aeb028f78a3
addedChess piece positionfe997d64f030
addedJoint entropy as subcase of entropy024958b3cb6e
addedConditional entropye20155be00b8
addedChain rule property of conditional entropy5238dfe6428f
addedMutual information36dacd4cd2d9
addedBasic property of mutual information925b4b80ab26
addedMutual information is symmetric6c9794b7f9f6
addedMutual information as KL divergencebe6d5d672e6d
addedKullback–Leibler divergence87e2d57d0778
addedKL divergence is not a metric4ce77aa56246
addedDirected information39ef212eca4e
addedDirected information is not symmetric65695bd3c225
addedInformation rate3d63991cd828
addedChannel capacitybdb0cb089fc1
addedNoisy-channel coding theoreme14c0086fd39
addedCapacity of the binary symmetric channel0a8ee15b8fb4
addedCapacity of the binary erasure channel65e77197c9b2
addedCapacity of channels with memorye938fb9cfc5d
addedFungible information7772b43d2703