The new glossary helping you to get the bigger picture.
Entropy & Mutual Information¶
including sufficient statistic and data processing inequality
What is this mysterious information bottleneck?¶
including distortion theory, lossless and lossy compression, Kullback-Leibler divergence, information plane, bounds
An Introduction into Neural Networks¶
including single and multilayer perceptron, Connectivity Matrix, Backpropagation, etc.
including Probability Theory, Markov Chains