Big Picture

The new glossary helping you to get the bigger picture.

Entropy & Mutual Information

including sufficient statistic and data processing inequality

What is this mysterious information bottleneck?

including distortion theory, lossless and lossy compression, Kullback-Leibler divergence, information plane, bounds

An Introduction into Neural Networks

including single and multilayer perceptron, Connectivity Matrix, Backpropagation, etc.

Basic Maths

including Probability Theory, Markov Chains