Deep Bottleneck
latest
Contents
Background
Literature summary
Contributing
User guide
Glossary
Experiments
Indices and tables
API Documentation
Analyses
Minimal model
Standard vs. Weighted Binning
Tishby’s harmonics dataset
Explore bias towards entropy induced by activation function
Measuring “Information”
Indices and tables
Deep Bottleneck
Docs
»
Analyses
Edit on GitHub
Analyses
¶
Minimal model
Comparing activation functions for a minimal model
Adding bias to the minimal model
Standard vs. Weighted Binning
1. Hypothesis
2. Experiments
Tishby’s harmonics dataset
Load Tishby’s dataset
Our attempt to generate the data set above
Explore bias towards entropy induced by activation function
Measuring “Information”
Mutual information
Indices and tables
¶
Index
Module Index
Search Page