Deep Learning and the Information Bottleneck Principle

Original author:

https://www.youtube.com/watch?v=FSfN2K3tnJU

https://www.youtube.com/watch?v=bLqJHjXihK8

https://www.youtube.com/watch?v=ekUWO_pI2M8

https://www.youtube.com/watch?v=bLqJHjXihK8 

https://www.youtube.com/watch?v=0gRfLTgnEgs  

https://www.youtube.com/watch?v=Vx3uN0dt8M8

https://arxiv.org/abs/1503.02406

https://en.wikipedia.org/wiki/Information_bottleneck_method 

https://arxiv.org/abs/1503.02406

https://openreview.net/forum?id=ry_WPG-A- 

https://openreview.net/pdf?id=ry_WPG-A-

https://www.youtube.com/watch?v=WspbpNEgm88

Intuition behind Information Bottleneck Theory:

https://www.quora.com/What-do-Deep-Learning-experts-think-about-the-information-bottleneck-theory

https://medium.com/singular-distillation/little-explanations-information-bottleneck-theory-its-possible-link-to-neural-networks-iii-67a54e918dae