Fun fact : entropy really is a fundamental unit, as mentioned in the video.

https://en.wikipedia.org/wiki/SI_base_unit

Entropy and temperature are linked together by an energy term. If you like, you can choose Entropy instead of Temperature as one of the fundamental physical dimension

As it has been said in another comment this should link to the whole playlist or the video with playlist https://www.youtube.com/watch?v=p0ASFxKS9sg&list=PLbg3ZX2pWl...

Otherwise it's just an intro.

Also of interest is algorithmic information theory. In both there are limits to that algotithms can do. There is the data processing inequality and Chaitin's incompleteness theorem.