Information Theory for Theoretical Physicists, 6 hours
The Physical Nature of Information -
A unified introduction to information theory for scientists
Reference List for the book
Popular Introduction to Information Theory
Popular colloquium
5-lecture course
Full 32-hour course at Harvard, 2022
