@mung I have an edited verison of this thread in mind for an article:
Mung's Primer on Information Theory