What is the ID Definition of Information?

@mung I have an edited verison of this thread in mind for an article:

Mung's Primer on Information Theory :slight_smile: