Information Rate and Entropy Rate

It was rather simple to see that your two equations were identical. But when asked for a source for your equation for information you pointed us to the equation for entropy!

I still have not found a single source that defines an equation for information that looks like the one you posted. The one source that did give a formal definition for information gave an equation that was not the same as yours.

1 Like