I absolutely agree with you. Information Theory provided a different perspective on how to conceptualize the meaning of entropy. And of course, this extended to how we could could conceptualize the Second Law of Thermodynamics. This was all presaged by Boltzmann. The 2LoT does not preclude improbable states.