The fundamental connections between classical Hamiltonian mechanics, quantum mechanics and information entropy

We show that the main difference between classical and quantum systems can be understood in terms of information entropy. Classical systems can be considered the ones where the internal dynamics can be known with arbitrary precision while quantum systems can be considered the ones where the internal dynamics cannot be accessed at all. As information entropy can be used to characterize how much the state of the whole system identifies the state of its parts, classical systems can have arbitrarily small information entropy while quantum systems cannot. This provides insights that allow us to understand the analogies and differences between the two theories.