When considering controversial thermodynamic scenarios such as Maxwell's demon or single-molecule gases, it is often necessary to consider probabilistic mixtures of states. However, the assignment of entropy to such states has proved controversial. Here I will offer an argument in support of the information theoretic entropy, based on a probabilistic generalisation of the Second Law.