In a set of questions that I was solving, the answer to one of the questions asking why the density of liquid water increases from 0 to 4 degrees C had the above answer: due to an increase in entropy.
This website does explain this a bit with two thermodynamic equations, but I am unable to make sense of how entropy comes into the picture here. Please explain how the increase in density of water is due to an increase in entropy.