Thermodynamically, solvation (including (de)protonation) relies on an energy difference: energy required to make a "hole" in the solvent for $\ce{CH_3COOH}$, as well as the energy required to make two holes - one for $\ce{CH_3COO^-}$ and one for $\ce{H^+}$ - compared to the energy released when stabilizing interactions form (dipole-dipole interactions, charge-dipole, cation-pi interactions, etc.) between solvent and solute molecules.
NOTE: When we say "holes" in the solvent, we literally mean the energy one would need to push aside the solvent molecules from each other to make a little hole big enough to put a single ethanoic acid molecule.
- If the energy required to make a "hole" in the solvent is larger than the energy released by making all the stabilizing interactions possible, the molecule will not be effectively solvated (e.g. hexanes in water: hexane cannot form lasting stabilizing interactions with water.)
- If the energy required to make a "hole" in the solvent is less than the energy released forming stabilizing interactions, the molecule will be solvated.(ethanoic acid in water)
It's about the ability of a solvent to stabilize the neutral and charged species.
Water: $\ce{CH_3COOH}$ and its acid and conjugate base are all polar molecules/ions. Water stabilizes $\ce{CH_3COOH}$ by forming excellent dipole dipole and dipole-charge interactions (and highly symmetrically because water is symmetric). The $\ce{H^+}$ from the acid forms $\ce{H_3O^+}$ in water (also highly symmetric) and is also stabilized by $\ce{H_2O}$, so often you read about "proton hopping" in acidic aqueous solution, which also happens in methanol, but to much less extent. You can also say water's lone pairs are larger and less hindered than methanol's, or you could say that the sigma-like MO for water overlaps better (and more symmetrically) with incoming molecules than methanol's. High symmetry allows much better orbital mixing (via more degenerate MOs), lowering the energy of water and hydronium significantly.
Methanol: Methanol is polar and has a $\mathrm{p}K_\mathrm{a}$ (so I've heard) around water's. Methanol $\ce{O}$ atom can accommodate a proton and when it does, it is stabilized partly by hyperconjugation (a type of orbital mixing; see below for visual) but is not stabilized to the extent water is in part because methanol is not as symmetric (neutral or protonated) as water is = less MO mixing. Yet, methanol forms good dipole-dipole and dipole-charge stabilizing interactions.
DMSO: DMSO is polar, but aprotic, suggesting it does not hold on to protons very well. It can form dipole-dipole interactions, but the sulfoxide $\ce{S=O}$ part likely doesn't overlap very well in a "sigma way" (head-to-head), but in a "pi-way" resulting in weaker overlap.
A note to illustrate hyperconjugation:
If protonated methanol is stabilized, it is likely stabilized intramolecularly by hyperconjugation, which is electron overlap between the exposed (empty) $\mathrm{p}$-orbital on oxygen and the $\ce{C-H}$ sigma bond.
It will also be stabilized intermolecularly if surrounded by other polar electron-rich species (methanol, $\ce{CH_3COO^-}$ or $\ce{CH3COOH}$): These molecules will also temporarily donate electron density to the empty $\mathrm{p}$-orbital on the protonated methanol oxygen.
These effects combine to allow for methanol to harbour a proton, making it a little better base than one would think.