On the point of ‘makes your body acidic’ you already have an answer to which I have nothing to add.
However, you also claim that sugar be completely neutral—at which point I must intervene.
A lot more compounds can act as acids and bases than the shortlist of common acids you probably had in chemistry class. Most things with a lone pair can be a base and practically any $\ce{X-H}$ bond where $\ce{X}$ has a higher electronegativity than hydrogen can be an acid. In $95~\%$ of cases, these compounds are probably still not acidic or basic though.
And then there is the (much smaller, but still vast) class of compounds that can act as acids or bases in standard aquaeous solutions but usually do not. In sugar’s case, it has a lot of $\ce{O-H}$ bonds and a lot of oxygen atoms. All oxygen atoms can be protonated if a strong acid is introduced to the mixture so sugar is a base about as strong as water. On the other hand, the hydrogen of the $\ce{O-H}$ bonds can also depart as a proton if a strong enough base is in solution. This means sugar’s hydroxy groups are also weak acids—again, about as strong as water.
Then there is a final convoluting factor. One of these hydroxy groups in glucose is attached to a carbon that is bound to a second oxygen ($\ce{R-O-CHR'-O-H}$). Here, the electronegative oxygen exercises a negative inductive effect, i.e. draws electron density away from the hydroxy group. Therefore, this one proton is slightly more acidic than all others. It is also ever so slightly more acidic than water so it acidifies the solution ever so slightly.
For all practical intents and purposes, this effect can be fully neglected, however, as it is so minor.