One thing you should always remember is that you should always consider the actual three-dimensional structure when determining chirality. Sometimes there are elements of chirality that are not visible on paper but clear if the full structure is considered. For cyclobutane, this means you should consider the puckered structure of the core structure. However, this often rapidly equilibrates between different practically identical configurations and does not add a layer of complexity to this molecule. Thus, we are able to analyse with the paper plane only.
If you put a plane of symmetry through the centre of the $\ce{CMe-CMe}$ bond, at first glance it may look like it’s a perfect fit: all four carbon atoms of the ring are put on top of another and the wedge and hash simply switch positions.
However, note that wedge and hash mean something entirely different. In one case, the methyl group is above the paper plane (wedge), in the other, it is below it (hash). The corresponding opposite position is occupied by a hydrogen atom that completes the four valences of the cyclobutane’s carbon. Thus, this plane of symmetry you propose transforms hydrogen onto methyl and vice-versa. It is not a symmetric transformation.
You can maybe visualise this by taking a sheet of paper, marking the bottom left corner with a filled dot (the wedge-methyl group) and the bottom right with a circle (the hash-methyl group). Turn it around and put a circle behind the dot and a dot behind the circle, so that you may identify it from both sides. You may already notice that in both cases the dot is bottom-left while the circle is bottom-right — this already indicates that we have a $C_2$ axis, i.e. we can rotate around an axis that is perpendicular to the $\ce{CMe-CMe}$ bond and in the ring plane.
Prepare a second piece of paper but with the reverse orientation: this is the molecule you created by mirroring along the plane. Now attempt to orient the two pieces in such a way that dot aligns with dot and circle aligns with circle. Spoilers: you will fail. anti-1,2-dimethylcyclobutane is chiral.
You can retry the experiment with the syn-1,2-dimethylcyclobutane, i.e. two dots at the bottom of the sheet of paper (and two circles on the back side). But you should immediately see that another piece of paper with identical dots/circles can immediately be aligned perfectly with the original. Hence, syn-1,2-dimethylcyclobutane is achiral.
This can be explained well with point groups. The anti isomer has the point group $C_2$ which does not feature a plane or centre of symmery. The syn isomer has the point group $C_\mathrm{s}$ whose only element of symmetry is a plane, hence it is achiral. You can read more about point groups in this question.