Let's start with the rule of mutual exclusion, it will come in handy. It states that, for centrosymmetric molecules (molecules with a center of symmetry), vibrations that are IR active are Raman inactive, and vice versa.
A linear $\ce{AB2}$ molecule will have $(3n-5) = 4$ vibrational modes, but because it is linear 2 of the modes are degenerate. $\ce{CO2}$ is an example of a linear $\ce{AB2}$ molecule, look at the following diagram showing the 4 vibrations for $\ce{CO2}$ and notice that the bending vibration ($v_2$) is degenerate. That is, there is no difference between those 2 bending modes, they are identical.
Notice too that $v_1$ is the only vibrational mode that does not change the dipole moment of the molecule, therefore it is the Raman active mode. Since the linear molecule is centrosymmetric, the Raman band does not appear in the IR, nor do any of the IR bands appear in the Raman spectrum. Hence, for a linear $\ce{AB2}$ molecule we would expect 2 IR active bands and 1 Raman band. This is consistent with the spectral data you reported.
If the $\ce{AB2}$ molecule is bent rather than linear (water for example), then there are $(3n-6) = 3$ vibrational modes as pictured below. All of these vibrations result in a change in the dipole moment. Therefore, for a non-linear $\ce{AB2}$ molecule, all 3 of the bands will be IR active. Since the molecule is not centrosymmetric all 3 bands may also appear in the Raman spectrum (note: while a change in dipole moment is required for an IR-active band to appear, a change in polarizability is required for a Raman band to appear; looking at the water vibrations pictured, they should alter both the dipole moment and the polarizability of the molecule). Hence, for a non-linear $\ce{AB2}$ molecule we would expect 3 bands in the IR and 3 in the Raman spectrum. This is not consistent with the spectral data you reported above.
In summary, your spectral data is consistent with $\ce{XeF2}$ having a linear geometry.
Note: Thanks to @porphyrin for pointing out that bent $\ce{AB2}$ molecules are indeed not centrosymmetric.