In order to dissolve a salt, you have to break apart the ions and hydrate them in solution. You can use the enthalpies of hydration of the ions, and the crystal lattice energy of the solid, to predict which compounds will dissolve.
I found data that the crystal lattice energy of $\ce{AgCl}$ is -916.3 kJ/mol (experimental), while the lattice energy of $\ce{AgNO_3}$ is -820 kJ/mol. (Since lattice energy is defined as the energy released when the ions join to form a solid, it is always negative. Reverse the sign for the amount of energy you need to put in to break the crystal apart into separate ions in the gas phase.) From this data you can see that it takes quite a bit more energy to break apart the $\ce{Ag+}$ and $\ce{Cl-}$ ions than it does the $\ce{Ag+}$ and $\ce{NO3-}$ ions, presumably because the chloride ion is smaller and more tightly held. If the enthalpy of hydration value is about the same for the two cases (I couldn't find actual values), then it may not be enough to overcome the extra energy needed to break up the ions.
So, both enthalpy of hydration and crystal lattice energy are important considerations for solubility.There is quite a nice discussion about how to think about solubilities of salts, and what factors affect solubility using a Born-Haber cycle, in this reference.
Added this paragraph to the answer after putting it in the comments below first.
Calculation from enthalpy of hydration data (-850.7 for $\ce{AgCl}$ and -794.4 for $\ce{AgNO3}$ says that $\ce{Cl−}$ is the more soluble ion, by -61.3 kJ/mol (since the contribution from solvation of $\ce{Ag+}$ would be the same in each case). Nitrate would be the less soluble ion (from energy concerns) in agreement with Fajan's rules. The enthalpy of hydration data was obtained from problems in a chemistry book.