The reasoning you gave for the increasing acidity of hydrides of group $15$ down the group is not the best one. You claim that less polar bonds are easy to break which is absolutely wrong. Non-polar covalent bonds are very difficult to break (think of beaking $\ce{C-H , N-H , O-H }$ bond, which is easier to break ?)The logic can be modified as follows.
Actually the basicity of those hydrides decrease down the group, which in turn results in the increase of acidity of them. The reason for decrease in their basicity down the group is the increase in inability to donate their lone pair to accept the proton. In $\ce{NH3}$, the lone pairs recide in the $sp^3$ hybrid orbitals, whereas for other hydrides like $\ce{PH3 , AsH3 , BiH3}$ the lone pairs recide almost in pure $s$ oritals (i.e. the hydrogen atoms are bonded to almost pure $p$ orbitals). So, as the $s$ character of the orbital where the lone pair is residing increases, it becomes closer and tightly bound to the nucleus, and thus difficult to protonate. Thus the basicity of group $15$ hydrides decreases down the group, alternatively, the acidity increases.
Coming to the case of $\ce{PH3 , H2S}$ and $\ce{HCl}$, two factors govern the acidity of them. One is the ease of bond-dissociation, and other is the solvation of the medium. When you consider the gas-phase acidity, i.e. no solvation is present, the bond-energy will only be the determining factor and bond energy is given as, $\ce{P-H < S-H < Cl-H}$ (easily justifiable by decreasing size of central atom), which tells us in gas phase the acidity of $\ce{PH3}$ should be the highest. But normally when we talk about acidity, we talk about $pK_a$ in water. Whenever there is a medium, it stabilises the dissociated species via solvation (in water , this is hydration). As. the size of the conjugate base decreases across the period, the extent of hydration energy released will dominate over the bond-dissociation energy. Chloride is the smallest ion among them having higher electronic charge density, and $\Delta H_{hyd} \propto \frac{1}{r} $, It is highest for hydrolysis of $\ce{HCl}$, making it a stronger acid among three.