Some hard data: bond enthalpies (in $\pu{kJ mol-1}$)
$$\begin{array}{c|c|c|c} \text{Bond} & \text{Enthalpy} &
\text{Bond} & \text{Enthalpy} \\ \hline
\ce{C-C} & 350 & \ce{Si-Si} & 226\\
\ce{N-N} & 163 & \ce{P-P} & 201\\
\ce{O-O} & 146 & \ce{S-S} & 226\\
\ce{F-F} & 155 & \ce{Cl-Cl} & 240 \\
\end{array}$$
We observe a decrease in bond energy from carbon to nitrogen and from silicon to phosphorus. It is clear and probably have same reason: appearance of lone electron pair of the atom. There is a repulsion between lone pairs, that is in partially compensated by stronger bonds formed by smaller atoms (the atomic radii falls down to the end of the row). When moving from second to third row, this repulsion is reduced thanks to larger size of atoms of the elements of the third row.
The general decrease in energy from carbon to silicon is thanks to increased size of the orbitals of valence level, making them more diffuse with less efficient overlap and longer bond length.
The stability of esters vs thioesters is ruled by different reasons. Sulfur is not as electronegative as oxygen, but when you consider an anion, sulfur anions have larger radius and are less prone to grabbing first positive charge they find. So sulfur anions are more stable intermediates (kinetically), and thus polar dissociation of thioester bonds is easier.