I am confused as to when exactly I should use the mass of the entire solution instead of the mass of the reactants in my Q = mc∆T and ∆H = ±Q/n calculations.
Ideally, you always take the mass of the entire solution, and the heat capacity of the product mixture. The two questions tell you what assumptions to make with respect to the heat capacity. There are other assumptions you also have to make, even if they are not stated.
[top question] ... assuming that the specific heat capacity of the solution is $\pu{4.18 J/(g ^{\circ}C)}$.
The instructions are straightforward. You know the mass of the product mixture (conservation of mass) and the assumed specific heat capacity. This is a dissolution process, indicated by the subscript "soln", i.e. $\Delta H_\mathrm{soln}$. The first sentence in the problem description should read "enthalpy of dissolution" instead of "enthalpy of solution" to be less confusing.
[bottom question] Assume the density of the solution is $\pu{1 g/mL}$ and the and the specific heat capacity is the same as that of water.
Here, solution refers to the product mixture. You have to make an additional assumption, namely that the volume of the product mixture is equal to the sum of the volumes of the reactants. For the given situation, you are not making a big systematic error assuming that. With this assumption, you can calculate $Q$.
What $Q$ are we calculating?
The reactants are at a certain starting temperature, and the product mixture are at a different temperature. In a thought experiment, you could heat up or cool down the product mixture back to the starting temperature. That is the magnitude $Q$ you are calculating (opposite sign, though). Because the entire mixture is "too" hot or cold, the mass (and specific heat capacity) of the entire product mixture needs to be considered.
Approximations in other problem sets
In other problems, you are instructed to consider the mass of water instead of the mass of the entire product mixture. This is a fine approximation for diluted solutions. In rare cases, problems such as this give you a more realistic value for the specific heat capacity of the product mixture instead of asking you to use the value for water. Again, using the value for pure water is fine for diluted solutions.