Elastic deformation properties like stiffness (Young's Modulus) vary very little with alloying element concentration since we are only working on the pre-yield bond strength. A pure iron, a carbon steel and a high alloy steel will only vary by about 15% in stiffness. So elastic properties will, as you suggest, be fairly invariant under small changes in alloy concentration.
But the other mechanical properties - those depending on plastic deformation like yield strength, hardness, toughness - are different in how they are affected by alloy element concentration.
Plastic deformation in metals at ambient temperatures, and below 1/3 of the absolute melting point, is mostly about moving dislocations within the crystal structure. Strengthening therefore means finding effective methods of impeding normal dislocation flow.
Let's look into why alloying helps any metal's plastic yield behaviour.
The word "alloying" may embrace situations where two or more metals exist as a mixture of separate elements. Such mixtures will show modifications of properties roughly representable by a rule of mixtures equation, i.e.
$$ S = v_1 S_1 + v_2 S_2$$ where $v_1$, $v_2$ are the volume fractions of the respective elements.
But alloying in the usual meaningful sense will only occur when the chemical equilibrium prevailing favors either a solid solution or intermetallic phase (e.g. $\ce{Ni3Al}$, $\ce{Fe3C}$, etc) in preference to existing as a mixture of two separate elements. Solid solution alloying can occur in two ways. It can occur when an atom of the minor component element substitutes for one in the crystal lattice of the major component element. This usually happens when the minor component has comparable atomic mass, e.g. nickel in iron.
Solution alloying can also occur if the minor component has a much smaller atomic mass than that of the major component, e.g. carbon in iron. In this case the minor element atoms fit inside the existing iron lattice, a type of solution known as an interstitial solid solution. Of course, a carbon atom within the body-centered cubic form of iron will expand the lattice around it somewhat. So we have an ambient temperature limit of 0.002% by weight (or about 1 carbon atom per 10,000 iron atoms) on how much carbon is soluble within solid b.c.c. iron, known as ferrite or $\alpha$-iron.
A dislocation within a metallic crystal is a mismatch in the usual ordered 3D-repeating arrangement of ions. It is virtually impossible to crystallize any substance without having lots of dislocations within each crystal. More importantly, since a perfect crystal will have all its bonds yield at once, it is the very existence of dislocations that allow crystalline materials to deform plastically under moderate stress rather than break in a brittle mode at a much higher stress. So the yield strength of any crystalline metallic material is effectively the stress under which its dislocations begin to move. If we want to improve the strength of some element, e.g. iron, we need to find a way to impede the movement of dislocations in it.

In the vicinity of a dislocation, the lattice is stretched on the side of the missing half-plane of ions and contracted on the side of the extra half-plane. Interstitial solute atoms within the crystal would therefore - given adequate temperature - tend to diffuse and settle on the expanded side of a dislocation zone since here they create minimal lattice strain energy increase. This is what happens with carbon atoms in iron.
Since the chemical interaction between a carbon atom and surrounding iron ions will be of partly covalent nature there will be significantly greater resistance to dislocation flow under stress and thus a higher yield stress.
Concentrations of carbon ~ 1 per 10,000 iron atoms would equate to one carbon atom per cube of iron crystal with an edge length of 22 interatomic spacings (~ 60 Angstroms). So a single carbon atom alone can significantly restrain dislocation loop movement within that volume and that is more than adequate for normal dislocation densities observed in carbon steel.
Another factor affecting dislocation impedance is the other carbon-containing phase in carbon steels, i.e. $\ce{Fe3C}$ or cementite. This phase precipitates simultaneously from $\gamma{}$-iron (austenite) or carbon supersaturated ferrite as it cools. This type of simultaneous solid-phase precipitation is referred to as eutectoid decomposition. Eutectoid pair phases are very finely mixed and often show a fixed relationship between their crystal orientations. In the case of carbon steels, the eutectoid mix consists of very fine alternating lamellae of ferrite and cementite. Being so close any dislocation movement towards the edge of the ferrite will be mechanically blocked by the neighboring cementite lamellae.
So the nominally "small" additions of carbon to pure iron will have two important effects in restraining dislocation advance and therefore strengthening the material:
The interstitial solubility of carbon in the ferrite b.c.c. lattice which locates carbon atoms in the "pipes" of dislocations where their partly covalent bonding with neighboring iron atoms on the extra half-planes requires a greater shear stress to move the dislocations within ferrite grains.
The close lamellar morphology of the ferrite/cementite eutectoid mix resists dislocation movement out of ferrite grains.
You have asked a seemingly simple question.
But the proper answer is long, involved and demands close study of a number of aspects of physical metallurgy. If your work requires a better understanding of this topic, please consult texts like those by Reed-Hill & Abbaschian and Cahn & Haasen at your local university library.