Richard Feynman alludes to this exact problem in the first volume of the Feynman Lectures on Physics. I'll present his argument here (based on the Uncertainty Principle), albeit, in my own words ;)
The German physicist [since he dealt with atomic chemistry/physics...by all means, go ahead and call him a "chemist" ;) ], Werner Karl Heisenberg came up with what we now know as "The Heisenberg Uncertainty Principle"... a revolutionary idea that points to an "inherent fuzziness", that exists within quantum systems (which is a fancy word that refers to any region of space that is sufficiently "small" enough to introduce wave-particle duality), and becomes apparent when we try to "measure" the various parameters that constitute them.
Basically, what (one version of) the Uncertainty Principle states is that:
The product of the uncertainty in measurement of velocity and the uncertainty in measurement of the position of a particle can never be less than a certain constant; i.e- ħ/2

Rephrasing this
If we were to know a particle's position to a very high precision (i.e- small uncertainty in measurement of position) then the corresponding uncertainty in the measurement of the particle's velocity (or momentum, if you know its mass) increases greatly. The same holds true vice versa.
In other words,
You cannot know both a particle's position and momentum in a quantum system to a great precision simultaneously.
Here's a good analogy for this (Part 3: Atomic Structure - Analogy with a ballon)
From this point on, I guess the question can best be dealt with by "proof by contradiction".
First part of the question: Why don't electrons stick to the nucleus?
We know for a fact, that Heisenberg's Uncertainty Principle holds true (yeah, I didn't prove it...but for now, just take my word for it).
So, let's assume that electrons do stick to the nuclei of their respective atoms. In that event, we would know the electrons' positions and momenta (with respect to the nucleus) with almost absolute certainty...something that Heisenberg's Uncertainty Principle does not allow.
Seeing that this situation is impossible, it is obvious that our little "assumption" must be wrong (Knowing the the Uncertainty principle is indeed, correct).
So yeah, electrons don't just go and simply "stick" to atoms.
Second part of the question: Why do electrons follow a whole bunch of wacky paths?
The Dane, Niels Bohr postulated that electrons move in certain, fixed orbits around a nucleus...a fairly convincing (but not very accurate) model that is still often brought up in high-school and under-grad physics and chemistry courses. The Bohr Model was developed before the Uncertainty Principle.
But electrons do not move in fixed orbits ...the Uncertainty Principle triumphs again!
So if electrons don't stick to the nucleus, and if they don't move in fixed orbits around the nucleus, then where exactly are they?
We can never exactly point out an electron's position in an atom. However, we can determine the probability of finding electrons in a given region of space around the nucleus. These regions of space with a very high electron probability density are called orbitals.
This answer has been greatly over-simplified. Thought it does deal with the gist of the topic, I'm personally looking forward to seeing more detailed answers myself.