Safety Warning
Caffeine is a toxic substance. When following the advice below, always keep in mind the factors that will help you kill yourself if you are not careful! For more details you can start out on Wikipedia.
Supersaturation
Your idea of preparing a supersaturated solution is not that bad, but it might be that you have some nucleation sites in the bottle where you want to store it. Furthermore, it is probably not that easy to transfer the supersaturated solution from the container where you prepared it to the vial.
Acidic Medium
I've come across this PDF that mentions something interesting:
Solubility in water is increased by adding dilute acid (e.g. HCl or citric acid).
It would be very easy to prepare an acidic solution (I'd aim at a pH of about 3 or so, in the general vicinity of energy drinks and Coca Cola, beverages known to contain large amounts of caffeine) from some citric acid¹ and dissolve caffeine in there. Maybe you could even conduct a study about the solubility of caffeine at different pH values!
Water/Ethanol Mixture
There is one dissertation (PDF) that touches on the solubility of caffeine in a mixture of water and ethanol. I wouldn't trust it too much, since it was written using MS Word and contains several formatting errors (it says $K_{ow}$ for example, instead of $K_\text{ow}$). The graphic containing the data can be found on page 52, but for your convenience it is reproduced below:
(Seriously, the figure caption is useless, and the plot is so bad I'm tempted to redo it just for this answer.)
Never mind the linear relationship that is indicated by the line, the diamonds are the important part here. As you can see, there seems to be a solubility maximum at around $x=0.5$, where $x$ is the volume fraction of ethanol in the water-ethanol mixture. So that's a whopping 50 vol.-% of ethanol, about equivalent to a cask-strength whisky!
However, it is probably not a good idea to use this knowledge to its fullest, because that will be quite a lot of ethanol, and as already mentioned in the comments it is probably not very wise to combine the consumption of caffeine with ethanol.
Does it have to be dissolved?
There are also caffeine tablets and pills that you can take. They come with the additional guarantee that some FDA-like agency has looked into the production of these products, so you can assume they are safe to ingest. Also, they come with instructions and more than enough warning labels so you can educate yourself further.
Conclusion
If you really want a caffeine solution, it is probably your safest and best bet to create an acidic solution where you can dissolve above-normal (i.e. pH=7) amounts of caffeine.
¹ Though please do not ask here how to calculate the amount you need, that would be considered a homework question and get deleted pretty quickly...