When it comes to resistors, you should buy an entire "series" (
https://www.electronics-notes.com/articles/electronic_components/resistors/standard-resistor-values-e-series-e3-e6-e12-e24-e48-e96.php )
E12 contains all the values you will use _a lot_, and E24 should get you covered for pretty much 99% of your needs.
Keep in mind that the series also contains "decades", so when it says "2.2", they mean:
2.2ohm, 22ohm, 220ohm, 2.2Kohm, 22Kohm, 220Kohm, 2.2Mohm (I think some resistor-kits go into the Gohm range, but that's very rarely used)
E12 = 12 values, 7 decades = 84 different kinds of resistors
E24 = 12 values, 7 decades = 168 different kinds of resistors
As for capacitors, I'm not sure if there exists series like that, but your usage would vary _a lot_ by what you're building.
Since I do mainly digital stuff, I mainly use just a few values:
* 10-22pF ( For crystals )
* 0.1uF ( Decoupling. I use _a lot_ of these, like 10+ per board )
* 10uF ( Bulk capacitance, a few per board )
* 0.8pF 1.0pF, 1.5pF, 2.2nF ( Matching network for 2.4GHz )
Now, if you were doing audio-work, you'd probably have a whole different set of capacitors laying around.

And finally.. Have you thought about how you're going to keep all of this organized? That's not as easy as it sounds..