If you are new to this, you need to consider how the final device will be put together. I'm just a hobbyist, so a lot of these parts that only come in hobbyist-unfriendly packages are just out of bounds for me. The MCP1700 actually comes in a through-hole TO-92 package, as well as the usual SMD versions. The tiny little switching converters generally do not. Of course these days I guess you can get JLCPCB or the like to build the device for you, but where's the fun in that?
You will find that a big opportunity for saving battery power is to arrange for your processor to sleep most of the time. And generally it only matters what percentage of the time it sleeps. For example, if you sleep for 9ms, and wake for 1ms, you might think that's not sleeping for very long, but in fact it's still sleeping 90% of the time, so well worth doing.