I put together a portable battery PSU a couple of years ago, and it's been really useful on many occasions. I used a 12V lead acid (because I had several given to me), but you could go lithium if you have them.
Don't have a schematic for my design because it was mostly point-to-point wired. It's basically a simple 317 regulator, but a few things you might want to consider:
I went for a four digit panel meter rather than the more common 3-digit versions (still dirt cheap on ebay), but discovered the current measurement only seemed to work on the return connection. Maybe just this unit, but something to check if you're going to add a display.
A 10-turn pot for adjusting the LM317 is pretty much essential. Also note that there's a drop out voltage on the 317, which can be up around 2V when pulling a lot of current. You will also need a good sized heatsink on the regulator, though they're thermal and current overload protected as standard.
The binding posts are very useful, but be careful buying cheap test leads. They can have a surprisingly high resistance (Mine are about 2 ohms!), which will give a noticeable voltage drop at high currents.
In the photo, yellow is raw battery out, green is battery negative. The red and black are the regulated output, with the black being the current return path that appears on the meter. So I can go from raw battery +ve (yellow) to black and measure the current if I like. There's a toggle switch top-right which shows battery voltage, so I get dual measurement (V & I) regardless of source. (It's all just wiring, the only components are the LM317, two capacitors, a resistor and the 10-turn pot. Check a 317 datasheet for suitable values.)
The blue terminal is a nice touch you might also want to consider. It's hooked up to a LP2950 which is a three-pin precision 5V regulator (+/- 25mV but usually better). Works just like a 317, but only has 100mA current capability. Still very useful though. (If you use microcontrollers, you can feed this to the Aref pin for precision ADC measurements, or even run the whole thing from it.)
Note that you MUST always buy precision components from a reputable supplier! I bought a batch of 2950s off ebay once and none of them was even close to 5V. They're usually under $1 from a good source, so no point cheaping out.
Other than finding (or making) a suitable case, it's a fairly straightforward project. I wouldn't bother with a switched mode supply to start with, though Dave did a nice video on the 34063 a while back if you're interest.