One of the many esp32 boards with an SD card built in. No need to wire it up.
If you want something direct from Adadfruit, check the 'metro'.
Supports circuit python, arduino or the proper esp-idf.
There is a jst battery connector and has a charter on board.
Quite a big board to me, I have a bunch of older esp32 boards with sd cards and charging connectors and hardware but the AdaFruit one would be easy to get going.
Edit: I didn't see you wanted a display built in. In that case I would go got a lilygo. They have boards with charger, SD card and display. You won't get as good micropython support but they work without much trouble from platform.io. Even the displays are pretty easy to get to work.
I don't have one of these but they look like good fun, epaper, sdcard and charger:
https://www.lilygo.cc/products/t5-v2-3-1