Look, realistically, how many do you think you are going to sell? Probably not that many in the scheme of things, not enough that the problems of all the various rules and regulations regarding consumer products are likely to be worth it, no matter what battery chemistry you use, it's a niche product.
My 2c, satisfy yourself that your design is sound, and safe, then sell it as a kit. Let the customer add their own battery, let the customer add their own power supply (or better, just make your kit USB powered).
That product you linked to, that's exactly what they do, it's sold in kit form, probably for much the same reason.
Kits are:
1. Fun for people to assemble
2. Save you a lot of certification type of headaches (well, probably, depends on your local laws I suppose)
3. Cheaper for people (well, marginally these days)
4. Have a long and wonderful history, especially in audio gear.
It's time to bring back the kitset gear I say!