What you're describing is a common DC UPS, I've designed dozens of them over the years, mostly 24VDC. Yes, they will do the job you ask BUT you need to consider a couple things. Depending on the chemistry, they do NOT filter out HF ripple very well, it'll just pass straight through, so you'll still need the usual HF / MF decoupling caps at the battery, and ideally a common mode choke / filter after the battery and before the regulator / load. IF you are drawing high surge currents, then a large low ESR cap is STILL recommended. Different regulator types also vary on how well they attenuate HF noise etc, and if you need more filtering after the regulator.
What is you load / current profile ? and what are you trying to filter out ?