Mixing in digital domain is not trivial, especially when sources are coming from different codecs. Keeping them in sync and at low latency is a chore. If you want to add different filters to each source, that's yet another bag of problems. Unless the codec itself has tone control filters, you may probably need a DSP capable MCU (with hardware DSP blocks).
I've fiddled once with a DSP board from TI. Their solution was a small DSP MCU (
TMS320C5535 - now obsolete) and a dedicated CODEC that is still in use (
TLV320AIC3204), on the same devboard. Even so, the USB was capable of only 8kHz recording and 16/44k of 2 channels playback. The devboard was named
ezDSP, and that was a lie, it wasn't exactly easy. Its name tricked me into buying the board thinking it will be easy.

Same as you, I was only wanted to step into DSP, after working for a while with microcontrollers.
It was not easy at all. Digital signal processing is way more difficult than microcontrollers. Though, it was a very interesting learning journey. Even after learning the basics, I'm still a newcomer when it comes to DSP. My point is, if you want to learn digital processing, then yes, go ahead with the digital route, but if you only want to make an audio mixer, then use analog electronics. Digital is so much more complicated, both to learn it, then to implement what you learn in a product. And you will be dependent of somebody else's software and libraries. For example, the board I was using is now obsolete, and a few years later there is no software toolchain for it any more, while analog electronics will still be around for many years from now on.
If you buy a devboard, look for something that has plenty of tutorials and examples of how to do the most usual audio tasks. Pick something that has good software libraries and code examples, or else you'll write software for a year and still not have all you need to make a mixer.
For learning filters you can use Octave, which is the same as Matlab but free.
Maybe start with learning filters and DSP first, that will tell you what to expect from the rest of the mixer project, and what hardware you'll need to implement it.Overall, it will take many months to learn DSP and make a functional mixer.
With opamps, mixing and tone correction would be much easier in practice.