You make it sound like any software engineering or electronics
is work. For me (and I guess many others here) it also a hobby (or 'therapy').
Sure use the most preconfigured environment you can find where you only have to initialize a library and it does everything for you. Great, you got the application done in no-time. You have full bragging rights. 2 months later, a strange bugs arises and it's inside some library or closed module that you adopted. You don't know anything about how the program gets compiled on the particular platform, optimized, how the library exactly works, etc.
As a a general rule: everything you integrate in your product is something you become responsible for maintaining & servicing, even it's a completely closed box to you. You're just screwed if a serious bug arises and you don't know much about it or better: you are not the person to solve it (because you don't have the source code/schematics). Hooray for dependencies.
For example, at work we had this RF modem that locked up occasionally when we switched RF channels/protocol. Some customers were outrageous with our system. We communicated proactively with the manufacturer of the modem, and the response we got after 12-months of troubleshooting back-and-forth (with many stupid did-you-plug-it-in questions in between) was: we have problems with this RF broadband SoC which locks up, and the manufacturer of that chip is unable to fix their firmware problem. Unfortunately our HW does not have the RF SoC reset line connected to our uC.
A deeper understanding will give more control and flexibility over your projects. I'm still not certain where you're going with this "I only care about getting the job done", in a thread that's clearly about setting up an environment for home/hobby projects, which IMO is about learning & experiencing.
Back on topic:
I'm also getting into Linux, and it seems like AVR & ARM have pretty good GCC toolchains. Microchip supplies a full IDE that runs on Linux, but the compilers are separate installation. I guess you could easily write your own makefiles for them , there is even a command-line debugger utility (not GDB though).
However, for any toolchain I still prefer debug functionality , which especially handy for debugging device drivers. So I probably will try MCP and ARM (STM32F4) first.