Yup, gotta flash that first program/bootloader before you can do so over whatever bus you implemented.
IIRC with Microchip and possibly others when you ordered thousands of chips you could have them programmed at the factory, but maybe WCH doesn't offer that...
It would be strange if they couldn't do that, for an extra fee. They obviously test them.
You see in the video (2m23s) bitluni sitting down for a drink [1] with WCH CTO @patrick_riscv (reddit u/patrick_riscv) who is a pretty accessible guy and has several times offered to send me samples and devboards for new chips [2]. I even talked with him on an actual phone call once. And I'm just a hobbyist who buys half a dozen chips (maximum a $5 or $7 bag of 50 CH32V003).
Patrick has told me they'll do a customisation on a chip for as little as a 3000 chip order — needing an actual custom mask set — so I'd be surprised if pre-programming chips wouldn't be available if you asked. They're also happy to directly receive orders in multiples of 3000 for any chip they've ever made. It's easy to pull old masks and run off a wafer or ten. Of course this has a lead time of a couple of months.
[1] I want to say it's the Sissi & Franz Bar at MUC but I can be dead wrong on that, I was only there once.
[2] I'm like ... thanks, but I can afford $5 :-) What WCH actually does for free samples is give you a voucher for Aliexpress. However I don't refuse offers of $600 SBCs from people like SpacemiT!