Yes, we've been fighting this for decades.
You plug in some serial device into a Windows box and Windows says, "OMG, it must be a serial mouse!"
Yes, you can disable the service, but it might get turned on behind your back.
All of this stuff is protected with the Windows SFC.
My solution is to copy and edit \Windows\INF\msmouse.inf
Remove anything that you distrust, especially sermouse and anything that is not HID.
Then you need to "takeown" of the destination, copy the file over and "icacls" it to have only read permission.
Finally, go to devmgmt.msc, View > Show Hidden Devices and delete anything that you don't like.