What AV devices do you need to connect?
Reason for my question is, that practically all the consumer AV devices (VCR, DVD, TV etc) I've seen do not provide RGB at the SCART connector, but only CVBS+L+R, so you'd only need a 3-pole switch (plus perhaps the control line)
If you're working with professional equipment, it's a different story, of course.