I'm sorry, I didn't realize there was need for a schematic.
This is a rough draft of what I'm thinking of:

Left the input buffer, in the center the audio switch and on the right the output buffer. These are the building blocks to make an audio matrix.
The idea is to build a matrix of at least 16x16. The switch enable will be driven by a couple of 4094 (at +/- 7.5V) - serial to parallel shift regs. Those will be driven by a MAXIM 1488E that will take logical 5V at the input and can output +/-7.5V. The logic serial signals will be generated by an MCU. Currently thinking in terms of some sort of AVR but that's just because I'm unfamiliar with the PIC. Have not done a detailed analysis of what I need, because I do not consider it a problem. There will also be a Midi interface that is handled by the MCU to allow for patch recall on a Midi Program Change.
The audio matrix is usable in itself (and I will probably build one for my own home studio) but the initial idea was for use in a guitar (multi) effect rack, where the signal flow through each effect can be programmed.
The audio switch perhaps requires some extra explanation:
- I use 4x 4066 switches to make one audio switch (so thats one chip per audio switch).
- The reason for this is cross talk: there is no cross-talk if you route the audio signals through different die's.
- I use 2 parallel 4066 switches to lower distortion.
- I connect the signal to ground in off-state (better off-state, less leakage)
- Leftover switch is used as an inverter.
Hope this clears things up a bit.