Well, it is. That's why for example the Porsche 911 (two-seater Carrera model) only comes as
standard with driver and passenger airbags - the minimum legal requirement - despite it costing a lot more than for example a Ford Focus, which as
standard comes with side and driver/passenger airbags for the driver as well as rear passengers. (Yes rear passengers don't matter in a 2-seater car; the 911 doesn't have driver side protection either.) This is one example of many. The crumple zones will be minimised as they add weight and size to the vehicle, so the vehicle won't perform as well in a crash. People who buy such cars understand that they are taking a risk. They consider that risk acceptable. (I probably would too.)
This is nothing against Porsche. I'm just noting that in general rear or mid engined cars are optimised for performance rather than safety in an accident (less active safety, more passive safety - good brakes/suspension etc.) So it's NOT a valid comparison to say that because mid/rear engined cars appear less safe, does not mean the engine position has made this difference. (Correlation != Causation...)
When a performance car manufacturer moves to a carbon-fibre frame for example, again, that's reducing weight, improving rigidity but reducing crash safety, because it's more likely to crack or shatter in an accident, leading to a faster deceleration.