So to get my RAID server back up I decided to just go with 2 x 3TB disks in a simple mirror.
I bought the WD Red 3TB drive, WDC WD30EFRX-68EUZN0, and a Toshiba 3TB DT01ACA300
After 72 hours of continuous write/read/compare patterns of 0x55,0xAA,0xF0, 0x0F, 0x00 it was all fine on both drives. Smart data showed 0 for the important metrics, and on both drives. So I feel safe to use these drives.
196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0
197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0
However, the WD drive had UDMA_CRC_Error_Count = 36 , while the Toshiba drive had this value at 0 still.
Should I suspect a cable problem? I'm currently swapping the cable and re-running the tests to see if the CRC errors go up on the other drive now, but the tests takes 9 hours to complete 1 pattern. However, with 36 CRC errors in 72 hours I expect to see 1 new error every 30 minutes
So it could be a cable, or a drive, or a controller problem.. If it moves with the cable I'll know. If it stays with the drive it could be a controller or a drive problem, so I'll switch controllers then to rule that out.