Products > Computers
PC for software development - recommendations please!
SiliconWizard:
--- Quote from: Nominal Animal on June 04, 2023, 02:05:28 pm ---Nevertheless, my next desktop/HPC machine will have dual SSD for storage; partially RAID-[01]. I have some very large continuous datasets (hundreds of megabytes) that I'd like to see how fast I can chew trough, mostly MD simulations and such; I'm really looking forward to 1GB/s+ transfer rate for those...
--- End quote ---
A reasonably good single NVMe SSD on PCIe 4.0 will give you close to 7GB/s. And on PCIe 3.0 about half of that. Of course on large transfers, not small random blocks.
Nominal Animal:
--- Quote from: SiliconWizard on June 04, 2023, 10:59:33 pm ---
--- Quote from: Nominal Animal on June 04, 2023, 02:05:28 pm ---Nevertheless, my next desktop/HPC machine will have dual SSD for storage; partially RAID-[01]. I have some very large continuous datasets (hundreds of megabytes) that I'd like to see how fast I can chew trough, mostly MD simulations and such; I'm really looking forward to 1GB/s+ transfer rate for those...
--- End quote ---
A reasonably good single NVMe SSD on PCIe 4.0 will give you close to 7GB/s. And on PCIe 3.0 about half of that. Of course on large transfers, not small random blocks.
--- End quote ---
I dropped a zero there, I think! :D
My current SSD, Samsung PM961, maxes out at 3 GB/s. I've been looking at the Samsung 980 Pro series, which also has about 3x the 4k random read rate than PM961, which should help in compiling things. (I am aware of the 3B2QGXA7 firmware being a big problem.)
It'd also be very interesting to see if RAID-1/mirroring still helps in random small file read cases in Linux, like compiling stuff.
SiliconWizard:
--- Quote from: Nominal Animal on June 05, 2023, 12:04:05 am ---
--- Quote from: SiliconWizard on June 04, 2023, 10:59:33 pm ---
--- Quote from: Nominal Animal on June 04, 2023, 02:05:28 pm ---Nevertheless, my next desktop/HPC machine will have dual SSD for storage; partially RAID-[01]. I have some very large continuous datasets (hundreds of megabytes) that I'd like to see how fast I can chew trough, mostly MD simulations and such; I'm really looking forward to 1GB/s+ transfer rate for those...
--- End quote ---
A reasonably good single NVMe SSD on PCIe 4.0 will give you close to 7GB/s. And on PCIe 3.0 about half of that. Of course on large transfers, not small random blocks.
--- End quote ---
I dropped a zero there, I think! :D
--- End quote ---
Ha, then sure!
--- Quote from: Nominal Animal on June 05, 2023, 12:04:05 am ---It'd also be very interesting to see if RAID-1/mirroring still helps in random small file read cases in Linux, like compiling stuff.
--- End quote ---
I'd be curious to see that. How could RAID-1 achieve that?
Nominal Animal:
--- Quote from: SiliconWizard on June 05, 2023, 01:57:52 am ---
--- Quote from: Nominal Animal on June 05, 2023, 12:04:05 am ---It'd also be very interesting to see if RAID-1/mirroring still helps in random small file read cases in Linux, like compiling stuff.
--- End quote ---
I'd be curious to see that. How could RAID-1 achieve that?
--- End quote ---
On software RAID-1, the kernel does a read on only one drive, not both. Remember, there is no compare on reads. Although writes must be duplicated on both drives, reads only access one of the drives, so as long as the workload is mostly reading small files and the I/O scheduler is smart enough to read from both drives, the overall small file random 4k-reads-per-sec increases. In theory, it doubles.
SiliconWizard:
--- Quote from: Nominal Animal on June 05, 2023, 02:44:30 am ---so as long as the workload is mostly reading small files and the I/O scheduler is smart enough to read from both drives,
--- End quote ---
That's the part I had no idea about. Does it actually do this?
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version