Author Topic: The end of the Hard Disks  (Read 15724 times)

0 Members and 1 Guest are viewing this topic.

Offline David Hess

  • Super Contributor
  • ***
  • Posts: 16548
  • Country: us
  • DavidH
Re: The end of the Hard Disks
« Reply #25 on: July 18, 2022, 10:54:05 pm »
Hard drives still have a place where greater capacity for a given cost is required and lower performance is acceptable.  High capacity SSDs are not only expensive, but have compromised retention and endurance.  MLC is a good compromise on retention and endurance but limits SSD capacity.

The increasing problem with hard drives is that their capacity has increased more than their speed, so rebuild time in RAID has become long enough to compromise RAID reliability.  Managed filesystems like ZFS should improve this situation but are not universally supported.

My PCs boot from HDD RAID which is also used for bulk storage, and SSDs are used for portable storage.  I do *not* use SSDs for scratch space because I found that it was wearing through their endurance too quickly, and that was with better MLC SSDs.
« Last Edit: July 18, 2022, 10:57:45 pm by David Hess »
 

Online bd139

  • Super Contributor
  • ***
  • Posts: 23018
  • Country: gb
Re: The end of the Hard Disks
« Reply #26 on: July 18, 2022, 11:01:15 pm »
Capacity vs endurance is rarely a problem. How often do you write a whole TB disk?
 

Offline David Hess

  • Super Contributor
  • ***
  • Posts: 16548
  • Country: us
  • DavidH
Re: The end of the Hard Disks
« Reply #27 on: July 18, 2022, 11:07:12 pm »
Capacity vs endurance is rarely a problem. How often do you write a whole TB disk?

It *was* a problem for me, and that was with better MLC disks than the cutting edge higher capacity devices which have a worse endurance.  Buying larger devices increases the endurance for a given throughput, but costs proportionally more.  I was writing the "whole device" quickly enough to burn through it in a year, versus the 5 year warranty.
 

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #28 on: July 18, 2022, 11:27:43 pm »
Capacity vs endurance is rarely a problem. How often do you write a whole TB disk?

It depends what you are doing. With normal PC use, it's probably at the most 4TB per powered on year. Even for a rubbishy SSD, that's decades, so wear out is hardly a problem. Video editing does a lot of writing. Regular backups to disk involve a lot of writes. Surveillance involves massive mounts of writes.
 

Offline SiliconWizard

  • Super Contributor
  • ***
  • Posts: 14309
  • Country: fr
Re: The end of the Hard Disks
« Reply #29 on: July 18, 2022, 11:37:50 pm »
And for "data centers", there is an enormous amount of writes.
 

Online Circlotron

  • Super Contributor
  • ***
  • Posts: 3168
  • Country: au
Re: The end of the Hard Disks
« Reply #30 on: July 19, 2022, 12:06:28 am »
I think the tipping point is here.  I was surprised by how fast CRTs disappeared after introduction of LCDs.  Hard drives won't die quite as quickly, but I think if you look around in five years you will find spinning disks only in specialty markets.
Let's hope the same mentality that thinks vinyl records are superior to properly done  CDs doesn't prevail here also.
 

Offline Halcyon

  • Global Moderator
  • *****
  • Posts: 5632
  • Country: au
Re: The end of Hard Disks
« Reply #31 on: July 19, 2022, 12:23:42 am »
harddisks are irreplaceable for long-term backups!

if you leave a MLC SSD unpowered and uncooled for some years,
you will see massive data corruption.

SSDs need to be powered up regularly, so the firmware can do a background refresh data of flash cells that leak.

The SSD problem gets worse as the TBW increases, and it's much worse with QLC.

You get bit decay in HDDs too, as the magnetisation patterns decay over time. It's as well to do a read/rewrite in place about every year.

SSD lifetime for most consumers far exceeds the life of the whole computer. I still have SSDs in use that are about 10 years old and the wear indicator shows minimal wear.

As for hard drives, I've never had to re-write data. I've had data sitting on my old NAS for about 12 years without a problem (ZFS routinely checks for data corruption). I have drives that are over 25 years old that still read perfectly fine.

These issues just don't seem to manifest in normal usage.
 

Offline David Hess

  • Super Contributor
  • ***
  • Posts: 16548
  • Country: us
  • DavidH
Re: The end of the Hard Disks
« Reply #32 on: July 19, 2022, 01:12:57 am »
Let's hope the same mentality that thinks vinyl records are superior to properly done  CDs doesn't prevail here also.

Unlike magnetic storage, optical storage did not continue scaling because the diffraction limit for the optics was reached.  Increased density now requires a better numerical aperture or shorter wavelength, and those have already been stretched.  I doubt there will be a generation after Blu-ray.  I wonder what happened to near field recording.  Magneto-optical drives already used tricks like heat assisted recording and scalloped recording and topped out long ago.

Flash has its own scaling limit which has nothing to do with feature size.  The floating gate memory cells eventually lack a long enough retention to be useful.  The smallest logic process with floating gate memory is currently 28 nanometers.  3D Flash made a huge improvement in density.

Hard drives have the paramagnetic limit which has been reached, but there are several options being used to do better so further improvement will happen.
 

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #33 on: July 19, 2022, 09:36:37 am »
I think the tipping point is here.  I was surprised by how fast CRTs disappeared after introduction of LCDs.  Hard drives won't die quite as quickly, but I think if you look around in five years you will find spinning disks only in specialty markets.
Let's hope the same mentality that thinks vinyl records are superior to properly done  CDs doesn't prevail here also.

The esoteric audio scene revolves around various things, usually expensive and with no engineering basis, which are supposed to enhance the sound quality by subjective measures. My favourite is "sonically competent mains leads". It's not the same with data storage. HDDs the size of a washing machine, with a 1.25 kW power consumption and a capacity of 500MB are not going to become sought after, because the bits have "almost overpowering presence".

There are rational reasons for continuing to use HDDs in some areas. It's hard to see them being supplanted in surveillance systems for a long time. Maybe within five years, USB external drives for backup will disappear.

Intel's Optane doesn't have the endurance problems of Flash SSDs, but it's very expensive.
 

Online bd139

  • Super Contributor
  • ***
  • Posts: 23018
  • Country: gb
Re: The end of the Hard Disks
« Reply #34 on: July 19, 2022, 09:44:45 am »
I just asked our ops guys what they use in our CCTV box. It’s 4x Crucial MX500 2TB SSDs  :-//
 

Online Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11537
  • Country: my
  • reassessing directives...
Re: The end of the Hard Disks
« Reply #35 on: July 19, 2022, 11:39:04 am »
You can brag about your company hard earn money or for business purpose ssd.. but ssd price is still 5-10x, no.. hdd wont die anytime soon.
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 
The following users thanked this post: DiTBho

Online bd139

  • Super Contributor
  • ***
  • Posts: 23018
  • Country: gb
Re: The end of the Hard Disks
« Reply #36 on: July 19, 2022, 11:41:43 am »
They bought them because the 6TB HDD in the box died after 3 months. Not having CCTV coverage was riskier than paying out.
 

Online xrunner

  • Super Contributor
  • ***
  • Posts: 7499
  • Country: us
  • hp>Agilent>Keysight>???
Re: The end of the Hard Disks
« Reply #37 on: July 19, 2022, 11:55:02 am »
They bought them because the 6TB HDD in the box died after 3 months. Not having CCTV coverage was riskier than paying out.

Earlier this year I got a new security camera system (old one finally failed). The cams use a wireless link and the main unit has nice big display and has (or shall I say had) a 3 TB HDD for data storage (not to run the system). After I got it running I had to check inside and have a look. The HDD is user replaceable but after I shut it off and touched the HDD it was literally so hot it wasn't fun to handle. After a few weeks the HDD just failed. They sent me another HDD but it got really hot the same. I wondered if the thing would format an SSD (the HDDs use SATA) so I bought one - figured if it didn't work I'd use it in a PC. Well it formatted fine and so far no problems, plus it uses less energy.
I told my friends I could teach them to be funny, but they all just laughed at me.
 
The following users thanked this post: bd139

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #38 on: July 19, 2022, 12:21:29 pm »

Earlier this year I got a new security camera system (old one finally failed). The cams use a wireless link and the main unit has nice big display and has (or shall I say had) a 3 TB HDD for data storage (not to run the system). After I got it running I had to check inside and have a look. The HDD is user replaceable but after I shut it off and touched the HDD it was literally so hot it wasn't fun to handle. After a few weeks the HDD just failed. They sent me another HDD but it got really hot the same. I wondered if the thing would format an SSD (the HDDs use SATA) so I bought one - figured if it didn't work I'd use it in a PC. Well it formatted fine and so far no problems, plus it uses less energy.

If you have an HDD with a max power dissipation of about 6W getting hot like that, it sounds like bad engineering.
 

Offline DiTBho

  • Super Contributor
  • ***
  • Posts: 3796
  • Country: gb
Re: The end of Hard Disks
« Reply #39 on: July 19, 2022, 12:22:09 pm »
DDS2 is only 4GB per cartridge

my DVDRAMs are also 4GB per cartridge, practically 4GB is *the* unit of my backups, more than enough for text, C and vhdl sources  :D

The opposite of courage is not cowardice, it is conformity. Even a dead fish can go with the flow
 

Online xrunner

  • Super Contributor
  • ***
  • Posts: 7499
  • Country: us
  • hp>Agilent>Keysight>???
Re: The end of the Hard Disks
« Reply #40 on: July 19, 2022, 12:44:18 pm »

Earlier this year I got a new security camera system (old one finally failed). The cams use a wireless link and the main unit has nice big display and has (or shall I say had) a 3 TB HDD for data storage (not to run the system). After I got it running I had to check inside and have a look. The HDD is user replaceable but after I shut it off and touched the HDD it was literally so hot it wasn't fun to handle. After a few weeks the HDD just failed. They sent me another HDD but it got really hot the same. I wondered if the thing would format an SSD (the HDDs use SATA) so I bought one - figured if it didn't work I'd use it in a PC. Well it formatted fine and so far no problems, plus it uses less energy.

If you have an HDD with a max power dissipation of about 6W getting hot like that, it sounds like bad engineering.

Attached is pic of 3TB HDD removed from security cam system. Do you know anything about this brand? I never had any HGST brand before this system.
I told my friends I could teach them to be funny, but they all just laughed at me.
 

Online bd139

  • Super Contributor
  • ***
  • Posts: 23018
  • Country: gb
Re: The end of the Hard Disks
« Reply #41 on: July 19, 2022, 01:05:49 pm »
HGST are Hitachi. They were originally IBM but sold off in 2003 after the whole Deskstar (Deathstar) click of death issues.

No comment on them recently. YMMV as always.
 
The following users thanked this post: xrunner

Offline NiHaoMike

  • Super Contributor
  • ***
  • Posts: 8973
  • Country: us
  • "Don't turn it on - Take it apart!"
    • Facebook Page
Re: The end of the Hard Disks
« Reply #42 on: July 19, 2022, 01:16:14 pm »
I don't think it will be long before 2.5" HDDs get completely replaced by SSDs in the market, the cost per TB difference is becoming quite narrow. 3.5" HDDs are here to stay for the foreseeable future.
Cryptocurrency has taught me to love math and at the same time be baffled by it.

Cryptocurrency lesson 0: Altcoins and Bitcoin are not the same thing.
 

Online tunk

  • Frequent Contributor
  • **
  • Posts: 969
  • Country: no
Re: The end of the Hard Disks
« Reply #43 on: July 19, 2022, 01:23:50 pm »
https://en.wikipedia.org/wiki/HGST
According to Backblaze some of them have a relatively low failure rate:
https://www.backblaze.com/blog/backblaze-drive-stats-for-q1-2022/
And I have 12 HGST Deskstar 6TB NAS (HDN726060ALE614) in a Dell
md1200 running 45k hours without problems.
 

Online bd139

  • Super Contributor
  • ***
  • Posts: 23018
  • Country: gb
Re: The end of the Hard Disks
« Reply #44 on: July 19, 2022, 01:26:32 pm »
Backblaze stats don't track MTTF / MTBF properly. There should be a statistical failure distribution for each drive type and they should be comparable.
 

Offline madires

  • Super Contributor
  • ***
  • Posts: 7695
  • Country: de
  • A qualified hobbyist ;)
Re: The end of the Hard Disks
« Reply #45 on: July 19, 2022, 01:28:31 pm »
My guess is that SSDs will keep replacing HDDs in many applications. However, in areas where price or write endurance matters HDDs will prevail until SSDs can compete here too.
 

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #46 on: July 19, 2022, 02:27:00 pm »

Attached is pic of 3TB HDD removed from security cam system. Do you know anything about this brand? I never had any HGST brand before this system.

HGST was IBM's HDD business.  IBM did very well in the early 3.5" 1" high market and then they had two disastrous products, with huge failure rates - Deskstars aka Deathstars. Then they sold the business to Hitachi. It carried on under Hitachi for a few years and then it was sold to Western Digital. It carried on under WD semi autonomously and their products were directed toward the server end of the market.

Last I looked HGST HDDs had the best reliability stats at about 1% annual failure rate, Toshiba were next at about 4%, then came WD and Seagate at much higher rates - around 10% of the top of my head. These were at best crude figures, because the market is very segmented.
 
The following users thanked this post: xrunner

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #47 on: July 19, 2022, 02:47:47 pm »
I don't think it will be long before 2.5" HDDs get completely replaced by SSDs in the market, the cost per TB difference is becoming quite narrow. 3.5" HDDs are here to stay for the foreseeable future.

2.5" HDDs are really aimed at the laptop market. The typical laptop drives are 5400rpm (slow) because of the power and heat dissipation requirements, and were designed to take rough treatment, even while running, but that was always going to be a difficult engineering challenge. SSDs are much faster, vastly more robust, and use a bit less power.

I really can't see why the 2.5" HDD market still exists. You can buy a very respectable 1TB 2.5" SATA drive for about £75 and the mechanical 2.5" drive equivalent - inferior in just about every way - starts from about half that much. I suppose some people just have to have the cheapest..
 

Online Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11537
  • Country: my
  • reassessing directives...
Re: The end of the Hard Disks
« Reply #48 on: July 19, 2022, 03:07:11 pm »
otoh it is agreed that hdd for OS is extinct, esp the 2.5" laptop.  the price of 120-480GB ssd is bearable and really worth it for OS performance. Anybody who still choose hdd for OS, even for 3.5" PC, albeit they have the full right to do whatever with their own body, have choosen to stay behind in dinasour age and unaware that they are crippling themselves. I was talking data storage 4TB and above for hdd still applicable. 30TB ssd?  You can brag any goodness in it, you cant afford it.
« Last Edit: July 19, 2022, 03:08:53 pm by Mechatrommer »
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 

Offline Zenith

  • Frequent Contributor
  • **
  • Posts: 447
  • Country: england
Re: The end of the Hard Disks
« Reply #49 on: July 19, 2022, 03:28:32 pm »
otoh it is agreed that hdd for OS is extinct, esp the 2.5" laptop.  the price of 120-480GB ssd is bearable and really worth it for OS performance. Anybody who still choose hdd for OS, even for 3.5" PC, albeit they have the full right to do whatever with their own body, have choosen to stay behind in dinasour age and unaware that they are crippling themselves. I was talking data storage 4TB and above for hdd still applicable. 30TB ssd?  You can brag any goodness in it, you cant afford it.

I was just looking at ready made desktop PCs on ebuyer at less than £700. Most have a 256GB or 512GB SSD only. Very few have both SSD and HDD, or just HDD. I'm sure about a year back it was mostly SSD and HDD systems.

Yes, 4TB and over seems like where HDDs are most applicable.

 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf