this post was submitted on 23 Dec 2023
165 points (97.1% liked)

Technology

59204 readers
3333 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] drkt@feddit.dk 73 points 10 months ago (2 children)

Person with vested interest in X says X will continue to proliferate. More at 11

[–] qupada@kbin.social 44 points 10 months ago (2 children)

We've done this exercise recently for multi-petabyte enterprise storage systems.

Not going to name brands, but in both cases this is usable (after RAID and hot spares) capacity, in a high-availability (multi-controller / cluster) system, including vendor support and power/cooling costs, but (because we run our own datacenter) not counting a $/RU cost as a company in a colo would be paying:

  • HDD: ~60TiB/RU, ~150W/RU, ~USD$ 30-35/TB/year
  • Flash: ~250TiB/RU, ~500W/RU, ~USD$ 45-50/TB/year

Note that the total power consumption for ~3.5PB of HDD vs ~5PB of flash is within spitting distance, but the flash system occupies a third of the total rack space doing it.

As this is comparing to QLC flash, the overall system performance (measured in Gbps/TB) is also quite similar, although - despite the QLC - the flash does still have a latency advantage (moreso on reads than writes).

So yeah, no. At <1.5× the per-TB cost for a usable system - the cost of one HDD vs one SSD is quite immaterial here - and at >4× the TB-per-RU density, you'd have to have a really good reason to keep buying HDDs. If lowest-possible-price is that reason, then sure.

Reliability is probably higher too, with >300 HDDs to build that system you're going to expect a few failures.

[–] tomatolung@lemmy.world 4 points 10 months ago (1 children)

Factoring in the current year inital cost and MBTF, did you figure out an ROI on HDD vs Flash including Power and space?

[–] qupada@kbin.social 5 points 10 months ago

Not in so much detail, but it's also really hard to define unless you've one specific metric you're trying to hit.

Aside from the included power/cooling costs, we're not (overly) constrained by space in our own datacentre so there's no strict requirement for minimising the physical space other than for our own gratification. With HDD capacities steadily rising, as older systems are retired the total possible storage space increases accordingly..

The performance of the disk system when adequately provisioned with RAM and SSD cache is honestly pretty good too, and assuming the cache tiers are adequate to hold the working set across the entire storage fleet (you could never have just one multi-petabyte system) the abysmal performance of HDDs really doesn't come into it (filesystems like ZFS coalesce random writes into periodic sequential writes, and sequential performance is... adequate).

Not mentioned too is the support costs - which typically start in the range of 10-15% of the hardware price per year - do eventually have an upward curve. For one brand we use, the per-terabyte cost bottoms out at 7 years of ownership then starts to increase again as yearly support costs for older hardware also rise. But you always have the option to pay the inflated price and keep it, if you're not ready to replace.

And again with the QLC, you're paying for density more than you are for performance. On every fair metric you can imagine aside from the TB/RU density - latency, throughput/capacity, capacity/watt, capacity/dollar - there are a few tens of percent in it at most.

[–] Empyreus@lemmy.world 3 points 10 months ago (1 children)

Most super computer systems have been doing away with hhds for the speed and energy efficiency causing ssds and tape to be the two forms of storage.

[–] qupada@kbin.social 2 points 10 months ago

Being in an HPC-adjacent field, can confirm.

Looking forward to LTO10, which ought to be not far away.

The majority of what we've got our eye on for FY '24 are SSD systems, and I expect in '25 it'll be everything.

[–] ryannathans@aussie.zone 40 points 10 months ago (1 children)

I bought 18 TB seagate exos x18 drives for about $400 AUD each this year. What price are 18TB SSDs at?

[–] emptiestplace@lemmy.ml 18 points 10 months ago (1 children)
[–] ryannathans@aussie.zone 4 points 10 months ago

Mr Toshiba needs to fix his numbers!

[–] JohnDClay@sh.itjust.works 36 points 10 months ago* (last edited 10 months ago) (6 children)

Haven't hard drives been cheaper per storage amount than SSDs forever? The problem was always that they were slow. I think tape may still be cheaper per storage amount than hard drives, but the speed is abysmal.

Edit: yeah looks like tape is 3x to 4x cheaper than hard drives https://corodata.com/tape-backups-still-used-today

[–] Potatos_are_not_friends@lemmy.world 5 points 10 months ago (1 children)

For me, reliability is now the bottleneck.

So many HDs are crapping out after about 5 years. Not saying SSDs are better, but I haven't used any for storage. But it's starting to feel like a subscription plan as I'm rotating hard drives in my server nearly every year now since 2018.

[–] frezik@midwest.social 2 points 10 months ago

That seems high. Data center drives have a failure rate around 1% per year, even for the worst manufacturer. Not sure how many drives you have or what your workload is like.

[–] lemmyvore@feddit.nl 4 points 10 months ago (2 children)

Tapes themselves are cheaper but there's also the upfront cost of the tape drive (we're talking thousands).

[–] umbraroze@kbin.social 6 points 10 months ago (1 children)

And that there is the real crime. It's a real shame no one's making a tape drive at the consumer market price point. Tapes are a hell of a lot more convenient for backups and archival than the giant weird pile of storage formats we've seen over years.

[–] lemmyvore@feddit.nl 5 points 10 months ago

The average consumer can make do with Blu Ray.

load more comments (1 replies)
load more comments (4 replies)
[–] Tja@programming.dev 36 points 10 months ago (10 children)

My 8TB Seagate failed a week ago and I was looking into new drives. The cheapest HDD was around 25 EUR per TB (for the 18TB ones) and the cheapest SSD were under 50 EUR per TB. No idea where this "7 times cheaper" comes, maybe from 2015.

I ended up buying a 4TB Crucial MX500 with 4TB for 208 EUR (barely enough for my data, but with some cleanup it will hold a year for sure).

Not only it's faster, it's smaller (fits in the NUC), it's quieter and it consumes much less electricity. I don't think I will ever buy an HDD ever again. Maybe for surveillance recording?

[–] Zanz@lemmy.world 19 points 10 months ago

Hamr drives and for data center use. Consumer ssds are made very poorly and even premium drives like a Samsung pro won't hold up in a data center environment. Hard drives on the other hand are basically only data center versions now.

[–] unionagainstdhmo@aussie.zone 11 points 10 months ago

No idea where this "7 times cheaper" comes

Probably from back when Toshiba was relevant

[–] user1234@lemmynsfw.com 3 points 10 months ago (1 children)

They ain't called Seabricks for nothing. SSD will let you sleep at night.

[–] Tja@programming.dev 3 points 10 months ago

There is a substantial difference indeed, now the setup is basically silent (I don't load the CPU enough for the fan to kick in).

load more comments (7 replies)
[–] rab@lemmy.ca 14 points 10 months ago (2 children)

I admin a datacenter and hard drives are never going anywhere. Same with tapes.

[–] Eccitaze@yiffit.net 8 points 10 months ago (1 children)

I work tech support for a NAS company and the ratio of HDDs to SSDs is roughly 85-15. Sometimes people use SSDs for stuff that requires low latency, but most commonly they're used as a cache for HDDs in my experience.

[–] preasket@lemy.lol 5 points 10 months ago (1 children)

Not much point in using SSDs in a NAS if it's there just for holding your files

[–] CaptainProton@lemmy.world 2 points 10 months ago

If the NAS supports tiered storage, you benefit from high I/O performance for things like video editing.

My home storage is a NAS connected over 10GbE, I never bothered trying to play games off of it, but I'll bet they'd run great. Read & write over the network at 10 gigabit is faster on a machine with (separate) RAID arrays of SSDs and HDDs than internal SATA3 connectivity which is kind of bonkers for a home user. Plus that has virtual machines and cloud backups running on the NAS side.

[–] guacupado@lemmy.world 7 points 10 months ago (1 children)

Work for one of the largest and we literally finished phasing out tape this year lol.

[–] CaptainProton@lemmy.world 4 points 10 months ago

In favor of what? Spinning rust, or some other media for archival backups?

[–] guyrocket@kbin.social 4 points 10 months ago

I just bought a microcenter brand 1 TB SSD for less than $50. Can a HDD compete with that on price and read/write speed?

Also recently bought a gaming PC that does not have a HD, only a 1 TB SSD.

I think HDDs day as boot drives is over. Unless they get a lot faster which I think is unlikely.

HDDs are certainly useful for larger amounts of storage, though. Self hosting, data centers, etc.

ETA: I don't think any of the responses read my entire comment. See the LAST SENTENCE in particular, friends.

[–] preasket@lemy.lol 3 points 10 months ago

Use HDDs for linear read/write (files) and SSDs for IOPS (databases)

[–] key@lemmy.keychat.org 2 points 10 months ago

Toshiba's estimates feel reasonable. While the price difference is slowly narrowing compared to the widening performance and form factor gap, it'll certainly continue to be a slow death. The current price ratio would need to be inverted before it makes sense to drop hdds entirely. And even then tapes will still be around forever.

With investments in storage tech being so diverted away from HDD technologies I wonder how much further capacity will get. We're already at the point where disks have many platters and HAMR is finally going to be delivered after decades of "coming soon". It feels like, much akin to processor fab, we're approaching a wall.

load more comments
view more: next ›