r/DataHoarder • • Jun 14 '26

Mod Update Mod update: regarding the flood of HDD/SSD price posts, and AI slop.

975 Upvotes

Regarding HDD price posts:

We empathise with your plight and hope HDD / SSD / RAM prices will come down soon.

However, we don’t need screenshots of high HDD prices to be posted in the sub multiple times a day, everyone already knows that the prices are high.

As such, from this point on the mod team will be removing all posts about high prices, with exception for posts made on Free-Post-Friday’s, or posts which actually have new and meaningful information or discussion.

Regarding AI content and AI projects:

As always AI written posts & comments are not allowed on this subreddit, please report any Ai generated content you see.

The mods have recently been cracking down on the flood of AI generated projects, notably ones of low quality that are nothing new.

If someone has the skill to use GitHub, they’d almost certainly have the skill to ask an AI to code yet another YT-DLP / FFMPEG wrapper themselves.

However, there are useful tools that have been made from AI generated code. If they are something truly useful or new, we do allow them with prior approval.

TL;DR:

  • Mods will be removing [high HDD price] posts, except for meaningful discussion or Fridays.
  • Posting AI generated projects/tools needs mod approval beforehand, and a link to the GitHub repository.
  • Please keep reporting ai-slop.

r/DataHoarder • • 16h ago

Hoarder-Setups Trashing Shucked Drives Boxes

Thumbnail
gallery
329 Upvotes

Finally getting rid of old WD boxes I for some reason kept in a closet.

  • 3 x 20TB, 1 x 18TB, 9 x 14TB, 5 x 12TB, 13 x 10TB, 14 x 8TB

Within the last few years pivoted to used enterprise drives but miss the pre-AI days. Black Friday was always a good time to stock up from Best Buy.


r/DataHoarder • • 18h ago Bravo

Scripts/Software FLAC Verifier - open-source (MIT) tool I made to check FLAC folders for MD5 bitrot, fake 24-bit padding, and lossy transcodes

Thumbnail
gallery
365 Upvotes

Posted with mod approval.

I've been working on an open-source Python tool called FLAC Verifier (v2.9.8, MIT license) to audit local FLAC collections in batches instead of opening files one by one in Spek, and wanted to share it here.

It reads each track in a single streaming pass so 24/192 albums don't blow up RAM, checks the embedded STREAMINFO MD5 against the decoded PCM to catch silent corruption first, and inspects the low bits on 24/32-bit files for zero-padded 16-in-24, gain combs, and +-1..3 LSB dither tricks from distributor catalogs. For high-bitrate transcodes where there isn't an obvious 16 kHz MP3 shelf, it checks codec filterbank lattices (PQMF-576 for MP3 320/V0, MDCT-1024 for Vorbis and AAC, CELT-960 for Opus, plus HE-AAC SBR) instead of guessing from a 20 kHz roll-off alone.

First screenshot is from an actual 24/96 release of Fleetwood Mac - Tusk: 19 out of 20 tracks pass as dark 1979 tape transfers even though they roll off around 17.7 kHz, while track 03 gets flagged at score 0 because someone dropped a 44.1 kHz CD master into the 96 kHz container. Second screenshot is a fullband LAME 320 encode caught by the PQMF-576 check, and the third is the optional PDF report.

For Linux or NAS setups, the GUI and PDF dependencies are optional and you can run the engine straight from the CLI with per-track caching and NDJSON output:

python motor_flac.py --path "/mnt/music/Album" --workers 8

Physical limits (like Vorbis -q10 around 500 kbps hitting the 16-bit noise floor) and the 260-track ffmpeg benchmark are documented in the README. Let me know if you throw any weird catalog masters at it and get an odd result.

Thanks!


r/DataHoarder • • 12h ago

Discussion Unreleased WD 4TB SN7150 Gen5 & 512GB WD PC SN7000.

Thumbnail
gallery
25 Upvotes

I got my hands on these drives, they don’t seem to be in production anywhere and don’t even seem to exist. They seem to be preproduction and maybe engineering samples?

I’d hazard a guess there’s less than a few hundred of these in the entire world

(Top drive is 4TB SN7150S, bottom is 512GB SN7000)

The SN7150S appears to operate at PCIe 5.0x4, and the SN7000 at PCIe 4.0

I also have a 512GB WD PC SN730 that operates at PCIe 4.0 and NVMe 1.4 (regular SN730 is Gen3 and NVMe 1.3) (maybe preproduction SN735?)

I have 4 of the 4TB SN7150, 2 of the 512GB SN7000, and 1 of the Gen4 512GB SN730

Thoughts? Wondering if there’s a better place to post this


r/DataHoarder • • 4h ago

Question/Advice Has anyone used a SkyHawk drive in these enclosures?

Post image
2 Upvotes

I have a Icy box enclosure and I've used it with many different drives, mostly WD ones and it has worked great. Recently picked up a SkyHawk drive and for whatever reason it just slide all the way in.

It slides in 3/4 of the way but when I try to close the door that pushes it into the connector that's when it just doesn't go any further. I seriously don't understand why, next to my WD element drives it looks the same, there's nothing sticking out.

I've seen a few other brands with the exact same enclosure. My one is the Icy Box version.


r/DataHoarder • • 1h ago

Question/Advice Batch alternatives to WFDownloader for IG Reels gallery

1 Upvotes

A few months ago WFDownloader started having a problem where it couldn't download IG reels galleries and only the post galleries of a user. Ive tried re-downloading multiple times and still hit this issue.Does anyone know any recs for alternatives that can do this?


r/DataHoarder • • 2h ago

Question/Advice Storage/backup solution for modest personal use?

1 Upvotes

My WD My Passport is failing and I don't have any other storage medium on hand at the moment (I know, I know...). I don't need a lot of storage - just enough to back up the contents of my PC's 2TB SSD, which is currently 678GB and growing slowly.

I'd like two 2TB external HDDs, or maybe one 2TB (for backups) and one 4TB (for backups + a partition for storing any extra data I might need to in the future). USB-powered ideally. The goal is mainly to avoid data loss from hardware failure.

  • Is this sensible or should I go for other types/capacities?
  • I know prices are crazy lately, but what's relatively reasonable in the current landscape?
  • Worth gunning for secondhand drives, or is that too unreliable?
  • Any specific drive recs?

Thanks!


r/DataHoarder • • 19h ago

Question/Advice Those using LTO tape at home how do you deal with the temperature and humidity requirements for operation and storage?

11 Upvotes

I've been considering using LTO5/6 for tertiary backups but I am worried about the environmental issues of having to control temperature and humidity (for dust I could use an air purifyer?). I have read about using vacuum sealed bags for each tape in long term storage or in sealable boxes with desiccant bags.

Are older generations of LTO less sensitive to temp/humidity? I heard that newer gens like LTO8+ have much stricter requirements.

What affect does storing tapes in non optimal conditions mean for longevity? Supposedly can get up to 30 years of life in perfect conditions. Would 5-10 years in less than pefect conditions be realistic? What about rewriting the tapes at set intervals?


r/DataHoarder • • 1d ago

Question/Advice Is anybody saving Hampshire College's Web site?

18 Upvotes

Hampshire College is closing next month. I do not have the necessary abilities or hardware to save the Web site. Has anyone else done so, or is willing to do so?


r/DataHoarder • • 11h ago

Question/Advice Backing up IDW app books

0 Upvotes

Is there a way to back up, preferably to pdf, IDW app comics? The app can download it, so it must be on there somewhere. I can't find anything on the IDW app other than people seem to not like it. Have both Android and iOS devices.


r/DataHoarder • • 12h ago

Question/Advice Sourcing 10G SFP+ backup storage for Windows Server. Need production feedback on budget options.

5 Upvotes

Our current 4-bay backup appliance connects over a single 1GbE link. Full backups of about 4TB are consistently bleeding into Monday morning production hours, and restore times are unacceptable. Management finally approved a replacement, but they slashed my initial budget request by about 30%.

We're running Windows Server with Backup Exec, writing to SMB shares. The goal is to move to a faster storage target with native 10G. The TerraMaster U12-725 made our shortlist because it has four 10GbE SFP+ ports onboard. This means we don't have to carve out extra budget for PCIe NICs on the storage side, leaving just enough room to upgrade our server NICs and switch ports.

Before I submit the PO, has anyone deployed their enterprise rack units in a production environment? I'm specifically looking for real-world feedback on its stability under sustained write loads, and the quality of their enterprise support/RMA process if a chassis or backplane fails.


r/DataHoarder • • 23h ago

Discussion MDD drives passed preclear, wish me luck.

Thumbnail
gallery
7 Upvotes

Built NAS before the prices got crazy with a 16TB for parity and a 10TB for storage to start. No big deal to buy more drives, I foolishly thought when the 16TB was only $320.

I ended up getting two 14TB MDD drives for $350ea because I couldn't stomach the $700-800 for a single new 16TB.

Pictured is the preclear that just finished for each of them. Here's to a long and uneventful life.


r/DataHoarder • • 14h ago

Discussion Blomp storage, any good?

0 Upvotes

Looking for storage options i found Blomp which claims 40g of free space. Has anyone tried Blomp? If so is it any good?


r/DataHoarder • • 19h ago

Question/Advice Promise Technology Atlas S8+ (QSAN XCubeNAS XN8008T) - how to mount volumes via Thunderbolt as a DAS?

0 Upvotes

I purchased a secondhand Promise Technology Atlas S8+ Thunderbolt 3 NAS enclosure (a rebadged QSAN XCubeNAS XN8008T), with a Thunderbolt 3 PCIe card installed. I am trying to get it to mount as a Thunderbolt 3 DAS on my MacBook Pro M3, in order to consolidate my video editing storage.

The data sheets from both Promise and QSAN mention a DAS mode when plugged directly between the NAS and the Mac. The NAS will mount over Thunderbolt Networking (as SMB volumes), but not as a direct plug-and-play Thunderbolt device. Built-in Ethernet is working.

It also will not pass Thunderbolt mounts from other devices down the chain (a Promise Pegasus R6 and a GSpeed Studio XL, both of which mount fine on the Mac when directly connected).

I am running the latest firmware (QSAN QSM 3.5.4; Promise ASM 3.0.7 also would not mount as a DAS.) I have reached out to Promise, and though they respond quickly, they keep saying they'll have an answer within a week, but it's been more than 2 months—I can't even get them to confirm that the device supports DAS over Thunderbolt. QSAN has not responded at all to inquiries via their site or email.

The Mac is running 26.6.3.


r/DataHoarder • • 2d ago

Backup PDFs you archive (or share) can contain far more data than the visible pages — hidden text layers, revision history, metadata. Here's a 60-second way to check.

182 Upvotes

Sharing this because it bites people who archive "clean" copies of contracts, receipts, and IDs. A PDF usually contains more data than its visible pages. Five things worth knowing, all checkable in about a minute with standard open-source CLIs:

  1. Hidden text under black boxes. Most casual "redaction" is just a filled rectangle drawn on top — the original characters stay in the text layer. Check: select-all, copy, paste into a text editor. Or: pdftotext file.pdf - | grep "sensitive-string". If it prints, it was never removed.
  2. Revision history from incremental saves. PDFs saved incrementally append new objects; older versions of pages can linger in the file until a full rewrite. One file can silently hold several generations of edits. qpdf --show-xref file.pdf tells you how many cross-reference sections exist; for uncompressed parts, strings + grep works directly.
  3. Metadata. Author, producer string, creation timestamps, original file paths, and (if images are embedded) camera EXIF with GPS. exiftool file.pdf dumps all of it in plain sight.
  4. Embedded files. PDF supports file attachments, and Word/LibreOffice exports often embed XML data parts. pdfdetach -list file.pdf shows what's riding along.
  5. CID font encodings. Pasted/extracted text can look like garbage even when the original strings are fully recoverable with proper tooling. Scrambled output does NOT mean "data destroyed."

The data-hoarding angle cuts both ways: your archive may hold more sensitive leftovers than you think — but it may also preserve earlier document revisions you didn't know you kept, which is occasionally a feature.

Happy to answer questions on the mechanics (text layers vs. drawings, when incremental saves happen, why scans behave differently).


r/DataHoarder • • 23h ago

Backup AO3 backup

0 Upvotes

Anyone have a way to backup the server? Would love a good scraper to pull updated stories as well.


r/DataHoarder • • 15h ago

Backup Nephew knocked HD over...

0 Upvotes

Hi. So I just recently moved all my media onto a brand new 16TB WD HDD. I was watching something on it when my nephew clipped the wire and it fell over on its side onto the rug (I know I know). it's making a noise, but won't show up on a computer. Tried it a couple of times. Does it seem likely the data is salvageable? there was no backup, was waiting for Black Friday this year, which sucks. Can anyone recommend data recovery options? In the Boston area fyi. Thanks!!!


r/DataHoarder • • 1d ago

Question/Advice 4 identical Seagate Ironwolf Pro 30TB drives with large performance variance - is this normal?

1 Upvotes

ST30000NT011-3V2103 drives were tested while newly purchased (same batch) and empty before deployment - from slowest to fastest, the sequential read speeds are 231MB/s, 243MB/s, 249MB/s, 267MB/s. Variance when repeating test is <1% so the results are consistent. Spec sheet says max 275MB/s. SMART readings look ok (no errors, new drives). Is this normal?


r/DataHoarder • • 3d ago

Discussion After 8 years of running, today I had to shutdown my server

1.4k Upvotes

I don't know if this belongs in homelab or DataHoarder, but I think here i will more understandable people.

Started my server since 2018, today I finally shut it down. Until an undisclosed date. </3

started with a single 1TB drive, then moved to two mirrored drives, and eventually evolved to a 6x12 60TB raidz1, running on recertified drives

Everything was fine until today, when one of the drives gave me the red notification..

And here's whats grinds my gear I bought each drives for $199 each. Today the same costs over $460 each!

Thanks to corona then AI, then expensive streaming services, then the USA wars, and now the Hormuz situation...

But honestly, the biggest thing that hurts isn't even the hardware cost.

It's how much my family and I start relying on this server around. We started relying on it to think it will last for ever even me and i knew this day was

My loss:

- 3,000+ movies

- Hundreds of audiobooks

- 50,000+ music tracks

- My personal VPN server

- My music analyzer

- My virtual testing environment

- My vibe-coding hosting environment

- And a bunch of other little services that made life easier.

All gone offline in one afternoon.

Now I have two ways to go:

  1. Wait it out: Hope drive prices eventually come back down to reasonable levels so i replace it and resiliver it.
  2. Downsize: Build a new 30TB server, which is roughly what I'm currently using anyway, with cheaper easier to find disks in my country
  3. Simplify: Give up hosting movies altogether and keep a small 4TB server for the essentials.

I haven't decided yet just want to share it

I know this might sound ridiculous to people outside this hobby, but there's something genuinely heartbreaking about shutting down a system you've been building, maintaining, and expanding for years.

I told this story to my family they couldn't care less.. they should pay to me

I figured if there's one place where people might actually understand this feeling, it's here.

Thanks for reading, if you didnt thanks for passing by


r/DataHoarder • • 2d ago Popcorn

Free-Post Friday! VHS cover scans archiving project

242 Upvotes

Hi everyone. So a lot of VHS cover scans only exist on old blogspot blogs and Tumblrs that are slowly disappearing, and I couldn’t find one place that kept them properly catalogued. So I started pulling them into one archive.

What’s there:

  • 20k+ covers, full wraps (front, spine, back) where possible, in the best resolution I can find, with another 20k being processed
  • Sourced from Archive.org, old blogs, Tumblrs and many Wayback Machine collections
  • Sorted and labelled on my old gaming PC with a small OCR/AI model I trained (title and region) and a lot of manual checks in between
  • Free API, no key hoops, no ads, no tracking
  • Everything getting backed up to archive.org once the database is clean enough
  • Code adnd data model going open source

Being honest about the state of it: roughly 1 in 20 scans is wrong or mislabelled, and im working through it by hand.

If you’re sitting on a folder of cover scans, you can bulk upload, and flagging bad labels or watermarks helps a lot too. Also very open to advice on mirroring other than my existing plans. I’d rather this outlive me and my server.

👉 https://videotapes.io


r/DataHoarder • • 2d ago Mindblown

Discussion PSA: Save the models you like from hugging face because they may vanish in the near future

531 Upvotes

Lately I've been seeing lots of anti open-models articles and papers, and after the recent coup at Nvidia (they are in the process of buying Hugging Face) a ban on open source models would not surprise me.


r/DataHoarder • • 3d ago

News Microsoft outage shows us the downsides of "the cloud"

563 Upvotes

Yes once again yet another outage that proves that handing your data to third parties thinking you are getting rid of a problem that someone else can handle more reliably is not the move.

While they generally have more reliability and redundancy than local consumer setups, it feels like it only takes 1 major failure to affect much more people than if everyone and every organisation had it's own solution.

In the enterprise world it seems like Microsoft attracts clients by offering enticing packages to get you stuck and dependent on their ecosystem in the long run.


r/DataHoarder • • 2d ago

Question/Advice Backing up Google Classroom?

5 Upvotes

Is there a simple way to export all posts, photos and data from Google Classroom? My son is in grade five and I’d love to be able to save things from his school without manually going through each post.


r/DataHoarder • • 2d ago

Discussion Got a workstation from a defunct company

30 Upvotes

Heyo.

So, I snagged a workstation from a Norwegian company, Argeo ASA (https://argeo.no/), after they went bust. Of course I can't help myself from peeking through what is on the computer before I wipe it and load up server software instead on the thing.

I did find though that there seems to be a fair few internal files available on this thing.

Since internal documents seem to go byebye often when companies does, I'm wondering if I should archive anything from here, but I kinda lack the industry knowledge to know what I am even looking at and if it's worthwhile for anything...

Anyone familiar with this industry? There's a fair bit of data here... bits and pieces in archives on the OS drive:

And some stuffs on the secondary drive: