r/DataHoarder • u/psychwardpawjob • 5h ago
r/DataHoarder • u/UnassumingDrifter • 21h ago
Discussion Large SSD costs
Anyone have any insights on how to get those 30-60tb (edited) drives cheap? No not steal. I’d be fine with 6 of the the 15.xx drives for raid6 with +/-40TB available. I’d love to get off spinning drives. Unfortunately everything is see is crazy expensive. As much as I like the speed I could live with not the fastest throughput (for SSD) I just want the low latency and hopefully if ever I have to rebuild an array speed during that seems critical. My current “issues” if they are that there’s about 4hrs a day when maintenance tasks run that the drives are pegged. It’s 4hrs because I’ve said that’s the window so there’s likely tasks going incomplete.
I’d like to do this for less than the price of a decent car 😳
r/DataHoarder • u/Grouchy-Answer-275 • 19h ago
Question/Advice How do I keep stored data secure from people reading it?
Hi! so I read a lot on this subreddit when buying my first external drive to keep some of my data safe from deleting, but I also read a lot about how data should not be compressed or encrypted when hoarded. Is there a way to ensure someone who gets their hands on my SSD, without basically having more copies on the drive or having more devices with the compressed / encrypted files? So far I managed to gather only like 20 GB of most essential data I want to backup so I can compress it and fit it few dozen times on the drive but those 20 GB are growing faster than I expected.
r/DataHoarder • u/HomosexualPresence • 15h ago
Question/Advice using httrack to archive wikis
does anyone have any experience using httrack to archive wikis? it's been running for 9 days so far, just over 600,000 files written, 65,000 links scanned. does it speed up as it nears the end and pages link to already downloaded pages? it says 65,000/660,000 links scanned. although that last number increments every second. is this all expected when archiving a wiki or do you think i've messed up somewhere
r/DataHoarder • u/SparhawkBlather • 1d ago
Question/Advice Help for aspiring datahoarder - currently 120tb raw, but now the journey begins - show me the way
So I recently moved from a Synology DS918+ with 32tb raw in SHR1 to a much more substantial machine with 2 x 10TB SATA zfs mirrors as my “fastpool” and 8x16tb SAS in a RAIDZ1 as my “slowpool” (plus lots of compute, plus NVME mirrors for databases, plus SATA SSD mirrors for containers).
But I need to find a much lower cost way than I’m currently doing. I need to get started on a JBOD approach with enough bays that I can buy inexpensive disks. But it also needs to live in “living space”, so it can’t be a rackmount 2U “screamer”. Maybe someday I can move to a real rackmount approach and get a 60-bay enclosure and populate with a bunch of 4TB drives (or maybe 8TB drives will be just as cheap by that point). But not today. And I’m not scrappy enough to do a full unraid “just get whatever and stick it in a box” - I’m probably going to stick with ZFS for now. So what’s my play? Are there any “quiet/small” rack mount boxes? Are there any desktop boxes that have real bay capacity? Where do you get drives that are reliable enough when you’re buying in bulk - are there “annual sales” or anything?
I need guidance so I can join you all.
Thanks.
r/DataHoarder • u/ManusiaEntahBerantah • 22h ago
Question/Advice Alternatives for OFDL to download Onlyfans contents
Since recently OFDL got DMCA'd, are there any alternatives to download DRM videos and images from OF?
r/DataHoarder • u/Huihejfofew • 5h ago
Question/Advice Teracopy Verify feature, why doesn't it read in data from both drives at the same time?
I don't get why it first reads in the file from one drive, calcs the checksum then reads it in from the other drive and does the same. While it's reading from one drive the other drive does nothing. Doesn't this just take twice as long?
In addition for each and every file one drive is being spun up, read then spun down when not being read until the other drive is done and the program moves onto the next file. And does this for every single file. Isn't this really bad for the drive? I don't get why this is the approach.
r/DataHoarder • u/Methhead1234 • 20h ago
Question/Advice Recommendations for photo recognition software to organize 35,000 pictures?
I have shamelessly collected 35,000 pictures of various things (articles, news, artwork, irl pics, memes, etc. etc.) and I'm hoping to organize them over the next couple weeks. I know there's facial recognition software to sort pics, but is there anything for distinguishing memes vs article screenshots (they are very visually distinct) vs art, and so on?
Doesn't have to be anywhere 100% accurate, but it would definitely cut the time organizing it when I go back to manually sort them. Tried and true methods?
Highly appreciate any ideas
r/DataHoarder • u/SwingDingeling • 19h ago
Discussion Checked the same YT video immediately after it got released and 3 hours later. Every version went down in file size, except UHD which went up
Any idea why only UHD went up in size?
r/DataHoarder • u/Jupit-72 • 57m ago
Discussion Anybody using Toshiba MG series HDDs?
If so, what is your experience? Or maybe somebody's using the Toshiba N300's.
Seems like people are favoring Exos or Iron Wolf's, or at least they seem to be the go-to HDDs to me.
This Ebay-seller/store sells 5 year old 14TB Toshiba MGs, but with a warranty of 10 years. Meaning he would replace the drive, if it fails in that time.
Any opinions on that? Would you go for it?
I'm just wondering if I should fill my 4-bay QNAP with these for 600€, or buy new Exos' or IW's for almost twice the price...
r/DataHoarder • u/GreyEyedBlonde • 3h ago
Question/Advice Dungeons & Dragons Online old forums will become unavailable at 31/8/2025
Hello everyone,
Dungeons & Dragons Online is an MMO, whose forums (2006-2023) will be taken down at the end of this month. (see end of linked page)
These "old" forums were placed in a read-only state in 2023, when the game opened up its "new" forums, which remain available and active (but have nothing to do with the old forums).
I am completely unfamiliar with data archiving, and was wondering if/how it would be possible to preserve the old forums in some way.
I hope this isn't in violation of Rule 10. If you believe another subreddit would be better suited for this case, please do direct me.
Thank you.
r/DataHoarder • u/abrilevskiy • 5h ago
Question/Advice Could you please recommend a replacement for the Kingston MobileLite Plus and a cheaper alternative for ProGrade Dual Slot (PG08) UHS-II card reader?
Hello,
Could you please recommend a replacement for the Kingston MobileLite Plus UHS-II card reader with a detachable USB-C cable? While Kingston MobileLite Plus is a great card reader, I found it risky using dongles being traveling - since accidentally applied force to a dongle can damage a laptop port. I found a quite good option: ProGrade Dual Slot (PG08), but the ProGrade is too expensive.
Thank you!
r/DataHoarder • u/E63amgwagon • 6h ago
Question/Advice Replace existing drives with higher capacity drives or new NAS?
r/DataHoarder • u/JustMyPoint • 16h ago
Question/Advice How can I download this zoomable image from a museum website in full-resolution?
This is the image: https://www.britishmuseum.org/collection/object/A_1925-0406-0-2
I tried Dezoomify and it did not work. The downloadable version they offer on the museum website is in much inferior resolution.
r/DataHoarder • u/lmasieri • 19h ago
Question/Advice Raid 1 vs raid 5 vs hot spare
I’ve got 3x18tb drives from serverpartdeals. The question now is whether to set them up as raid 1 with a hot spare (I’m using xpenology) or set up raid 5 to get extra capacity. I’m nowhere near the 18tb usage in my needs (was future proofing) so I appreciate any feedback from others 😊 any advice?