this post was submitted on 28 May 2024
97 points (95.3% liked)

Selfhosted

39435 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

Hiya, so am looking to buy more storage and while browsing am seeing some external harddisks, such as Western Digital My Book and Seagate Expansion Desktop for cheaper than the internal harddisks themselves. Have seen this one video from KTZ Systems where he bought up multiple of these external ones just to open them up and use the disks for his own server. Was therefore wondering if you peeps have ever done this and if there any downsides to it at all?

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 78 points 6 months ago (1 children)

Yup. And if you want to look up more info on how to do it correctly, look up hard drive shucking.

[–] [email protected] 5 points 6 months ago
[–] [email protected] 53 points 6 months ago (6 children)

It's called shucking and it happens a lot especially in the home server home lab community.

[–] [email protected] 5 points 6 months ago (2 children)

learn something new every day :)

[–] [email protected] 9 points 6 months ago

It’s a bummer that hard drives are priced this way. It’s been common for a few decades now.

[–] lambda 4 points 6 months ago

The best ones for this are the ones from Best Buy. Easystore.

load more comments (5 replies)
[–] [email protected] 36 points 6 months ago (1 children)

Yes I’ve done it. What sucks is you make a lot of trash this way. Also double and triple check that the drives you buy will have standard sata connectors on them.

[–] [email protected] 9 points 6 months ago (2 children)

I like the trash to hook up any hard drive via USB.

[–] [email protected] 5 points 6 months ago

Yeah one of these is literally my primary USB 3.0 to SATA adapter

[–] [email protected] 2 points 6 months ago (1 children)

But you don’t need 8 of them, do you?

[–] [email protected] 4 points 6 months ago

You never know.

Stop staring at my cable box. I don't have a problem!

[–] [email protected] 27 points 6 months ago* (last edited 6 months ago) (3 children)

Be aware. Some external USB drives, like WD Elements, have built-in USB controllers. So they don't have a SATA connector.

[–] [email protected] 10 points 6 months ago (2 children)

This must've changed as I've shucked WD Elements / Book drives and they were normal drives...

So, you're saying the actual harddrive has a USB chipset onboard and only a USB interface?

When did this start happening?

[–] [email protected] 8 points 6 months ago (1 children)

I've shucked probably 100s of those WD essentials and they just had a little SATA -> USB adapter on it. It's been a few years but it doesn't seem like they'd make a whole new PCB just to include USB.

[–] Dhs92 6 points 6 months ago (1 children)

Within the past 2-3 years drive manufacturers have been swapping to USB PCBs directly attached to the drive controller, instead of using a SATA -> USB interface.

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 6 points 6 months ago

I think this depends on whether it's a 3.5 or 2.5 inch drive inside. To my knowledge, all external drives with a 3.5 inch drive inside are shuckable and have a standard SATA interface. With the compact drives that have a 2.5 inch drive inside, many will have a native usb interface and no SATA connector.

It makes sense as 3.5" sata drives are used for many many applications so why make something new just for external drives? With 2.5, however there are very few devices that use spinning sata drives in this form factor. It makes a lot more sense to build the USB interface directly on the drive since their main and possibly only application is external drives.

I could be wrong, but this has been my experience.

[–] [email protected] 4 points 6 months ago

Good to know! thanks

[–] [email protected] 26 points 6 months ago (4 children)

Yes and i got "scammed" - western digital in order to save $3 included the USB port directly on the drive motherboard instead of the usual sata+usb like anyone else was doing

[–] [email protected] 4 points 6 months ago

Same happened to me on a WD black

load more comments (3 replies)
[–] [email protected] 21 points 6 months ago (2 children)

Yes. Be aware there will be some pin blocking you need to do to make it work right because vendors know this trick.

[–] [email protected] 13 points 6 months ago (4 children)

I have done this with dozens of drives and have never had to do any pin blocking. You only need to do that if you're using an absolutely ancient sata power cable that doesn't know about the spinup pin change

load more comments (4 replies)
[–] [email protected] 5 points 6 months ago

Yeah typical :P

[–] [email protected] 18 points 6 months ago (1 children)

IMO, if you want the beast deals right now on a 12+ TB HDD, you should use serverpartdeals.com instead. I've got 2 manufacturer recertified 14 TB enterprise-grade drives from them and it was way cheaper than buying any 14 TB external drive.

[–] [email protected] 8 points 6 months ago (2 children)

Im based in scandinavia so wont be able to buy from there, but thanks anyway!

[–] [email protected] 6 points 6 months ago

Hey. Heyhey. Heyheyhey. Have you ever noticed that your warships have giant barcodes on them? It's so that when they return to port they can scan the navy in.

load more comments (1 replies)
[–] [email protected] 13 points 6 months ago

Yes. It’s a viable way to save money if you use a site like https://shucks.top/

[–] [email protected] 10 points 6 months ago (7 children)

Why create yourself a headache and still get substandard and no-warranty drive. If you want cheaper drives go for reconditioned/refurbished/used drives. Same risks, better product. Old enterprise SAS drives are cheap and many still have plenty of heath in them.

[–] [email protected] 3 points 6 months ago

Do keep in mind that you need a SAS controller for that, which can cost between $50-200

load more comments (6 replies)
[–] [email protected] 10 points 6 months ago

I have opened other enclosures and found a custom board on the hard disk.

[–] [email protected] 9 points 6 months ago* (last edited 6 months ago) (3 children)

Yeah! The practice is called drive shucking (kinda like Oysters) and you just need to be considerate of the limitations. The drives often end up cheaper, but lose warranty support once they're shucked. They'll also occasionally be slower than a normal drive or have an odd connector, but that is rare since it's usually cheaper to go with something 'off the shelf'. If you Google it though you should usually be able to find the handful of drive SKUs they'll use in whatever external you're planning to shuck.

load more comments (3 replies)
[–] [email protected] 8 points 6 months ago* (last edited 6 months ago)

i bought a big external hdd recently on impulse... a clearance sale. it was really, really cheap. with the thinking that i could 'shuck' it because i'm short on space in a couple storage systems. i checked. i can, but i haven't. hell, i haven't even used it yet other than to run a full smart diag on it, followed by a full format and a read/write verify. took days. then i put it back in the box and have basically forgotten about it until now.

you have to be careful on what models you buy. some have usb built onto the controller board (no internal sata) or other things (e.g. encryption chip, weird power) that make it more difficult or even impossible to use the internal drive in an environment other than the enclosure it ships in.

[–] [email protected] 6 points 6 months ago (1 children)

Shucked drives are usually the drives that are rejected for internal use because of quality issues. They might work fine, they might not. Be careful with them and remember, RAID is not a backup.

load more comments (1 replies)
[–] [email protected] 6 points 6 months ago

I thought you were talking about the platter

[–] [email protected] 5 points 6 months ago

many times, shucking is a very valid way to get large format disks for cheaper than retail NAS parts. But be aware of what your buying and make sure that the disk your getting if its a white label is a reliable disk. WD Easystore/Mybook are generally good, as are the larger format Seagate external.

[–] [email protected] 4 points 6 months ago (1 children)

This is what I did when I had to refurb a laptop. Swap the drives, reinstall the OS, snd hand it all to the user. All your files are on this usb drive.

Thats when you find out who understands folder structure and who doesn't.

[–] [email protected] 5 points 6 months ago

I guess it shows how out of touch (old) I am that it's completely bewildering to me that there could be people who do not understand folders ... on a computer. Phones, tablets, yeah, I get that, those actively make it harder and harder to access the folder structure. But computers?

[–] [email protected] 3 points 6 months ago* (last edited 6 months ago) (1 children)

NOOO who would ever do that.

[–] [email protected] 2 points 6 months ago

a lot of people it seems :>

[–] [email protected] 3 points 6 months ago* (last edited 6 months ago) (1 children)

You might want to look up SMR vs CMR, and why it matters for NASes. The gist is that cheaper drives are SMR, which work fine mostly, but can time out during certain operations, like a ZFS rebuild after a drive failure.

Sorry don't remember the details, just the conclusion that's it's safer to stay away from SMR for any kind of software RAID

EDIT: also, there was the SMR scandal a few years ago where WD quietly changed their bigger volume WD Red ("NAS") drives to SMR without mentioning it anywhere in the speccs. Obviously a lot of people were not happy to find that their "NAS" branded hard drives were made with a technology that was not suitable for NAS workload. From memory i think it was discovered when someone investigated why their ZFS rebuild kept failing on their new drive.

[–] [email protected] 3 points 6 months ago* (last edited 6 months ago) (1 children)

i bought a few smr drives, knowing they were smr. they were cheaper, a lot cheaper than the same amount of space in cmr. used only for static media storage, so that's not a big deal, really., but holy hell was it slow getting stuff on them initially.

i have a few self-powered externals that are also smr (quite common with those as they use 2.5in notebook hdd). when those things have to start shuffling bits around and rewriting tracks, sustained write speeds fall well under what even usb2 can send.

load more comments (1 replies)
[–] [email protected] 3 points 6 months ago (1 children)

Used to be my main source of disks, but these days there are better ways and it is easier to know exactly what you are getting.

[–] [email protected] 3 points 6 months ago (1 children)
load more comments (1 replies)
[–] [email protected] 3 points 6 months ago* (last edited 5 months ago)

Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

Fewer Letters More Letters
NAS Network-Attached Storage
PSU Power Supply Unit
RAID Redundant Array of Independent Disks for mass storage
SATA Serial AT Attachment interface for mass storage
ZFS Solaris/Linux filesystem focusing on data integrity

5 acronyms in this thread; the most compressed thread commented on today has 17 acronyms.

[Thread #769 for this sub, first seen 28th May 2024, 15:55] [FAQ] [Full list] [Contact] [Source code]

[–] [email protected] 2 points 6 months ago

I've shucked a few drives in the past but when there was a big sale on hard drives awhile back I finished decking my NAS out with 8TB drives that weren't shucked as they came out to be cheaper than the ones in enclosures at the time.

The main downside is warranty really and some of the drives from enclosures need to have the power blocked on one of the pins to work (can't remember which sorry) due to the type of drive they are.

[–] [email protected] 2 points 6 months ago

Yup. /r/Datahoarder guided me right. Got two of the recommended model of MyBook and shucked them. This was 2-3 years ago. Disks are still going strong in my NAS.

[–] [email protected] 2 points 6 months ago

after doing it for a few drives and observing the failure rates of said drives i just buy drives with warranties now. i've got a few shucked drives still kicking around though.

load more comments
view more: next ›