this post was submitted on 10 Jul 2023
15 points (94.1% liked)

Selfhosted

39435 readers
4 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I've added 2 external USBs of 2TB each to my Proxmox server and created a Resource Pool called USB_HDD containing both. I created an Ubuntu VM, but I can't allocate all 4TB to it in one go - it only allows me to add each one as a separate SCSI device. When I start to install the OS it only allows the install onto one of the 2TB devices. I though the point of pools was to make the actual disks transparent, and present the pool to the VM so it sees it as one lot of space. Am I doing something wrong, or do I have to have it as 2x2TB disks?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago (3 children)

Thanks for the responses; it seems I can't really do it. I looked into ZFS but if I use that it halves the available disk space to 2TB. I'm using the VM for a media server and thought it would be better to have 1 4TB space instead of 2 2TB disks. At the end of the day it isn't a big deal, I just thought I'd be able to present both disks as 1.

[–] [email protected] 3 points 1 year ago (1 children)

looked into ZFS but if I use that it halves the available disk space to 2TB.

Look harder :-)

ZFS can do it either way.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago) (2 children)

Indeed ZFS has support for stripe (RAID0 like) ~~vdev~~ zpool since very early days.

[–] [email protected] 1 points 1 year ago (1 children)

Would it be better to make single-disk vdevs and add them into a pool so you could add a mirror disk to each vdev later?

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

Oh right my fault. Stripe is done at the pool level. So the two disks will be their own vdevs. And then the two vdevs are added into one zpool.

[–] [email protected] 1 points 1 year ago

Be aware in RAID0 if one of the HDD fails, the content on both will be lost lost.

[–] [email protected] 2 points 1 year ago (1 children)

I would suggest adding both disks to the VM, and then using mergerFS installed inside to pool the disks together for easier media storage.

[–] [email protected] 1 points 1 year ago (1 children)

Only if you never want to use those disks for anything else on that server

[–] [email protected] 1 points 1 year ago

In this case 'adding disks' could mean either direct pass-through, or just adding a virtual disk on each physical disk in Proxmox so they can be used for other things as well.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

ZFS can absolutely combine both into a 4TB single volume. Well like 3.78TB but you get the picture.

Note that, just like any other method which combines disks in a “RAID0” way, if one drive fails you lose everything on both drives.

But yes as others have said, “Pools” in Proxmox (or, more accurately, “Resource Pools”) are not related to storage but to permissions. A pool of VMs, of network bridges, yeah even storage but they’re not used for creating storage, only controlling access to it in an environment with lots of users (like in an enterprise).

ZFS and Ceph also use the term “Pool” but in a different context. They’re talking about a pool of combined storage, which is what you are looking for.

Put each USB disk into a ZFS vdev and then combine the two vdevs into a pool. You can add more drives into the vdev later to create mirrors within the vdev and get a RAID10-like setup once you have the means.