Selfhosted

39251 readers

195 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago

MODERATORS

[email protected]

Recommendations on Changes to Homelab (lemmy.one)

submitted 1 year ago by [email protected] to c/[email protected]

12 comments fedilink hide all child comments

I currently run a Lenovo minipc and an rpi4 to host all of my homelab services, and I just purchased a new minipc with an 11th Gen i5 in order to better handle Plex and transcoding. I would also like to add Immich to my homelab. Here is a breakdown of my current state:

Lenovo Mini PC running Proxmox: Home Assistant OS VM Ubuntu VM running:

Frigate
Pi-hole
Plex
Arr Stack
Transmission
Has two ext HDs in a mergerfs configuration to host all media and onsite homelab backups.

RPi4:

Wireguard VPN
Pi-hole

I am going to install Proxmox on the new minipc, and setup both in a cluster. I would like to move Plex, Arrs, Transmission, and Immich to the new mini PC. Because of that I am thinking the external drives should be connected directly to the new minipc to maximize performance. I would also like to have the ability to share the external drives to any nodes in the cluster.

Do you have any recommendations on how to best setup these drives? Should I setup a TrueNAS VM on the new minipc and share to all others via NFS? Any other tips for my setup?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 1 year ago (1 children)

You may have trouble keeping a quorum with a proxmox cluster of 2. You should really have 3, or set up a q-device. (Source)

Each node in a cluster has a "vote" in a healthy cluster. If one of your devices goes (or is taken) down, you'll lose quorum, and the GUI and some other stuff. You need 3 votes for things to work reliably. I have an old RPi set up as a q-device and it works fine.

[–] [email protected] 1 points 1 year ago (1 children)

This only applies to high availability clusters, correct?

[–] [email protected] 2 points 1 year ago (1 children)

Unfortunately not, it applies to all clusters. A quorum requires at least 2 votes, which means 2 nodes. But if one node goes down, you only have 1 vote, and the cluster will go into read-only mode, which means you'll lose the GUI and the ability to manage your nodes:

When your cluster is non-quorate (so at least half of all nodes are dead), the remaining nodes will change the PVE management into read-only mode. Because of that you will no longer be able to change and manage your VMs and containers and will also not be able to log into the GUI. This is done to avoid cluster split-brain problems in which they run into inconsistent states. (Source)

But if you have a device that will supply a vote in the event that one of the two votes is unavailable, the cluster will continue to function with a single node, which will allow you to use the normal Proxmox tools and interfaces to diagnose the problem, while also keeping any VMs on the single remaining node up and running (available).

Here is a Proxmox employee explaining it a bit more clearly than the official documentation:

... a cluster needs to be always quorate to work properly, not just for HA. High availability just means that the cluster will try to keep your HA-enabled VMs and containers always available, i.e. if a cluster node fails the HA-manager will launch HA-managed guests on another cluster node.

While a 2 node cluster should work with 2 active nodes, if one of your nodes goes down your cluster will automatically be non-quorate and will no longer work as expected. To have quorum in your cluster, you need a setup of at least 3 nodes, though you do not need 3 full Proxmox installations ... you can setup something like a Raspberry Pi as a QDevice for external vote support.

(Source)

[–] [email protected] 2 points 1 year ago

Wow thanks for that detailed explanation! Very helpful and I'll be setting up an rpi as a device.