get around cgnat finally
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Moving to a rack is nice, I love my rack. If you’re in or near a city I suggest keeping an eye on Craigslist and ebay (search by distance nearest and lowball ones that have been sitting for months) because it’s not uncommon for nice racks to go real cheap as long as you come get them. I got my rack realllll cheap ($40, 42u, fully enclosed with massive pdu) because it’s a 90s ibm rack and it’s welded steel so it’s like 450lbs. Moving it was a nightmare but it’s real sturdy and I’m never moving it again now that it’s in my basement
For my goals in the short term I have to replace a sas cable that caused a crc error on one drive, it only happened once per smart data but still want to get that done asap. I also have another drive that’s beginning to show some smart issues; it’s on the same sas cable so it may be related because the errors didn’t increase (they all were related to an unclean shutdown, confusing things) but it’s old anyway so better safe than sorry I guess.
Medium term I want to finally upgrade my ups. The one I have now is not a rack mount which is part of what led to the unclean shutdown. It’s also a bit undersized. I have a generator for my house so I don’t need something massive but the one I have is 450va and several years old so with the tired battery I only can get about 5m of runtime. It’s more than enough to cover the transfer from power cutting out to generator power but I want something that’s a bit more reliable in case of generator failure. This is pricey though because my array is pretty huge so it’ll probably be held off unless I find a good deal on a dead one that has cheap batteries available
I also want to put the rack on its own circuit. This is something I should do asap because it’s cheap, just gotta find time and rearrange my panel a bit because it’s pretty full. This would be the other part of the unclean shutdown as the outlet would be in a much better location and I could also install a locking outlet
Would also be nice to pick up a super cheap monitor locally, like something for $15-20 from a pawn shop or Craigslist or something for the rack. Earlier this year I had nginx crash on my server and the webui became inaccessible, I had to drag my nice and kind of large desktop monitor down to the basement to solve the issue, would be nice to just have a shitty small monitor on the rack for that
Speaking of nginx I keep meaning to setup some kind of reverse proxy or mdns for all my dockers so that I can just do whatever.whatever instead ipaddress:3993 which makes my password managers barf but I’ll probably just be lazy and edit my hosts file
Longer term I want to add a secondary low power server that can run something like pfsense to handle my routing, then turn my current wireless routers into access points because they kind of suck as routers.
And of course the array could always be bigger, especially if drive prices fall
I will probably realistically only do the drive and cable replacement, the circuit thing since that’ll be like $40 and a half hour of work, the monitor if I can find one, and maybe the hosts file thing. If I run into cash (unlikely) or a crazy deal (you never know) the ups would be my next priority but there’s a million other things going in life (deductibles just reset for health insurance, hooray)
"I'm never moving it again...". As a larger guy that owns a pickup truck, I wish I had a nickel for everytime I heard that about a big rack I help move. (Or a baby grand piano, pool table, or gun safe) :)
Nginx is pretty simple to run as a reverse proxy. Caddy is even easier but not as scalable.
HAProxy looks intimidating at first but it's pretty easy and very scalable and performant. Wendell from Level1Techs has a nice writeup on their forums
Oh, there's also Nginx Proxy Manager that is very clean and very easy to work and manage with it's nice web UI
To start - moving services from bare metal to rootless Podman containers running via quadlets. It's something I have had in mind for a while but keep second guessing the distro choice. Long-ish release cadence, systemd-networkd and a recent Podman version in the native repos, well supported, and not Ubuntu.
So far openSUSE Leap seems like the winner. A testing machine is up to install everything, write some deployment scripts, and decide on a storage layout and partitioning scheme.
If anyone has another distro to recommend that checks these boxes let me know!
I like rolling release for the desktop, but only want critical patches in any given month for this server, and a major upgrade no more than every 3-4 years. Or an immutable server distro. But it doesn't seem like networkd is an option for the ones I've looked at (Fedora CoreOS, openSUSE MicroOS), and I am not sure if I want to figure out Ignition/Combustion right now.
Next project - VLANs on Mikrotik.
OP - Navepoint makes good racks for reasonable money. I have a Pro series 9u from them and it went together without any problems. It's on the wall with a pretty big ups in it.
Thanks for the recommendation!
If I hadn't been using Unraid for my server I too think I'd be rocking OpenSuse, but probably MicroOS as you mentioned.
Hardware perspective i need a nas. I got myself some piece of acer oem thats not too shit just need a case and some drives (i dont wanna just make stack of drives on top of the stack of old oems i call a homelab).
Am getting starlink installed cos shitty rural aussie internet is shit. So gonna have to do some fucking around to make that work.
Would like some local media reccommendation algorithm (can probs just write some code to dump jellyfin into openwebui and task an llm).
Gotta set up an image gen ai and hook that up to openwebui.
Gotta set up an email server to make authelia notifications not just dumped to a file.
Ohh and i got literaly no backups of anything (well except my docker composes that are on git).
Other than that we will see what i want.
Replace Blue Iris with Frigate + Coral
Set up Immich with proper backups
Set up Peertube
Increase my storage pool to fit 100% of my local backups.
Nearline my critical backups
Move my remote backups from BackBlaze to synctoy untrusted crypt on a pie at work.
Frigate and a Coral TPU work amazing. I've had them and Home Assistant setup for the last year or so and have been quite happy.
finish setting it up
I have all the hardware laying around collecting dust
The fun part is putting it together and watching it all work smoothly! Best of luck dude 👍
Hopefully I can finally get the IPv6 stack fully working.
OPNsense works, Proxmox works, LXC works, Docker works but Docker Swarm does not.
Either I move away from Docker Swarm or a miracle happens and they finally fix their IPv6 support in 2025.
As a networking noob: what are the benefits to having/using an IPv6 stack? I realize that eventually we all have to move to IPv6, but any point in being early on it?
IPv6 is pretty much identical to IPv4 in terms of functionality.
The biggest difference is that there is no more need for NAT with IPv6 because of the sheer amount of IPv6 addresses available. Every device in an IPv6 network gets their own public IP.
For example: I get 1 public IPv4 address from my ISP but 4,722,366,482,869,645,213,696 IPv6 addresses. That's a number I can't even pronounce and it's just for me.
There are a few advantages that this brings:
- Any client in the network can get a fresh IP every day to reduce tracking
- It is pretty much impossible to run a full network scan on this amount of IP addresses
- Every device can expose their own service on their own IP (For example: You can run multiple web servers on the same port without a reverse proxy or multiple people can host their own game server on the same port)
There are some more smaller changes that improve performance compared to IPv4, but it's minimal.
Well this certainly has me intrigued!
From a hardware perspective I need more storage. Am thinking I'll probably end up with a second Synology NAS unit before the end of the year with 4 hard drives at whatever a reasonable price vs size point it at the time I do it (likely 12-14Tb drives at this stage). Bought drives 2 at a time last time so I'm running two RAID1 pairs right now on the existing unit - adding 4 new drives at once to the home lab will let me move all that content to the new drives and reformat the existing ones into a RAID5 array and get an extra 12Tb of storage.
The one I already have does support adding the 5 drive expansion bay, but figuring that with a second NAS I can move some of my Docker instances currently running on a dedicated laptop onto the second NAS which takes one computer out of the setup as well.
Maintenance wise I've just only done my 2024 maintenance stuff that I do each year. This year it was going through my password vault and making sure everything was synced up, had complex passwords, had two factor enabled where applicable, etc, as well as setting up unique email addresses for every service I'm using (they just forward to the same inbox) to help me track who's been selling my info. Have already found a local fast food outlet who has from that.
Have also rotated all my SSH keys, made sure they were all upgraded to Ed25519 from RSA, set up unique keys for the three devices I regularly use so I can revoke one individually if required, made sure all my hardware was running the latest updates (my RPi running my Pi-hole instance was still on Buster so I had to get that updated before I could even update Pi-hole), etc.
Also swapped my Mullvad connection on my gateway to use Wireguard instead of OpenVPN since they're dropping support later this year.
Honestly I'd love to invest in some sort of rack mounting for home, its something I should look into some more, but right now I just have a whole section of the wardrobes in my study for equipment and tech storage. It's working for now although I worry about it in summer with not a massive amount of heat dissipation in there. This weekend is supposed to be close to 40 degrees Celsius both days 🥵
While not really for my hosting, I want to upgrade the Wi-Fi speeds in my home, currently running an eero setup that provides good coverage, but the speed seems poor when transferring large files around the home.
Not sure what to get, but this is my goal.
Hardware-wise:
- Reorganize my networking closet and rack up my switches
- Replace my core switch with 10 gbit, connect up 10Gbit fiber to my laptop dock and one of my nodes still on copper
- Add 3 more nodes to my cluster with nvme storage so that I can start an erasure-coding pool in ceph.
Software wise, too many projects to count lol
Finalise my physical network to have at least one available port in every essential room & build a new home server/NAS.
Replace proxmox with incus.
I'm on proxmox too and now very curious as to why you want to move to incus.
Get VLANs working, proper IOT network isolation, and Nextcloud as my primary document storage. If that first one didn't bring down my homelab entry time I try I'd be more inclined.
Rebuilding my main router to work with 10gbe fiber that recently became available here. Although it is a tad expensive, so I am not actually sure yet if I will upgrade my contract.
I'm still in the middle of a K8s migration. It's overkill for a home user, but I want the upskilling.
I've got a QNAP NAS with self-managed linux for storage, and a MS-01 with an RTX A2000 for compute. They're connected over 10Gb SFP+. I'm more than half way done, especially considering I mostly know what I'm doing now.
I still need to figure out the idiomatically right way to schedule pods with their storage, but I got GPU workloads going recently. Next up is migrate the last of the docker-compose from the storage node.
Top 1 for me would be a strong backup mechanism, and by that I mean something that is tested. Currently I have restic in place but I don't even know if in case of a disaster the backups are ok.
And considering my lack of time, I would be happy with just that.
I am doing exactly the same as what the OP is doing. In addition to that, I will unify my beelink mini PC proxmox server and our old Intel atom NAS into one rack server with AMD EPYC, proxmox and truenas in a VM.
I sure hope our landlord and the Internet operator can agree on the operator finally bringing fiber cables to all apartments. Then I would have fast enough uplink to my homelab.
I'm begging for fiber too! It's 2025 gosh darn it 😁
Yeah... So I'm in Berlin, and in Germany the internet operators finally are building fiber everywhere. The provider who lays the fiber to our street is Deutsche Telekom, and they promise to pay everything: laying the fiber, bringing it to our house and bringing the fiber to every apartment for a two year monopoly on fiber internet after which it's up for competition using their cables. What needs to happen next is our landlord (a Swiss company) and house management company to agree on these guys to come in, put little fiber dividers to every floor and drill a hole to the walls so we get the fiber cable to our apartment.
Of course this being Germany, they are very slow on agreeing on that, we might need to go to court and for sure we need to talk to our neighbors who own their apartments to push them a bit. I'd expect us to get the connection maybe before end of 2025. But eventually it will happen...
I want to build a whole new server, starting with a wooden case that makes it perfectly silent (but allows for good air flow).
Btw: does anybody know what bad things actually happen if there is no metal cage that blocks all the radio?
Btw: does anybody know what bad things actually happen if there is no metal cage that blocks all the radio?
Noise happens. Could be no problem, or it could hurt your wifi or mobile data connections, or maybe raise a neighbor's ham radio noise floor. I saw this recently when setting up a pi to run BirdNet-Pi. The USB3 connection to an SSD caused enough noise in the 2.4GHz band that the onboard wifi radio could only connect on the 5GHz band.
Never good to intentionally pollute.
It would be to replace my 4-bay Synology DS918 NAS with something with more drive bays and 10 Gbit connectivity
Add an NVMe cache to my server and upgrade RAM if pricing permits.
From the software side there are a lot of open feature requests I keep adding to my backlog, like setting up a mail archive, reconfiguring my network (separate IoT devices into separate VLANs), maybe reconfigure some of my containers, …
Nothing fancy but I found an old RPI3 and want to selfhost Vaultwarden and piped on that thing to give my parents a way to watch YouTube without those nasty ads and give them a proper and easy way to store their password. (Over wireguard tunnel)
Also If the universe aligns buy a N100 or 200? To host my own router/switch setup and finally take advantage of my 5Gbit fiber 🫤. I still need to figure out how I get WiFi AP to work with a N100...
Not much but I have a lot other things to figure out but mostly software wise :).
I want to move my 4x SFP+ from their current MicroTik switch to my new Brocade. Then I'm very strongly debating running both VM and Ceph over the same 10Gbps connections, removing the ugly USB Ethernet dongles from my three Proxmox Lenovo M920q boxes.
After that? Maybe look at finally migrating Vault off my ClusterHat to Kubernetes.
At some point I need to migrate off Hyper-V. Probably to Proxmox.
Ugh. I don’t wanna.