Selfhosted

39435 readers

1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago

MODERATORS

[email protected]

Planning build: Power efficient headless steam machine, and later upgrade for AI tasks (lemm.ee)

submitted 11 months ago by [email protected] to c/[email protected]

11 comments fedilink hide all child comments

Background

I'm planning on building a secondary server that can process more intense tasks than my current basic home server. Tasks such as light gaming (think "remote Steam Deck"), and later allowed to be upgraded with a Nvidia graphics card to handle AI tasks, such as LLM and SD.

The problem

While I have no problem picking parts to build this as a "desktop computer", I'm completely lost when trying to make it power efficient for idle load (if it's even possible with a power-hungry Nvidia card). I'd appreciate some guidance even if it's not a full parts list suggestion!

Watching Wolfgang's videos has unfortunately not translated knowledge into practice for me yet. At least I know TDP isn't an absolute determining factor anymore.

Planning the build

Due to a limited budget, the idea is split the build in 2 phases.

Phase 1 (gaming):

Budget: $1000 (ideally below ~$800):
Use for local headless gaming (with bazzite?)
At least as powerful as a Steam Deck
Parts:
- APU:
  - Perhaps: "AMD Ryzen 7 7800X3D ($400)"
  - or "AMD Ryzen 5 7600X ($300)"?
- Motherboard:
  - No specific requirement, will mainly just use the PCIe x16 slot for a single GPU when upgrading in "phase 2".
  - Okay with gigabit ethernet and basic I/O.
- Power supply:
  - Power efficient power supply that can handle a class 4080/4090 card.
- Cooling:
  - Air-cooled preferred
- Storage:
  - Samsung 990 PRO NVMe M.2 SSD 1TB (~$100)
- RAM:
  - Corsair Vengeance LPX Black DDR4 3200MHz 2x16GB (~$70)
- Case:
  - As long as it fits a large graphics card

Phase 2 (AI: LLM/SD):

Budget: ~$2000
After 1-2 years, upgrade with Nvidia graphics card.
- Ideally something with 24GB VRAM, like the 4090.
- Prefer Nvidia due to compatibility with SD.
Open for suggestion, since wanting a low power draw with a 4090 might sound contradictory.

In case I missed any crucial information, let me know!

you are viewing a single comment's thread
view the rest of the comments

[–] Still 2 points 11 months ago (1 children)

one of those pi kvms or the like could turn on any system even if it doesn't support wake on lan

[–] [email protected] 1 points 11 months ago

Might be the case but is this really a problem to solve? To my knowledge, all modern boards support wol.