this post was submitted on 25 Feb 2025
50 points (98.1% liked)

Framework Laptop Community

2903 readers
35 users here now

Related links:

Related communities:

founded 3 years ago
MODERATORS
[email protected]
uthredii
50
Framework (2nd Gen) Event | 2025 Launch Event - Discussion (www.youtube.com)
submitted 1 week ago by uthredii to c/[email protected]
61 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

For inference (running previously-trained models that need lots of RAM), the desktop could be useful, but I would be surprised if training anything bigger than toy examples on this hardware would make sense because I expect compute performance to be limited.

Does anyone here have practical recent experience with ROCm and how it compares with the far-more-dominant CUDA? I would imagine that compatibility is much better now that most models are using PyTorch and that is supported, but what is the performance compared to a dedicated Nvidia GPU?