Framework Laptop Community

2567 readers

33 users here now

Related communities:

Buy it for life community: [email protected]
Fairphone community: [email protected]

founded 3 years ago

MODERATORS

[email protected]

uthredii

How easy is it to run stable diffusion on framework’s amd graphics card? (sopuli.xyz)

submitted 6 months ago by [email protected] to c/[email protected]

10 comments fedilink hide all child comments

I don’t know much about graphics cards, but the framework laptop seems to offer an “AMD Radeon™ RX 7700S” and stable diffusion requires Linux ROCm.

It’s not completely clear if ROCm runs on AMD Radeon™ RX 7700S, so I was wondering if anyone had any experience with setting it up on framework.

top 10 comments

sorted by: hot top controversial new old

[–] [email protected] 2 points 5 months ago (1 children)

Did you ever learn more about this? I can take a stab at it later.

[–] [email protected] 1 points 5 months ago (1 children)

I’ve seen a few YouTube videos for running Stable Diffusion on Linux. It seems like it should be doable. I’ve put in a pre-order for a framework.

[–] [email protected] 2 points 5 months ago

Yeah, I've done it before with my desktop with NVIDIA graphics. ROCm support would be new to me.

[–] [email protected] 1 points 6 months ago (1 children)

I could be wrong, but from a quick glance AMD's website makes it seem like it is pre-installed with the AMDGPU drivers, which are built into the kernel afaik.

[–] [email protected] 1 points 6 months ago

I don’t think Framework comes pre installed with the Linux kernel, which is what I’ll be using.

Also, it seems running Stable Diffusion requires some proprietary AMD stuff which seems unlikely to be included by default.

[+] [email protected] -6 points 6 months ago (1 children)

It won't run. Don't try to damage your laptop. This should be done on a desktop or a server in the first place.

[–] [email protected] 2 points 6 months ago (1 children)

I don’t have the space for a desktop/server yet, hence I’m considering a graphics card laptop.
What do you mean by “ It won’t run. Don’t try to damage your laptop.”? What road-block prevents it from running? Why would it cause damage?

[–] [email protected] 4 points 6 months ago* (last edited 6 months ago) (1 children)

I would like to retract the first sentence. It is misleading - the model can run without any hiccups with ROCm, and is probably a decent GPU for this job. However, I will provide more context on the second sentence.

I tried training and running models (GAN, LLM) on my Lenovo IdeaPad S540 (i5-8265U + 8GB + MX250 2GB laptop). The result of such heavy computation is that the battery is toast, the barrel port adapter is severely damaged where it connects with the board, the metallic panels have stress marks due to uneven heating, and the soldered RAM is a goner. And the battery has no capacity. Remember those old TVs where you had to hit them to make it work? That's the state of my device right now.

The cooling system in a laptop isn't the best. So, it would be better to run the model on a desktop or cloud GPU. By the way, older stable diffusion models seem to work on something as old as RX580 with ROCm.

[–] [email protected] 2 points 6 months ago* (last edited 6 months ago) (1 children)

I see. Thank you.

Would keeping it plugged in or removing the battery help with the battery issue?

Edit: Also, is there any way to force the GPU to throttle earlier to reduce damage?

[–] [email protected] 5 points 6 months ago

I think that would still be a bad idea - running billions of parameters on a laptop - because it's not just the battery, you might also want to think about how much the heat-sink can handle cooling. However, there's nothing wrong with running the model a few times. If that were a desktop GPU, it would handle a load as heavy as that easily.

Might I suggest you try using KOALA once? It has way lesser parameters than your typical large-scale diffusion model, so it will be forgiving on your device. Best of luck with your attempt.

Framework Laptop Community

Related links:

Related communities: