this post was submitted on 19 Feb 2025
108 points (99.1% liked)

Privacy

1301 readers
65 users here now

Protect your privacy in the digital world

Welcome! This is a community for all those who are interested in protecting their privacy.

Rules

PS: Don't be a smartass and try to game the system, we'll know if you're breaking the rules when we see it!

  1. Be nice, civil and no bigotry/prejudice.
  2. No tankies/alt-right fascists. The former can be tolerated but the latter are banned.
  3. Stay on topic.
  4. Don't promote big-tech software.
  5. No reposting of news that was already posted. Even from different sources.
  6. No crypto, blockchain, etc.
  7. No Xitter links. (only allowed when can't fact check any other way, use xcancel)

Related communities:

founded 4 months ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
108
DeepSeek 'shared user data' with TikTok owner ByteDance (www.bbc.com)
submitted 2 weeks ago by [email protected] to c/[email protected]
18 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 2 weeks ago (1 children)

Don't iGPUs use the RAM as VRAM directly? You'd only need to configure how much in the BIOS (eg. by default it uses 1.5GB of 8GB or smth and you can set it to 6/8GB)

[โ€“] [email protected] 2 points 2 weeks ago* (last edited 2 weeks ago)

Yes for gaming, but for LLMs I've heard that the bandwidth limitations of using system RAM as vram hurts performance worse than running on the CPU using system memory directly, since smaller models are more memory bandwidth limited.

I've never tried to run AI on an igpu with system memory though so you could try it, assuming it will let you allocate like 32GB or more like 64GB. I think you'll also need a special runner that supports igpus.