this post was submitted on 03 Dec 2024
241 points (97.6% liked)

Technology

60113 readers
2723 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

If even half of Intel's claims are true, this could be a big shake up in the midrange market that has been entirely abandoned by both Nvidia and AMD.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

Its weird that Intel/AMD seem so disinterested in the LLM self hosting market. I get its not massive, but it seems way big enough for niche SKUs like they were making for blockchain, and they are otherwise tripping over themselves to brand everything with AI.

[–] [email protected] 4 points 3 weeks ago (1 children)

Exactly. Nvidia's thing is RTX, and Intel/AMD don't seem interested in chasing that. So their thing could be high mem for LLMs and whatnot. It wouldn't cost them that much (certainly not as much as chasing RTX), and it could grow their market share. Maybe make an extra high mem SKU with the same exact chip and increase the price a bit.

[–] [email protected] 7 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

Well AMD won't do it ostensibly because they have a high mem workstation card market to protect, but the running joke is they only sell like a dozen of those a month, lol.

Intel literally had nothing to lose though... I don't get it. And yes, this would be a very cheap thing for them to try, just a new PCB (and firmware?) which they can absolutely afford.

[–] [email protected] 4 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

They might not even need a new PCB, they might be able to just double the capacity of their mem chips. So yeah, I don't understand why they don't do it, it sounds like a really easy win. It probably wouldn't add up to a ton of revenue, but it makes for a good publicity stunt, which could help a bit down the road.

AMD got a bunch of publicity w/ their 3D Cache chips, and that cost a lot more than adding a bit more memory to a GPU.

[–] [email protected] 1 points 3 weeks ago (1 children)

Are the double capacity GDDR6X ICs being sold yet? I thought they weren't and "double" cards like the 4060 TI were using 2 chips per channel.

[–] [email protected] 1 points 3 weeks ago

I'm really not sure, and I don't think we have a teardown yet either, so we don't know what capacities they're running.

Regardless, whether it's a new PCB or just swapping chips shouldn't matter too much for overall costs.