AMD

151 readers

6 users here now

Advanced Micro Devices, Inc. (AMD) is an American multinational corporation and fabless semiconductor company that designs, develops and sells computer processors and related technologies for business and consumer markets.

AMD's main products include microprocessors, motherboard chipsets, embedded processors, and graphics processors for servers, workstations, personal computers, and embedded system applications. The company has also expanded into new markets, such as the data center, gaming, and high-performance computing markets. AMD's processors are used in a wide range of computing devices, including personal computers, servers, laptops, and gaming consoles.

Icon attribution

If someone is interested in moderating this community, message @[email protected].

founded 3 months ago

MODERATORS

[email protected]

AM5 CPU + Chipset for 2+ GPUs? (lemmy.zip)

submitted 4 days ago* (last edited 4 days ago) by [email protected] to c/[email protected]

4 comments fedilink hide all child comments

Hello!

I'm looking into buying a system for running inference with small to medium size LLM models. I wonder, is there any AM5 CPU + Chipset combination that supports 2x PCIe 16x with all lanes connected directly to the CPU? From what I've gathered my understanding is that there is no such configuration because the Ryzen 7000/9000 only have 24 PCIe lanes at best. This means I have to go for a Threadripper configuration, which is much more expensive. (The ROCm mGPU documentation states that all lanes shall be connected directly to the CPU.)

It's possible that I can manage running two GPUs with 8x lanes, but it's for sure not optimal..

But the thing is, it is quite hard for me to navigate the AMD website and the websites of various motherboard producers. I might very well be wrong.

So again: Is there any AM5 CPU + chipset combination that supports 2x PCIe 16x with all lanes connected directly to the CPU?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 4 days ago

Is there any AM5 CPU + chipset combination that supports 2x PCIe 16x with all lanes connected directly to the CPU?

No, because the CPU doesn't have that many PCIe lanes on it. There are only 24 on the CPU socket.

However... They are Gen5 lanes and potentially twice the speed of gen4. So, you can get X870 boards which have two x8 gen5 slots. Very few gpus are gen5 yet though.