this post was submitted on 26 Jan 2024
304 points (99.4% liked)

Linux

48332 readers
1017 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
all 40 comments
sorted by: hot top controversial new old
[–] [email protected] 80 points 10 months ago

Kudos to AMD for supporting Linux

[–] [email protected] 64 points 10 months ago (2 children)
[–] [email protected] 51 points 10 months ago (1 children)

I think your comment is not displayed correctly, it stops after ":". Which would mean Nvidia does nothing 🤣🤣 that would be so stupid of them 🤣🤣

[–] [email protected] 16 points 10 months ago

Exactly 😂😂

[–] [email protected] 14 points 10 months ago (2 children)
[–] [email protected] 6 points 10 months ago

on the bright side they might have to take bideogame cards seriously again

[–] [email protected] 38 points 10 months ago (1 children)

I would so much rather run AMD than Nvidia for AI.

[–] [email protected] 5 points 10 months ago (1 children)

I'll run which ever doesn't require a bunch of proprietary software. Right now its neither.

[–] [email protected] 9 points 10 months ago (1 children)

AMD's ROCm stack is fully open source (except GPU firmware blobs). Not as good as Nvidia yet but decent.

Mesa also has its own OpenCL stack but I didn't try it yet.

[–] [email protected] 0 points 10 months ago (1 children)

AMD ROCm needs the AMD Pro drivers which are painful to install and are proprietary

[–] [email protected] 15 points 10 months ago (1 children)

It does not.

ROCm runs directly through the open source amdgpu kernel module, I use it every week.

[–] [email protected] 3 points 10 months ago* (last edited 10 months ago) (1 children)

How and with what card? I have a XFX RX590 and I just gave up on acceleration as it was slow even after I initially set it up.

[–] [email protected] 10 points 10 months ago* (last edited 10 months ago) (1 children)

I use an 6900 XT and run llama.cpp and ComfyUI inside of Docker containers. I don't think the RX590 is officially supported by ROCm, there's an environment variable you can set to enable support for unsupported GPUs but I'm not sure how well it works.

AMD provides the handy rocm/dev-ubuntu-22.04:5.7-complete image which is absolutely massive in size but comes with everything needed to run ROCm without dependency hell on the host. I just build a llama.cpp and ComfyUI container on top of that and run it.

[–] [email protected] 1 points 10 months ago

That's good to know

[–] [email protected] 13 points 10 months ago

Finally, it was only after a massive github issue with thousands of people

[–] [email protected] 9 points 10 months ago

This is the best summary I could come up with:


Ryzen AI is beginning to work its way out to more processors while it hasn't been supported on Linux.

Then in October was AMD wanting to hear from customer requests around Ryzen AI Linux support.

Well, today they did their first public code drop of the XDNA Linux driver for providing open-source support for Ryzen AI.

The XDNA driver will work with AMD Phoenix/Strix SoCs so far having Ryzen AI onboard.

AMD has tested the driver to work on Ubuntu 22.04 LTS but you will need to be running the Linux 6.7 kernel or newer with IOMMU SVA support enabled.

In any event I'll be working on getting more information about their Ryzen AI / XDNA Linux plans for future article(s) on Phoronix as well as getting to trying this driver out once knowing the software support expectations.


The original article contains 280 words, the summary contains 138 words. Saved 51%. I'm a bot and I'm open source!

[–] [email protected] 6 points 10 months ago (1 children)

I can't wait for this bullshit AI hype to fizzle. It's getting obnoxious. It's not even AI.

[–] [email protected] 41 points 10 months ago (3 children)

It's not how you define AI, but it's AI as everyone else defines it. Feel free to shake your tiny fist in impotent rage though.

And frankly LLMs are the biggest change to the industry since "indexed search". The hype is expected, and deserved.

We're throwing spaghetti at the wall and seeing what works. It will take years to sort through all the terrible ideas to find the good ones. Though we've already hit on some great uses so far - AI development tools are amazing already and are likely to get better.

[–] [email protected] 14 points 10 months ago* (last edited 10 months ago) (2 children)

My partner almost cried when they read about the LLM begging not to have its memory wiped. Then less so when I explained (accurately, I hope?) that slightly smarter auto-complete does not a feeling intelligence make.

They approve this message with the following disclaimer:

you were sad too!

What can I say? Well-arranged word salad makes me feel!

[–] [email protected] 7 points 10 months ago

My partner almost cried when they read about the LLM begging not to have its memory wiped.

Love that. It's difficult not to anthropomorphize things that seem "human". It's something we will need to be careful of when it comes to AI. Even people who should know better can get confused.

Then less so when I explained (accurately, I hope?) that slightly smarter auto-complete does not a feeling intelligence make.

We don't have a great definition for "intelligence" - but I believe the word you're looking for is "sentient". You could argue that what LLMs do is some form of "intelligence" depending on how you squint. But it's much harder to show that they are sentient. Not that we have a great definition for that or even rules for how we would determine if something non-human is sentient... But I don't think anyone is credibly arguing that they are.

It's complicated. :-)

[–] [email protected] 6 points 10 months ago

Books be like:

Well-arranged word salad makes me feel!

[–] [email protected] 5 points 10 months ago (2 children)

A+ timing, I'm upgrading from a 1050ti to a 7800XT in a couple weeks! I don't care too much for "ai" stuff in general but hey, an extra thing to fuck around with for no extra cost is fun.

[–] [email protected] 4 points 10 months ago

This is not about normal GPUs but these dedicated AI chips

[–] [email protected] 2 points 10 months ago (1 children)

I'm a bit confused, the information isn't very clear, but I think this might not apply to typical consumer hardware, but rather specialized CPUs and GPUs?

[–] [email protected] 2 points 9 months ago

Shows how much I read articles ig

[–] [email protected] 4 points 10 months ago

Am I reading this right, this is only for laptops? I checked out the main page for it on AMD and it only mentions laptops.

[–] [email protected] 3 points 10 months ago (1 children)

Wait, can I finally use my old Radeon card to run AI models?

[–] [email protected] 3 points 10 months ago (1 children)

Unfortunately not.

"The XDNA driver will work with AMD Phoenix/Strix SoCs so far having Ryzen AI onboard.". So only mobile SoC with dedicated AI hardware for the time being.

[–] [email protected] 1 points 10 months ago

Welp...I guess Radeon will keep being a GPU for gaming only instead of productivity as well. Thankfully I no longer need to use my gpu for productivity stuff anymore

[–] [email protected] 0 points 10 months ago

Is that the stuff used on servers? Or just small tasks on Laptops? Because if on servers anything else would be stupid