this post was submitted on 27 Jun 2024

31 points (94.3% liked)

Machine Learning

490 readers

1 users here now

A community for posting things related to machine learning

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

founded 1 year ago

MODERATORS

31

Researchers upend AI status quo by eliminating matrix multiplication in LLMs (arstechnica.com)

submitted 5 months ago by [email protected] to c/machine_learning

7 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 15 points 5 months ago* (last edited 5 months ago) (3 children)

The technique has not yet been peer-reviewed

Let's see, then.

[–] [email protected] 3 points 4 months ago

They claim it's more efficient, which presumably means it requires less electricity to run the same process. Which means that if this is legit, the companies that do AI should implement it organically as a way to shave costs. If they have any brains whatsoever.

[–] [email protected] 3 points 4 months ago

The peer review process is way too noisy to be meaningful. Better to just read it and judge the work for yourself.

https://arxiv.org/abs/2406.02528

Or wait for follow up work that can corroborate their claims.

[–] SatouKazuma 3 points 5 months ago

Yeah I'm not exactly holding my breath.