Technology

58303 readers

10 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

349

AI Computing on Pace to Consume More Energy Than India, Arm Says (news.bloomberglaw.com)

submitted 6 months ago by [email protected] to c/[email protected]

60 comments fedilink hide all child comments

AI’s voracious need for computing power is threatening to overwhelm energy sources, requiring the industry to change its approach to the technology, according to Arm Holdings Plc Chief Executive Officer Rene Haas.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 6 months ago (1 children)

ML is not an ENIAC situation. Computers got more efficient not by doing fewer operations, but by making what they were already doing much more efficient.

The basic operations underlying ML (e.g. matrix multiplication) are already some of the most heavily optimized things around. ML is inefficient because it needs to do a lot of that. The problem is very different.

[–] [email protected] 1 points 6 months ago (1 children)

There's an entire resurgence of research into alternative computing architectures right now, being led by some of the biggest names in computing, because of the limits we've hit with the von Neumann architecture as regards ML. I don't see any reason to assume all of that research is guaranteed to fail.

[–] [email protected] 2 points 6 months ago (1 children)

I'm not assuming it's going to fail, I'm just saying that the exponential gains seen in early computing are going to be much harder to come by because we're not starting from the same grossly inefficient place.

As an FYI, most modern computers are modified Harvard architectures, not Von Neumann machines. There are other architectures being explored that are even more exotic, but I'm not aware of any that are massively better on the power side (vs simply being faster). The acceleration approaches that I'm aware of that are more (e.g. analog or optical accelerators) are also totally compatible with traditional Harvard/Von Neumann architectures.

[–] [email protected] 1 points 6 months ago

And I don't know that by comparing it to ENIAC I intended to suggest the exponential gains would be identical, but we are currently in a period of exponential gains in AI and it's not exactly slowing down. It just seems unthoughtful and not very critical to measure the overall efficiency of a technology by its very earliest iterations, when the field it's based on is moving as fast as AI is.