Futurology

1735 readers

146 users here now

founded 1 year ago

MODERATORS

[email protected]

Google says it's AI is now recursively improving its own chips faster than human experts can. (www.nature.com)

submitted 1 week ago by [email protected] to c/[email protected]

8 comments fedilink hide all child comments

top 8 comments

sorted by: hot top controversial new old

[–] [email protected] 25 points 1 week ago

Yeah, no, that is not what the article says. AlphaChip is better at component/module placement in terms of connection length between them.

Not to say that that isn't cool. But it is not recursive. That would imply that the chip with shorter connection length improves the models performance significantly, which they do not claim at all. Because it would quickly reach diminishing returns.

There is a thousand things that go into making chips. Many will benefit from the automatic optimization of such algorithms. But this doesn't suddenly give you a new manufacturing node or anything comparable out of thin air. Just a marginal improvement on existing design.

[–] [email protected] -4 points 1 week ago* (last edited 1 week ago) (3 children)

For anyone familiar with the ideas behind what Ray Kurzweil called 'The Singularity', this looks awfully like it's first baby steps.

For those that don't know, the idea is that when AI gets the ability to improve itself, it will begin to become exponentially more powerful. As each step will make it even better, at designing the next generation of chips to make it more powerful.

[–] [email protected] 19 points 1 week ago

This is not even close to singularity-level AI scaling.

The way that Nature is phrasing this is quite disingenuous because they make it sound like AI algorithms are designing the chips that the same AI algorithms are running on, which would logically lead to an exponential increase as predicted by Kurzweil and in science fiction.

AlphaChip (the AI model described in the paper) is only performing chip layout. This is the stage of chip design where you already have the chip design at a functional block level, and the layout algorithm must then decide where to place all of the elements on the silicon so that it can connect them all together correctly in the most efficient way (in terms of space used and connection lengths required).

Placement is important but it we have been using algorithms for placement and routing for decades (possibly since the very beginning of VLSI), so the only new thing here is that it's a reinforcement learning model which is doing the placement instead of a human-constructed algorithm.

In order for us to reach a runaway singularity level of AI self-improvement, we first need an AI that can actually design the chips from the functional level. I have no doubt that Google are working on that but for now chip design, just like every other form of engineering design, is very much a human activity.

AlphaChip is just the beginning. We envision a future in which AI methods automate the entire chip design process, dramatically accelerating the design cycle and unlocking new frontiers in performance through superhuman algorithms and end-to-end co-optimization of hardware, software, and machine learning models

The poor phrasing of this article is just more AI hype, designed to appeal to the people who believe that the singularity is near.

[–] [email protected] 15 points 1 week ago (1 children)

LLMs are not really AI

[–] [email protected] 3 points 1 week ago (1 children)

Fascinating and quite terrifying.

[–] [email protected] -3 points 1 week ago

I've been familiar with his ideas for years, even though intellectually I could see they were true, emotionally I always felt they were science-fiction. Now this is starting to look like science-fact.