Technology

58303 readers

11 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

446

“Model collapse” threatens to kill progress on generative AIs (bigthink.com)

submitted 2 months ago by [email protected] to c/[email protected]

152 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago)

At least in this case, we can be pretty confident that there's no higher function going on. It's true that AI models are a bit of a black box that can't really be examined to understand why exactly they produce the results they do, but they are still just a finite amount of data. The black box doesn't "think" any more than a river decides its course, though the eventual state of both is hard to predict or control. In the case of model collapse, we know exactly what's going on: the AI is repeating and amplifying the little mistakes it's made with each new generation. There's no mystery about that part, it's just that we lack the ability to directly tune those mistakes out of the model.