this post was submitted on 19 Nov 2023
496 points (86.9% liked)
Technology
58133 readers
4472 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm saying this because I do this for a living. It has become obvious to everyone in research (for example - https://arxiv.org/abs/2311.00059) that "AI"s don't understand what they are outputting. The secret sauce with all these large models is the data scale. That is, we have not had real algorithmic breakthroughs - it's just model scale and data scale. So we can make models that mimic human language and music etc but to go beyond, we need multiple fundamentally different breakthroughs. There is a ton of research attention now so it might happen, but it's not guaranteed - the improvements we've seen in the past few years will plateau as data plateaus (we are already there according to some, i.e we've used all the data on the Internet). Also, this - https://arxiv.org/abs/2305.17493v2
You do it for a living and you can't even understand what a general ai is. Alas I long since understood that mostly everyone is profoundly incompetent at their own jobs.