this post was submitted on 05 May 2025
13 points (72.4% liked)

Artificial Intelligence

1585 readers
11 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 2 years ago
MODERATORS
[email protected]
13
Anthropic CEO Admits We Have No Idea How AI Works (futurism.com)
submitted 6 days ago by [email protected] to c/[email protected]
6 comments fedilink hide all child comments
top 6 comments
sorted by: hot top controversial new old
[–] [email protected] 16 points 6 days ago (2 children)

This bullshit propaganda is intensely frustrating. Stop pretending these models are magic. This propaganda is meant to mystify and fascinate idiots.

Here is a short reading list that will explain to a competent person how generative transformers work.

https://jaykmody.com/blog/gpt-from-scratch/#fn1

https://explainextended.com/2023/12/31/happy-new-year-15/

https://jalammar.github.io/how-gpt3-works-visualizations-animations/

https://arxiv.org/abs/1706.03762

Enough pretend-along. They aren't smarter than you.

[–] [email protected] 2 points 5 days ago

Good on you for saying it so eloquently. None of them would have dared to say anything remotely similar to 'we don't know' if it really was the case

[–] kogasa 1 points 5 days ago

The GPT architecture is well understood, the part that is hard to explain is the way information is encoded in the trained model's parameters. It's not magic, it's just a highly opaque encoding.

[–] [email protected] 4 points 6 days ago (1 children)

I'm not the least bit surprised the CEO has no idea how these things work. But if the CEO not understanding something makes it magic, that also makes computers, cell phones, cars, the weather, healthy relationships, and being a decent person magic as well.

[–] [email protected] 2 points 5 days ago

Remind me of the old saying about them ancient rotary dials phones, how no one in the world knows how to build one fully from scratch.

You made great analogies and very true

[–] [email protected] 2 points 5 days ago

Anthropic is getting left in the dust.