this post was submitted on 02 Sep 2024
1177 points (98.6% liked)

Memes

45681 readers
712 users here now

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.

founded 5 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 12 points 2 months ago* (last edited 2 months ago) (1 children)

The way you phrased that perfectly illustrates the current problem AI has: In a problem space as large as natural language, there are nearly an infinite number of ways it can be wrong. So no matter how much data we feed it, there will always be some "brand new sentence" someone asks that breaks it and causes a wrong answer.

[โ€“] [email protected] 6 points 2 months ago

Absolutely. It's why asking it for facts is inherently bad. It can't retain information, it is trained to give output shaped like an answer. It's pretty good at things that don't have a specific answer (I'll never write another cover letter thank blob).

Now, if someone were to have the good sense to have some kind of lookup to inject correct information between the prompt and the output, we'd be cooking with gas. But that's really human labor intensive and all the tech bros are trying to avoid that.