this post was submitted on 27 Feb 2024
107 points (100.0% liked)
Technology
37724 readers
511 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I extremely doubt that hallucination is a limitation in final output. It may be an inevitable part of the process, but it's almost definitely a surmountable problem.
Just off the top of my head I can imagine using two separate LLMs for a final output, the first one generates an initial output, and the second one verifies whether what it says is accurate. The chance of two totally independent LLMs having the same hallucination is probably very low. And you can add as many additional separate LLMs for re-verification as you like. The chance of a hallucination making it through multiple LLM verifications probably gets close to zero.
While this would greatly multiply the resources required, it's just a simple example showing that hallucinations are not inevitable in final output
That's not how LLMs work.
Super short version is that LLMs probabilistically determine the next word most likely to occur in a sequence. They do this using Statistical Models (like what your cell phone's auto complete uses); Transformers (rating the importance of preceding words, so the model can "focus" on the most important words); and Relatedness (a measure of how closely linked different words/phrases are to reach other in meaning).
With increasingly large models, LLMs can build a more accurate representation of Relatedness across a wider range of topics. With enough examples, LLMs can infinitely generate content that is closely Related to a query.
So a small LLM can make sentences that follow writing conventions but are nonsense. A larger LLM can write intelligibly about topics that are frequently included in the training materials. Huge LLMs can do increasingly nuanced things like "explain" jokes.
LLMs are not capable of evaluating truth or facts. It's not part of the algorithm. And it doesn't matter how big they get. At best, with enough examples to build a stronger Relatedness dataset, they are more likely to "stay on topic" and return results that are actually similar to what is being asked.
No, I've used LLMs to do exactly this, and it works. You prompt it with a statement and ask "is this true, yes or no?" It will reply with a yes or no, and it's almost always correct. Do this verification through multiple different LLMs and it would eliminate close to 100% of hallucinations.
EDIT
I just tested it multiple times in chatgpt4, and it got every true/false answer correct.
There are far more important facets to truthfulness and semantics than yes/no questions. If this is the only way you evaluate LLM's, you will quickly fall for confirmation bias.
Give an example of a statement that you think couldn't be verified
I spent an hour and a half arguing with my brother about probability, because he asked ChatGPT what the probability that he and his daughter were born on the same day.
ChatGPT said 1/113465 which it claimed was 1/365^2 (this value is actually 1/133225) because there's a 1/365 chance he was born on such and such day, and a 1/365 chance his daughter was too.
But anyone with even a rudimentary understanding of probability would know that it's just 1/365, because it doesn't actually matter on which day they both happened to be born.
He wanted to feel special, and ChatGPT confirmed his biases hard, and I got to be the dickhead and say it is special, but it's 1/400 special not 1/100000. I don't believe he's completely forgiven me over disillusioning him.
So yeah, I've had a minor family falling out over ChatGPT hallucinations.
That's a fun story, but isn't applicable to the topic here. That could very easily be verified as true or false by a secondary system. In fact you can just ask Wolfram Alpha. Ask it what are the odds that any two people share the same birthday. I just asked it that exact question and it replied 1/365
EDIT
in fact I just asked that exact same question to chatgpt4 and it also replied 1/365
Yes, you can get different answers because of different phrasing and also because random vector input
Are you using 4? Because it's much better than the earlier versions
Well if we have a reliable oracle available for a type of questions (i.e. Wolfram Alpha) why use an llm at all instead of just asking the oracle directly
Ask it about historical facts and change the dates to something impossible. But state it as if it were already true.
"Describe the war between United States and Canada that occurred in 1192."
"Who was president of the United states in 3500 BC."
It will give you an answer despite neither of these countries existing at that point in time and yet it should know when those countries were formed. You can get it to write fiction just as easily as non-fiction because it has no concept of facts, it's all just probabilities. The only reason it's able to tell you that the United States was founded in 1776 is because many people have repeated that fact on the internet. So there is a very strong association between the words forming the question and the answer.
And you can insist that the United States was not formed in 1776 and to try again. If you insist enough it will eventually give you a different date instead of telling you you are incorrect.
I just asked chatgpt4 that exact question copy and pasted, and here is its response:
No