this post was submitted on 03 Mar 2025
719 points (99.3% liked)

Technology

63614 readers
3271 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

But the explanation and Ramirez’s promise to educate himself on the use of AI wasn’t enough, and the judge chided him for not doing his research before filing. “It is abundantly clear that Mr. Ramirez did not make the requisite reasonable inquiry into the law. Had he expended even minimal effort to do so, he would have discovered that the AI-generated cases do not exist. That the AI-generated excerpts appeared valid to Mr. Ramirez does not relieve him of his duty to conduct a reasonable inquiry,” Judge Dinsmore continued, before recommending that Ramirez be sanctioned for $15,000.

Falling victim to this a year or more after the first guy made headlines for the same is just stupidity.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 140 points 17 hours ago (9 children)

“Mr. Ramirez explained that he had used AI before to assist with legal matters, such as drafting agreements, and did not know that AI was capable of generating fictitious cases and citations,” Judge Dinsmore wrote in court documents filed last week.

Jesus Christ, y'all. It's like Boomers trying to figure out the internet all over again. Just because AI (probably) can't lie doesn't mean it can't be earnestly wrong. It's not some magical fact machine; it's fancy predictive text.

It will be a truly scary time if people like Ramirez become judges one day and have forgotten how or why it's important to check people's sources yourself, robot or not.

[–] [email protected] 38 points 14 hours ago (3 children)

AI, specifically Laege language Models, do not “lie” or tell “the truth”. They are statistical models and work out, based on the prompt you feed them, what a reasonable sounding response would be.

This is why they’re uncreative and they “hallucinate”. It’s not thinking about your question and answering it, it’s calculating what words will placate you, using a calculation that runs on a computer the size of AWS.

[–] [email protected] 7 points 6 hours ago (1 children)

It's like when you're having a conversation on autopilot.

"Mum, can I play with my frisbee?" Sure, honey. "Mum, can I have an ice cream from the fridge?" Sure can. "Mum, can I invade Poland?" Absolutely, whatever you want.

[–] [email protected] 1 points 1 hour ago

So chat gpt started ww2

[–] [email protected] 3 points 7 hours ago

Don't need something the size of AWS these days. I ran one on my PC last week. But yeah, you're right otherwise.

[–] [email protected] 7 points 14 hours ago (2 children)
[–] [email protected] 16 points 13 hours ago (4 children)

a lie is a statement that the speaker knows to be wrong. wouldnt claiming that AIs can lie imply cognition on their part?

[–] [email protected] 11 points 13 hours ago (3 children)

I've had this lengthy discussion before. Some people define a lie as an untrue statement, while others additionally require intent to deceive.

[–] [email protected] 8 points 12 hours ago (1 children)

I would fall into the latter category. Lots of people are earnestly wrong without being liars.

[–] [email protected] 3 points 12 hours ago (1 children)

Me, too. But it also means when some people say "that's a lie" they're not accusing you of anything, just remarking you're wrong. And that can lead to misunderstandings.

[–] [email protected] 1 points 8 hours ago

Yep. Those people are obviously "liars," since they are using an uncommon colloquial definition. 😉

[–] [email protected] 3 points 11 hours ago (1 children)

The latter is the actual definition. Some people not knowing what words mean isnt an argument

[–] [email protected] 1 points 5 hours ago

Sure it is. You can define language all you want, the goal is to communicate with each other. The definition follows usage, not the other way around. Just look up the current definition for literally...

[–] [email protected] 1 points 9 hours ago* (last edited 9 hours ago) (1 children)

You can specifically tell an ai to lie and deceive though, and it will…

This was just in the news today.. although the headline says that the ai become psychopathic, they just told the ai to be immoral or something

[–] [email protected] 3 points 6 hours ago

Every time an AI ever does anything newsworthy just because it's obeying it's prompt.

It's like the people that claim the AI can replicate itself, yeah if you tell it to. If you don't give an AI any instructions it'll sit there and do nothing.

[–] [email protected] 4 points 12 hours ago

AI is just stringing words together that are statistically likely to appear near each other. It's a giant complex statistical model but it has no awareness of truth or lying

[–] [email protected] 4 points 13 hours ago (1 children)

AIs can generate false statements. It doesn't require a set of beliefs, it merely requires a set of input.

[–] [email protected] 3 points 11 hours ago* (last edited 11 hours ago)

A false statement would be me saying that the color of a light that I cannot see and have never seen that is currently red is actually green without knowing. I am just as easily probably right as I am probably wrong, statistics are involved.

A lie would be me knowing that the color of a light that I am currently looking at is currently red and saying that it is actually green. No statistics, I've done this intentionally and the only outcome of my decision to act was that I spoke a falsehood.

AIs can generate false statements, yes, but they are not capable of lying. Lying requires cognition, which LLMs are, by their own admission and by the admission of the companies developing them, at the very least not currently capable of, and personally I believe that it's likely that LLMs never will be.

[–] [email protected] 2 points 12 hours ago (3 children)

Me: I want you to lie to me about something.

ChatGPT: Alright—did you know that Amazon originally started as a submarine sandwich delivery service before pivoting to books? Jeff Bezos realized that selling hoagies online wasn’t scalable, so he switched to literature instead.

[–] [email protected] 3 points 11 hours ago (1 children)

Still not a lie still text that is statistically likely to fellow prior text produced by a model with no thought process that knows nothing

[–] [email protected] 2 points 9 hours ago

Lie falsehood, untrue statement, while intent is important in a human not so much in a computer which, if we are saying can not lie also can not tell the truth

[–] [email protected] 2 points 12 hours ago

AHS - Amazon Hoagies Services

[–] [email protected] 1 points 11 hours ago (1 children)
[–] [email protected] 2 points 11 hours ago (1 children)

Yeah, I know how LLMs work, but still, if the definition of lying is giving some false absurd information knowing it is absurd you can definitely instruct an LLM to “lie”.

[–] [email protected] 2 points 11 hours ago

A crucial part of your statement is that it knows that it's untrue, which it is incapable of. I would agree with you if it were actually capable of understanding.

[–] [email protected] 1 points 12 hours ago

Yeah lol, and it's trivial to show

[–] [email protected] 5 points 16 hours ago (2 children)

It can and will lie. It has admitted to doing so after I probed it long enough about the things it was telling me.

[–] [email protected] 16 points 14 hours ago* (last edited 14 hours ago) (17 children)

Lying requires intent. Currently popular LLMs build responses one token at a time—when it starts writing a sentence, it doesn't know how it will end, and therefore can't have an opinion about the truth value of it. (I'd go further and claim it can't really "have an opinion" about anything, but even if it can, it can neither lie nor tell the truth on purpose.) It can consider its own output (and therefore potentially have an opinion about whether it is true or false) only after it has been generated, when generating the next token.

"Admitting" that it's lying only proves that it has been exposed to "admission" as a pattern in its training data.

[–] [email protected] 14 points 14 hours ago

I strongly worry that humans really weren't ready for this "good enough" product to be their first "real" interaction with what can easily pass as an AGI without near-philosophical knowledge of the difference between an AGI and an LLM.

It's obscenely hard to keep the fact that it is a very good pattern-matching auto-correct in mind when you're several comments deep into a genuinely actually no lie completely pointless debate against spooky math.

load more comments (16 replies)
[–] [email protected] 2 points 11 hours ago

You can't ask it about itself because it has no internal model of self and is just basing any answer on data in its training set

[–] [email protected] 4 points 16 hours ago (3 children)

You don't need any knowledge of computers to understand how big of a deal it would be if we actually built a reliable fact machine. For me the only possible explanation is to not care enough to try and think about it for a second.

[–] [email protected] 5 points 12 hours ago

That's fundamentally impossible. There's always some baseline you trust that decides what is true

[–] [email protected] 5 points 14 hours ago

We did, a long time ago. It's called an encyclopedia.

If humans can't be trusted to only provide facts, how can we be trusted to make a machine that only provides facts? How do we deal with disputed truths? Grey areas?

[–] [email protected] 3 points 14 hours ago (1 children)

We actually did. Trouble being you need experts to feed and update the thing, which works when you're watching dams (that doesn't need to be updated) but fails in e.g. medicine. But during the brief time where those systems were up to date they did some astonishing stuff, they were plugged into the diagnosis loop and would suggest additional tests to doctors, countering organisational blindness. Law is an even more complex matter though because applying it requires an unbounded amount of real-world and not just expert knowledge, so forget it.

load more comments (5 replies)