Technology

58303 readers

23 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

486

Public trust in AI is sinking across the board (www.axios.com)

submitted 8 months ago by [email protected] to c/[email protected]

95 comments fedilink hide all child comments

Trust in AI technology and the companies that develop it is dropping, in both the U.S. and around the world, according to new data from Edelman shared first with Axios.

Why it matters: The move comes as regulators around the world are deciding what rules should apply to the fast-growing industry. "Trust is the currency of the AI era, yet, as it stands, our innovation account is dangerously overdrawn," Edelman global technology chair Justin Westcott told Axios in an email. "Companies must move beyond the mere mechanics of AI to address its true cost and value — the 'why' and 'for whom.'"

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 8 months ago* (last edited 8 months ago) (1 children)

How about taking advice on a medical matter from an LLM? Or asking the appropriate thing to do in a survival situation? Or even seemingly mundane questions like "is it safe to use this [brand name of new model of generator that isn't in the LLM's training data] indoors?" Wrong answers to those questions can kill. If a person thinks the LLM is intelligent, they're more likely to take the bad advice at face value.

If you ask a human about something important that's outside their area of competence, they'll probably refer you to someone they think is knowledgeable. An LLM will happily make something up instead, because it doesn't understand the stakes.

The chance of any given query to an LLM killing someone is, admittedly, extremely low, but given a sufficiently large number of queries, it will happen sooner or later.

[+] [email protected] -3 points 8 months ago (2 children)

[deleted]

[–] [email protected] 5 points 8 months ago

Half of the human population is of below-average intelligence. They will be that dumb. Guaranteed. And safeguards generally only get added until after someone notices that a wrong answer is, in fact, wrong, and complains.

In part, I believe someone's going to die because large corporations will only get serious about controlling what their LLMs spew when faced with criminal charges or a lawsuit that might make a significant gouge in their gross income. Untill then, they're going to at best try to patch around the exact prompts that come up in each subsequent media scandal. Which is so easy to get around that some people are likely to do so by accident.

(As for humans making up answers, yes, some of them will, but in my experience it's not all that common—some form of "how would I know?" is a more likely response. Maybe the sample of people I have contact with on a regular basis is statistically skewed. Or maybe it's a Canadian thing.)

[–] [email protected] 4 points 8 months ago (1 children)

if you even ask a person and trust your life to them like that, unless they give you good reason they are reliable, you are a moron. Why would someone expect a machine to be intelligent and experienced like a doctor? That is 100% on them.

Insurance companies are already using AI to make medical decisions. We don't have to speculate about people getting hurt because of AI giving out bad medical advice, it's already happening and multiple companies are being sued over it.

[–] [email protected] -1 points 8 months ago

Somehow we went from me saying this technology shouldn't be downplayed to "but it's costing lives already!"

Not really sure how that happened but yeah it's obviously shitty that people are irresponsible shitheads and I think downplaying it or quibbling about whether it's actually AI or not is far from helpful in light of such consequences