Technology

66465 readers

4849 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

686

AI search engines give incorrect answers at an alarming 60% rate, study says (arstechnica.com)

submitted 1 day ago by [email protected] to c/[email protected]

50 comments fedilink hide all child comments

cross-posted from: https://infosec.pub/post/24994013

CJR study shows AI search services misinform users and ignore publisher exclusion requests.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 1 day ago (2 children)

The AI models can be hilariously bad even on their own terms.

Yesterday I asked Gemini for a population figure (because I was too lazy to look it up myself). First I asked it:

what is the combined population of place 1, place 2 and place 3

It answered:

Unfortunately, providing an absolutely precise, up-to-the-minute combined population figure is difficult. Population numbers are constantly changing.

To find these figures, I would recommend checking the Office for National Statistics (ONS) website. They provide detailed population statistics for local authorities in England.

On a whim, I asked it again as:

combined population of place 1, place 2 and place 3

And then it gave me the answer sweet as a nut.

Apparently I was being too polite with it, I guess?

[–] [email protected] 2 points 19 hours ago* (last edited 19 hours ago)

I slapped a picture of a chart into Gemini because I didn’t know what the type of chart was called but I wanted to mention it in a Uni report. I was too lazy to go looking at chart types and thought that would be quicker.

I just asked it “What kind of chart is this” and it ignored that and started analysing the chart instead and started stating what the chart was about and giving insights into the chart. Didn’t tell me what kind of chart it was even though that was the only thing I asked.

Bear in mind that I deliberately cropped out any context to avoid it trying to do that, just in case, so all I got from it was pure hallucinations. It was just making pure shit up that I didn’t ask for.

I switched to the reasoning model and asked again, then it gave me the info I wanted.

[–] [email protected] 2 points 22 hours ago

Gotta let it take the W on that first answer, honestly.