this post was submitted on 03 Aug 2023
73 points (100.0% liked)
Chat
7499 readers
7 users here now
Relaxed section for discussion and debate that doesn't fit anywhere else. Whether it's advice, how your week is going, a link that's at the back of your mind, or something like that, it can likely go here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is anyone checking the AI "summariser" bot for accuracy? I'd rather not get misleading ideas in my head from a poor summary.
Is someone checking human summarizers as well? I mean, humans make mistakes but also generally adds flavours, and can focus on things due to inherent bias. In fact, this is actually an area were bots can probably produce more factually correct and unbiased summaries than humans (depends on the quality of course).
The way past both is to actually read the article?
Erm, well, yes. That should happen too. Tends to in a good community with a range of views.
I asked a single question on a single facet of the current internet. For my own information, because I've found reading a range of articles about Chat GPT useful for understanding and beginning to form my own opinion on them. And rather than add any helpful information, you've gone down this tangent? 🤷♂️
Your "In fact" rebuttal, not needed btw, is technically true. I'm more interested in the current actual state of things with a particular bot, not a hypothetical.
Human-written posts differ in tone from the summary-bot. The bot "writes" more in the tone of an article, which tends to mean a tone of authority. That affects how the "facts" resurface in my memory. Maybe it works differently for the bright young things who've grown up with the internet. IDK 🤷♂️
Of course reading the articles is important. I don't have the spoons to read every article I come across though. I know I don't have much of a life, but still 😂 Scanning comments is a bit more like human interaction and I find that helpful in deciding whether or not to click through to the article.
And before anyone jumps in with "Then the summary bot will be really helpful to you", please note that my question was about the accuracy of the bot and if anyone was gathering information. I will make my own observations over time but would also like to learn from others'.
The bot has now been disabled as per the decision of Beehaw. Contact your favorite community mods if you'd like to change that.
To answer your question, yes, I am checking it for accuracy as I'm the author and I'd like it to be as useful as it can be. I'd say its summary is really helpful in 90+% of cases, the rest could be better and only once I've seen it post a summary that wasn't helpful at all.
Thanks for this :)
No problem! Hopefully we'll come to some agreement with Beehaw mods/admins, you can follow the (hopefully fruitful) discussion here: https://beehaw.org/comment/858784