this post was submitted on 03 May 2025
775 points (98.0% liked)

Technology

69702 readers
2886 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 43 points 12 hours ago (3 children)

This is probably the most ethical you'll ever see it. There are definitely organizations committing far worse experiments.

Over the years I've noticed replies that are far too on the nose. Probing just the right pressure points as if they dropped exactly the right breadcrumbs for me to respond to. I've learned to disengage at that point. It's either they scrolled through my profile. Or as we now know it's a literal psy-op bot. Already in the first case it's not worth engaging with someone more invested than I am myself.

[–] [email protected] 1 points 2 hours ago (1 children)

Over the years I’ve noticed replies that are far too on the nose. Probing just the right pressure points as if they dropped exactly the right breadcrumbs for me to respond to. I’ve learned to disengage at that point. It’s either they scrolled through my profile. Or as we now know it’s a literal psy-op bot. Already in the first case it’s not worth engaging with someone more invested than I am myself.

You put it better than I could. I've noticed this too.

I used to just disengage. Now when I find myself talking to someone like this I use my own local LLM to generate replies just to waste their time. I'm doing this by prompting the LLM to take a chastising tone, point out their fallacies and to lecture them on good faith participation in online conversations.

It is horrifying to see how many bots you catch like this. It is certainly bots, or else there are suddenly a lot more people that will go 10-20 multi-paragraph replies deep into a conversation despite talking to something that is obviously (to a trained human) just generated comments.

[–] [email protected] 1 points 2 hours ago (1 children)

Would you mind elaborating? I'm naive and don't really know what to look for...

[–] [email protected] 1 points 2 hours ago* (last edited 2 hours ago)

I think the simplest way to explain it is that the average person isn't very skilled at rhetoric. They argue inelegantly. Over a long time of talking online, you get used to talking with people and seeing how they respond to different rhetorical strategies.

In these bot infested social spaces it seems like there are a large number of commenters who just seem to argue way too well and also deploy a huge amount of fallacies. This could be explained, individually, by a person who is simply choosing to argue in bad faith; but, in these online spaces there seem to be too many commenters who seem to deploy these tactics compared to the baseline that I've established in my decades of talking to people online.

In addition, what you see in some of these spaces are commenters who seem to have a very structured way of arguing. Like they've picked your comment apart into bullet points and then selected arguments against each point which are technically on topic but misleading in a way.

I'll admit that this is all very subjective. It's entirely based on my perception and noticing patterns that may or may not exist. This is exactly why we need research on the topic, like in the OP, so that we can create effective and objective metrics for tracking this.

For example, if you could somehow measure how many good faith comments vs how many fallacy-laden comments in a given community there would likely be a ratio that is normal (i.e. there are 10 people who are bad at arguing for every 1 person who is good at arguing and, of those skilled arguers 10% of them are commenting in bad faith and using fallacies) and you could compare this ratio to various online topics to discover the ones that appear to be botted.

That way you could objectively say that on the topic of Gun Control on this one specific subreddit we're seeing an elevated ratio of bad faith:good faith scoring commenters and, therefore, we know that this topic/subreddit is being actively LLM botted. This information could be used to deploy anti-bot counter measures (captchas, for example).

[–] [email protected] 17 points 12 hours ago (1 children)

Yeah I was thinking exactly this.

It's easy to point to reasons why this study was unethical, but the ugly truth is that bad actors all over the world are performing trials exactly like this all the time - do we really want the only people who know how this kind of manipulation works to be state psyop agencies, SEO bros, and astroturfing agencies working for oil/arms/religion lobbyists?

Seems like it's much better long term to have all these tricks out in the open so we know what we're dealing with, because they're happening whether it gets published or not.

[–] [email protected] 2 points 10 hours ago

actors all over the world are performing trials exactly like this all the time

I marketing speak this is called A/B testing.

[–] [email protected] 10 points 11 hours ago (1 children)

But you aren't allowed to mention Luigi

[–] [email protected] 3 points 6 hours ago (1 children)

You’re banned for inciting violence.

[–] [email protected] 5 points 6 hours ago

Free Luigi

Eat the rich

The police are a terrorist organization

Trump and Epstein bff