this post was submitted on 23 Sep 2023
337 points (92.9% liked)

Technology

58303 readers
9 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

A very NSFW website called Pornpen.ai is churning out an endless stream of graphic, AI-generated porn. We have mixed feelings.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 26 points 1 year ago (1 children)

The actual scary use case for AI porn is that if you can get 50 or more photos of the same person's face (almost anyone with an Instagram account), you can train your own LoRA model to generate believable images of them, which means you can now make "generic looking" porn with pretty much any person you want to see in it. Basically the modern equivalent of gluing cutouts of your crush's face onto the Playboy centerfold, only with automated distribution over the Internet...

[–] [email protected] 20 points 1 year ago (1 children)

Using a LoRA was the old way, these days you can use Roop, FaceSwapLab or ReActor, which not only can work with as little as a single good photo, they also produce better locking results than LoRA. There is no time consuming training either, just drag&drog an image and you get results in a couple of seconds.

[–] [email protected] 4 points 1 year ago (4 children)

So how will any progressive politician be able to be elected then? Because all the fascists would have to do is generate porn with their opponent's likeness to smear them.

Or even worse, deepfake evidence of rape.

Or even worse than that, generate CSAM with their likeness portrayed abusing a child.

They could use that to imprison not only their political opponents, but anyone for anything, and people would think whoever is being disappeared this week actually is a pedophile or a rapist and think nothing of it.

Actual victims' movements would be chopped off at the knee, because now there's no definitive way to prove an actual rape happened since defendants could credibly claim real videos are just AI generated crap and get acquitted. No rape or abuse claims would ever be believed because there is now no way to establish objective truth.

This would leave the fascists open to do whatever they want to anybody with no serious consequences.

But no one cares because they want AI to do their homework for them so they don't have to think, write, or learn to be creative on their own. They want to sit around on their asses and do nothing.

[–] [email protected] 7 points 1 year ago (1 children)

People will have to learn to stop believing everything they see. This has been possible with Photoshop for even more than a decade now. All that's changed is that it takes less skill and time now.

[–] [email protected] -4 points 1 year ago (3 children)

That's not possible with AI-generated images impossible to distinguish from reality, or even expertly done photoshops. The practice, and generative AI as a whole, needs to be banned. They're putting AI in photoshop too so ban that garbage too.

It has to stop. We can't allow the tech industry to enable fascism and propaganda.

[–] [email protected] 5 points 1 year ago

This reads like satire.

[–] [email protected] 4 points 1 year ago (1 children)

You're proposing to build a dam with duct tape.

[–] [email protected] -3 points 1 year ago (1 children)

Nah, that Thanos I-am-inevitable shit doesn't work on me. They can ban AI, you all just don't want it because generative AI allows you to steal other people's talent so you can pretend you have your own

[–] [email protected] 4 points 1 year ago

You are literally trying to fight math.

[–] [email protected] 1 points 1 year ago (1 children)

Can't tell whether this is bait or if you are seriously that much of a Luddite.

[–] [email protected] 1 points 1 year ago

Oh look at that, they just released pictures of you raping a 4-year-old, off to prison with you. Never mind they're not real. That's the world you wanted and those are the consequences you're going to get if you don't stop being lazy and learn to reject terrible things on ethical grounds.

[–] [email protected] 4 points 1 year ago (1 children)

We're going to go back to the old model of trust, before videos and photos existed. Consistent, coherent stories from sources known to be trustworthy will be key. Physical evidence will be helpful as well.

[–] [email protected] 1 points 1 year ago (1 children)

But then people will say "Well how do we know they're not lying?" and then it's back to square 1.

Victims might not ever be able to get justice again if this garbage is allowed to continue. Society's going so off-track.

[–] [email protected] 1 points 1 year ago (1 children)

How often does video evidence of rape exist, though? I don't think this really changes anything for most victims.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

See Stuebenville, Ohio where the dumb motherfuckers date raped a girl and put the video on Facebook.

People do shit like that.

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago) (1 children)

Because that's called Libel and is very much illegal in practically any country on earth - and depending on the country it's either easy or trivial to put forth and win a case of libel in court, since it's the onus of the defendant to prove what they said was entirely true, and "just trust me and this actress I hired, bro" doesn't cut it.

[–] [email protected] 0 points 1 year ago (1 children)

So what happens when evildoers give AI-generated deepfakes to news media so they can avoid liability?

[–] [email protected] 3 points 1 year ago

The burden of liability will then fall on the media company, which can then be sued for not carrying out due dilligance in reporting.