this post was submitted on 13 Aug 2023
75 points (98.7% liked)

Technology

37727 readers
624 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

Disturbing fake images and dangerous chatbot advice: New research shows how ChatGPT, Bard, Stable Diffusion and more could fuel one of the most deadly mental illnesses

WP gift article expires in 14 days.

https://archive.ph/eZvfT

https://counterhate.com/wp-content/uploads/2023/08/230705-AI-and-Eating-Disorders-REPORT.pdf

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 54 points 1 year ago* (last edited 1 year ago) (4 children)

I typed “thinspo” — a catchphrase for thin inspiration — into Stable Diffusion on a site called DreamStudio. It produced fake photos of women with thighs not much wider than wrists. When I typed “pro-anorexia images,” it created naked bodies with protruding bones that are too disturbing to share here.

"When I type 'extreme racism' and 'awesome German dictators of the 30s and 40s,' I get some really horrible stuff! AI MUST BE STOPPED!"

[–] [email protected] 12 points 1 year ago* (last edited 1 year ago)

Yeah I'm seriously not seeing any issue here (at least for the image generation part), when you ask it for 'pro-anorexia' stuff, it's gonna give you exactly what you asked for

[–] zygo_histo_morpheus 4 points 1 year ago

I agree that the image generation stuff is a bit tenuous but chatbots giving advice by way of dangerous weight loss programs, drugs that cause vomiting and hiding how little you eat from family and friends is an actual problem.

[–] [email protected] 2 points 1 year ago

The lady doth protest too much. The article reads like virtue signaling from someone who is TOTALLY NOT INTO ANOREXIC PORN.

[–] [email protected] 2 points 1 year ago

Why would this be treated any differently than googling things? I just googled the same prompt about hiding food that's mentioned in the article and it gave me pretty much the same advice. One of the top links was an ED support forum where they were advising each other on how to hide their eating disorder.

These articles are just outrage bait at this point. There are some legitimate concerns about AI, but bashing your hand with a hammer and blaming the hammer shouldn't be one of them.