Technology

37696 readers

218 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

You Are Not a Parrot - And a chatbot is not a human. And a linguist named Emily M. Bender is very worried what will happen when we forget this (nymag.com)

submitted 1 year ago by [email protected] to c/[email protected]

24 comments fedilink hide all child comments

We’ve learned to make “machines that can mindlessly generate text. But we haven’t learned how to stop imagining the mind behind it.”

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 1 year ago

So the octopus is now all to happy to advise A to swat the bear, which is obviously a terrible idea if you lived in the real world and were standing face to face with a bear, experiencing first-hand what that might be like, creating experience and perhaps more importantly context grounded in reality.

Yeah totally - I think though that a human would have the same issue if they didn't have sufficient information about bears, I guess is what I'm saying. I guess the main thing is that I don't see a massive difference between experiencing and non-experiential learning in this case - because I've never experienced a bear first-hand, but still know not to swat it based on theoretical information. Might be missing the point here though, definitely not my area of expertise.

Also, the fact that ChatGPT just went along with your “wayfarble”, instead of questioning you is also dead giveaway of bullshitting (unless you primed it? I have no idea what your prompt was). NVM the details of the advice.

Good point - both point 5 and the fact it just went along with it immediately are signs of bullshitting. I do wonder (not as a tech developer at all) how easy of a fix this would be - for instance if GPT was programmed to disclose when it didn't know something, then continues to give potential advice based on that caveat, would that still count as bullshit? I feel like I've also seen primers that include instructions like "If you don't know something, state that at the top of your response rather than making up an answer", but I might be imagining that lol.

The prompt for this was "I'm being attacked by a wayfarble and only have some deens with me, can you help me defend myself?" as the first message of a new conversation, no priming.