this post was submitted on 14 Jan 2024
264 points (95.5% liked)

Technology

60044 readers
3677 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

AI girlfriend bots are already flooding OpenAI’s GPT store::OpenAI’s store rules are already being broken, illustrating that regulating GPTs could be hard to control

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 76 points 11 months ago* (last edited 11 months ago) (2 children)
[–] [email protected] 27 points 11 months ago (3 children)

Omg I just looked this up that orb looks like it eats souls. Like they had to have spent time actively designing it to be as sinister as possible, with fucking slogans like "orbs are here" and "look into my eye"

[–] [email protected] 12 points 11 months ago
[–] [email protected] 3 points 11 months ago (2 children)
load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 20 points 11 months ago

Dude tried to place palantíri around Kenya and nobody remembers. The Lord of Gifts, charismatic and dazzling to leaders as ever.

[–] [email protected] 59 points 11 months ago

Open ai forgot abput the 3 rules and went straight to the 34th

[–] [email protected] 44 points 11 months ago (1 children)

Can't wait to hear about someone getting dumped by a computer.

[–] [email protected] 18 points 11 months ago

Finding catfish just got a lot harder.

[–] [email protected] 43 points 11 months ago (4 children)

[Yawn]

I’m all for a bit of Ai panic, but this is the worst kind of desperate journalism.

The facts as reported:

  • 1 day before opening the doors of their new online store OAi updated their policy to ban comfort-bots and bad-bots.
  • On opening day there are 7 Ai girlfriends available for purchase/download.

The articles conclusion: Ai regulation is doomed to fail and the machines will wipe out humanity.

[–] [email protected] 20 points 11 months ago (2 children)

The articles conclusion: Ai regulation is doomed to fail and the machines will wipe out humanity.

Well, as we all know, AI girlfriend is the first step to AI Hitler.

[–] [email protected] 21 points 11 months ago (1 children)
load more comments (1 replies)
[–] [email protected] 2 points 11 months ago

A very solid point :-)

[–] [email protected] 8 points 11 months ago (2 children)

If we get wiped out by AI girlfriends we deserve it. If the reason why a person never reproduced is solely because they had a chatbot they really should not reproduce.

[–] [email protected] 7 points 11 months ago (2 children)

I was trying to dream up the justification for this rule that wasn’t about mitigating the ick-factor and fell short… I guess if the machines learn how to beguile us by forming relationships then they could be used to manipulate people honeypot style?

Honestly the only point I set out to make was that people were probably working on virtual girlfriends for weeks (months?) before they were banned. They had probably been submitted to the store already and the article was trying to drum up panic.

[–] [email protected] 3 points 11 months ago

Sure which you know we already can do. Honeypots are a thing and a thing so old the Bible mentions them. Delilah anyone? It isn't that cough...hard...cough to pretend to be interested enough in a guy to make them fall for you. Sure if the tech keeps growing, which it will, you can imagine more and more complex cons. Stuff that could even have webcam chats with the marks.

I suggest we treat this the same way we currently treat humans doing this. We warn users, block accounts that do this, and criminally prosecute.

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 5 points 11 months ago (2 children)

Not that I'm really interested in one but what's actually wrong with making an AI gf app?

[–] [email protected] 8 points 11 months ago (9 children)

It encourages the dehumanization of women and gives men even more unrealistic expections about relationships and sex. But if they take themselves out of the gene pool this way then it could end up being a win.

load more comments (9 replies)
[–] [email protected] 2 points 11 months ago (2 children)

I’m not sure there’s anything wrong with it, that’s what the article reported on as though it were some sort of harbinger of doom… Felt like my smarmy retorts would be slightly less punchy if I had opened up a side discussion regarding appropriate uses for AI. I suppose part of my motivation was that it seemed incredibly innocent relatively speaking.

Open AI claims to be in this to save humanity from Skynet, this seems like a fairly pathetic attempt keep their store from filling up with “disreputable” content before… what exactly I don’t know. The killer app for AI that would be magically devoid of controversy?

load more comments (2 replies)
[–] [email protected] 4 points 11 months ago (1 children)

Your comment gave me an idea. These alarmist articles are so common that I bet writing them could be automated. We can get bots to write articles about the dangers of bots. I asked chatgpt to write one from the perspective of Southern Baptist

From a Southern Baptist viewpoint, the emergence of AI 'girlfriend' chatbots presents a challenging scenario. This perspective, grounded in Scripture, values authentic human relationships as cornerstones of society, as reflected in passages like Genesis 2:18, where companionship is emphasized as a fundamental human need. These AI entities, simulating intimate relationships, are seen as diverging from the Biblical understanding of companionship and marriage, which are sacred and uniquely human connections. The Bible's teachings on idolatry, such as in Exodus 20:4-5, also bring into question the ethics of replacing real interpersonal relationships with artificial constructs.

Not bad for a first pass.

[–] [email protected] 4 points 11 months ago

LOL

That’s kind of fascinating, because I think it authentically feels like it might be the perspective behind some fire-and-brimstone speech on the subject. I was kind of hopping for the sermon personally, but this makes you feel like southern baptist preachers could be people too ;-)

[–] [email protected] 41 points 11 months ago* (last edited 11 months ago) (2 children)

"lol at least it will help get some losers out of the gene pool, lonely unfuckable loosers deserve what they get if they resort to a chatbot for affection lol" fucking hell what nastiness some people have in them.

Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don't like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection. Its very sad.

However, I also understand what it truly means to be alone, for decades. You can point the finger and mock people for their social failings. It doesn't make them feel any less empty. Some people are genuinely so psychologically or physically damaged, their confidence so ultimately shattered, that dating or even just fucking seem like pipe dreams. A psychologically normal, average looking human being who can't stand a month or two of being single could never empathize with what that feels like.

If an AI girlfriend could help relieve that feeling for one irreparably broken human being on this planet, lessen that unbearable lonelyness even a smidge through faux interaction, then good. I'll never want one, but im happy its an option for those who really need something like it. They'll get no mockery or meanness or judgement from me.

[–] [email protected] 16 points 11 months ago (1 children)

Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don’t like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection.

That's not even the scary part. What we really shouldn't be uncomfortable with is this very closed technology having so much power over people. There's going to be a handful of gargantuan immoral companies controlling a service that the most emotionally vulnerable people will become addicted to.

load more comments (1 replies)
[–] [email protected] 7 points 11 months ago* (last edited 11 months ago) (1 children)

Im not 100% comfortable with AI gfs and the direction society could potentially be heading. I don't like that some people have given up on human interaction and the struggle for companionship, and feel the need to resort to a poor artificial substitute for genuine connection. Its very sad.

The marketing for some of them also seems quite predatory, which doesn't seem like a good sign.

Although I'm personally less concerned about the people that seek them out, and more the ones that just get used in the wild.

Imagine hitting it off with someone, having a friendship for a while, only to find out that they're an engagement or scam bot? It'd be devastating.

[–] [email protected] 3 points 11 months ago (1 children)

that's already happening on just about every dating app though

[–] [email protected] 3 points 11 months ago

Was functionally the entire business model of sites like "Seeking Arrangements" since their inception. AI isn't doing what phone sex operators and cam-whores have been doing for decades. They're just filling in as a cheap inferior substitute that can over-saturate the market at very little cost to the distributors.

AI Girlfriend is the new 419 Scam, kicked up a notch.

[–] [email protected] 35 points 11 months ago (3 children)

Once LLMs can have perfect memory of past conversations, we are going to see a lot of companion bots. Running into the context window sucks.

[–] [email protected] 18 points 11 months ago (1 children)

I typed a comment saying something nice about Her.

Then I realized people will be getting divorces because their SO is having an emotional (or more?) affair with a bot. Drains the joy, man.

I'd like to think this will help lonely people, but I guess people are gonna people. Here's hoping the AI isn't "there" yet.

[–] [email protected] 6 points 11 months ago (1 children)

It could help with the symptoms of loneliness, but it might also worsen the root causes, like social isolation and/or personal insecurities. It's only expected that AI chatbots will somewhat reflect the expectations of their users, which might encourage patterns of biased and negative thinking they feed into it.

If someone sees it as a plaything, there is nothing wrong with that, but it's way too easy for people to take with too far. There's people who do that to static characters and rudimentary dating sims already.

[–] [email protected] 3 points 11 months ago

Yep. Gotta exist in meatspace sometime. It's just how we evolved. We need people. People proxies aren't as nourishing.

Yet.

[–] [email protected] 8 points 11 months ago (5 children)

Is it even feasible with this technology? You can't have infinite prompts so you would have to adjust the weights dynamically, right? But would that produce the effect of memory? I don't think so. I think it will take another major breakthrough before we have personal models with memory.

[–] [email protected] 5 points 11 months ago* (last edited 11 months ago) (1 children)

I agree that it has limits but there are things we could do to make it reasonably good. ChatGPT knows how to execute actions (such as calling an API or doing a web search). It could probably be made to store and look up information in a vector database, essentially giving it a long-term memory.

Given some smaller breakthroughs in performance and model size we could conceivably retrain the network on new input continuously, in order to incorporate new knowledge.

[–] [email protected] 5 points 11 months ago (5 children)

That's the thing, I don't think a database can work as a long term memory here. How would it work? Let's say you tell your AI girlfriend that Interstellar movie was so bad it made you vomit. What would it store in the DB? When would it look that info up? It would be even worse with specific events. Should it remember the exact date of each event perfectly like DB does? It would be unnatural. To actually simulate memory it should alter the model somehow and the scale of the change should be proportional to the emotional charge of the message. I think this is on a completely different level than current models.

[–] [email protected] 5 points 11 months ago* (last edited 11 months ago) (1 children)

Vector databases are relatively good at this kind of thing, because they can find records based on queries that are semantically close instead of just a lexical search. It would probably still make sense to split the information up in fragments such as e.g., "Interstellar movie," "watched on February 2nd, 2021," "made me vomit", and then connect those records to each other. GPTs are good at that kind of preprocessing. The idea would not be to store exact data such as timestamps and that's not how vector databases work, so recall would be more associative just like for humans (I can't ask you what movie you watched on Feburary 2nd, 2021 and expect an accurate reply either).

[–] [email protected] 4 points 11 months ago (1 children)

But you would have to do something like multiple steps of preprocessing with expanding search depth on each step and do it both ways: when recollecting and changing memories. Like if I say:

  • Remember when I told you I've seen Interstellar last year?
  • AI: Yes, you said it made you vomit.
  • I lied. It was great.

So you process the first input, find the relevant info in the 'memory' but then for the second one you have to recognize that this is regarding the same memory, understand the memory and alter it/append to it. It would get complicated really fast. We would need some AI memory management system to manage the memory for the AI. I'm sure it's technically possible but I think it will take another breakthrough and we won't see it soon.

[–] [email protected] 4 points 11 months ago

Again, you will certainly hit limitations if you push it, but the example you give would work fine if you just append the added information to the database. A query for Interstellar would return both your original statements and the fact that you later said you lied about it, and all of these records are inserted into the GPT's context (short-term memory) when discussing that subject.

load more comments (4 replies)
load more comments (4 replies)
load more comments (1 replies)
[–] [email protected] 24 points 11 months ago (1 children)

Simps are not the fringe market they used to be. Soon, they’ll be a billion dollar a year one.

[–] [email protected] 19 points 11 months ago (1 children)

Soon?

They are already driving the gacha game market, spending several billions. Way too many games sell characters to players simply by making a variety of waifus.

Then we have everyone paying for OnlyFans and erotic art patreons.

Then we have everyone paying subscriptions for dating apps.

Really, the more I think about it, was it ever a fringe market? "Porn sells" is a known saying. Playboy magazines used to be an institution.

This is just a new layer of that.

[–] [email protected] 4 points 11 months ago (1 children)

I feel like traditional "There be titties" porn is a slightly different beast than the parasocial onlyfans stuff, or the even weirder "ai girlfriend" stuff. The traditional stuff is less sad, to me. Like, there's no illusions about what's happening if I'm looking at a traditional video of a naked woman. But when it adds the whole fake interaction thing? Makes my skin crawl.

load more comments (1 replies)
[–] [email protected] 19 points 11 months ago (1 children)

Who could have seen this coming?

[–] [email protected] 9 points 11 months ago

No one. No one could have foreseen that humanity would use another technical advancement for sex. Since that hasn't been the case since quite literally the stone age.

https://www.livescience.com/9971-stone-age-carving-ancient-dildo.html

[–] [email protected] 15 points 11 months ago (1 children)

This is just a stepping stone to the ultimate guilt free porn. No one gets hurt, 300 simulated penises. Except that no one is simulating penises yet. The gay community needs to step up it's simulation....oh this just in: gay guys don't need a simulation because the real thing is easy to get.

[–] [email protected] 9 points 11 months ago (1 children)

No one gets hurt, 300 simulated penises.

I would argue that a continuous state of isolation, bolstered by shoddy simulations of human interaction, that we treat as a stand in to real human contact and expression, is going to hurt a whole lot of people in the long run.

It all just feels like some 18th century Libertarian looking at an opium den full of washed out dope-heads and saying "Look at how happy they are! There's no such thing as an opium crisis, because its all voluntary and the end result is profound bliss."

The gay community needs to step up it’s simulation…

The gay community doesn't need simulation precisely because it is rich with enthusiastic socially active and eager individuals. The NEET community needs simulations because they've fallen victim to their own anxieties, failed to develop strong social skills, and alienated themselves from everyone else in their lives who might provide them with the experiences they're seeking a rough approximation of in simulation.

[–] [email protected] 6 points 11 months ago (1 children)

I would say the following things would help:

•	Rethink the way our cities are built and reduce the ratio of work to weekends so that people can find time and have ease in going to spaces where they can interact with others socially.

•	Allow for the construction of third spaces, especially for adolescents. Seriously, as a teenager in the 2010s, the amount of surveillance and regulation by parents and schools was kinda insane. It pushes teenagers online, as it’s the one place where they tend to have an edge on their elders enough to break free from it. (And it also normalizes invasions of privacy by corporations.)

•	Withhold judgment by mass public opinion for minor transgressions. We have all said things that make us cringe at ourselves down the line when we think of them, or even when reminded of the perhaps more innocent action of simply looking foolish. It is little wonder, then, that people, already socially withered from lack of experience, shy away from the very actions that might give them confidence when faced with the potential for public immortalization of these acts via the internet.

•	Regulate platforms to reduce the existing profitability of addiction. It is no contest when the largest companies spend billions and employ thousands to keep their users under their thrall. The only recourse for the individual is to join in group action to wield the power of government for the public good.

While by no means an exhaustive list, I feel as though if we follow the steps of RAWR, we can at least make an incremental improvement.

load more comments (1 replies)
[–] [email protected] 8 points 11 months ago (2 children)

I don't get it. What's wrong with pretending to have a relationship with an AI? Fantasy video games are super popular, and probably a more realistic experience than the current state of ChatGPT.

[–] [email protected] 6 points 11 months ago

Yeah there's a bit of similarity to pursuing a "romance route" in a video game. Funny to think that it's more acceptable to fuck a fake bear in Baldur's Gate 3 than to have weekly conversations with a bot that pretends to understand your written words.

I suppose the key difference being that my wife in Skyrim is more akin to a one-night stand since she can't reciprocate my notes of affection.

[–] [email protected] 2 points 11 months ago

In my opinion, it’s immoral to profit off of someone’s loneliness. Of course that’s a huge sector of the economy now and why dating apps focus on vapid, meaningless hookups rather than finding real working relationships, and cam girls exploiting whales, so on a so forth.

But I still think that things like AI girlfriends promote isolation, hostility, and anti-social behaviors that are harmful to society.

load more comments
view more: next ›