Fuck AI

1507 readers

25 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

founded 9 months ago

MODERATORS

[email protected]

210

Certain names make ChatGPT grind to a halt, and we know why (arstechnica.com)

submitted 2 weeks ago by [email protected] to c/[email protected]

40 comments fedilink hide all child comments

Want to stop chatGPT from crawling your website? Just mention Australian mayor Brian Hood (or any of the other names listed in the article)

When asked about these names, ChatGPT responds with "I'm unable to produce a response" or "There was an error generating a response" before terminating the chat session, according to Ars' testing. The names do not affect outputs using OpenAI's API systems or in the OpenAI Playground (a special site for developer testing).

The filter also means that it's likely that ChatGPT won't be able to answer questions about this article when browsing the web, such as through ChatGPT with Search. Someone could use that to potentially prevent ChatGPT from browsing and processing a website on purpose if they added a forbidden name to the site's text.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 29 points 2 weeks ago (1 children)

I think there are two crawlers and the one on the data collection stage to build the model will still crawl away even if you have certain content on your page.

The one that searches when you ask a question is a different one.

[–] [email protected] 7 points 2 weeks ago (1 children)

In this case, that's just the model. It's not crawling or searching anything.

[–] [email protected] 2 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

More recent versions can search the internet. Then it basically adds the words of the page to the prompt.

Edit: Might have misunderstood, to make it crash it doesn’t have to search. That data is already internal.

[–] [email protected] 3 points 2 weeks ago

I don't think this is a crash. This looks like a filter on openAI'S end now that I've played with it myself