this post was submitted on 23 Aug 2024
195 points (100.0% liked)

TechTakes

1437 readers
59 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] MagicShel -5 points 3 months ago* (last edited 3 months ago) (2 children)

No. Predicting words is barely related to facts. I'll defend AI as an occasionally useful tool, but nothing it ever says should be taken as fact without confirmation. Sometimes that confirmation can be experimental — does this recipe taste good? Sometimes you need expert supervision to say this part was translated wrong or this code won't work because of xyz. Sometimes you have to go out and look it up.

I like AI but there is a real problem treating it like the output means anything. It might give you a direction to look closer at, but it can never be the endpoint. We'd be better off not trying to censor it, but understanding it will bullshit you without blinking.

I summarize all of that by saying AI is a useful tool, but a terrible product.

[–] [email protected] 10 points 3 months ago (2 children)

We’d be better off not trying to censor it

this claim keeps getting brought up and every time it doesn’t seem to mean a damn thing, particularly since no, censoring the output of an LLM doesn’t do anything to its ability to predict text. censoring its training set would, but seeing as the topic of this thread is a fact an LLM fabricated by being just a dumb text predictor — there’s no real way to censor the training set to prevent this, LLMs are just shitty.

I summarize all of that by saying AI is a useful tool

trying to find a use case for this horseshit has broken your brain into thinking these worthless tools would have value if only they weren’t “being censored” or whatever cope you gleaned from the twitter e/accs

[–] [email protected] 7 points 3 months ago (1 children)

We’d be better off not trying to censor it

Those mfs would refuse to change their code when it fails a test because it restricts their freedom of expression and censors their outputs to conform to the mainstream notion of "correct"

[–] [email protected] 11 points 3 months ago (1 children)

type systems are censorship. proof assistants? how dare you imply I would need to prove anything

…fuck, I’m flashing back to the one time a Verilog developer told me formal verification wasn’t real because mathematicians don’t understand engineering

[–] [email protected] 10 points 3 months ago

type systems are censorship

You jest but trying to convince C people to just use Rust please god fuck stop hurting yourself and us all kinda feels like this

[–] [email protected] 7 points 3 months ago (1 children)

You're dodging the question. How do you evaluate if it's good at predicting words? How do you evaluate if a change made it better or worse?

[–] MagicShel 1 points 3 months ago* (last edited 3 months ago)

So the censorship turns into how ChatGPT makes everything sound like a lecture from HR. That makes it less useful at predicting text in non-corporate settings.

One of the things I've built is a discord bot for running roleplaying games. It's pretty good at text, but when you try to have it play an evil character or narrate combat, it becomes very very difficult. The output is worse than without the censorship because in the context of a monologuing bad guy, he's not going to make a point of respecting the feelings of others.

There are apparently tools for analyzing the output and ranking the quality, but that's above my pay grade. I'm just going off of very clear personal experience.

Sorry I though at first this was a continuation of another thread so it's a little out of context, but maybe it answers the gist.