this post was submitted on 19 Jul 2023
184 points (84.1% liked)
Technology
58303 readers
14 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Lol could you provide a source where the people behind these LLMs say they don't know how it works?
Did they program it with their eyes closed?
they program it to learn. They can tell you exactly how it learns, but not what it learned (there are some techniques to give some small insights, but not even close to the full picture)
Problem is, how it behaves nepends on how it was programmed and what it learned after being trained. Since what it learned is a black box, we cannot explain their behaviour
Yes I can. example
Opposed to other technology, nobody knows the internal structure. Input A does not necessarily produce output B.
Whether you like it or not is irrelevant.
"Whether you like it or not is irrelevant."
That's a very hostile take.
I just think it's wild they wouldn't know how it works when they're the ones who created it. How do you program something that you don't understand?! It's crazy.
Basically with neural networks you program the way it injests data and how it outputs data. Everything else in between is constantly updating statistical algorithms. Developers can look at those algorithms, but it’s extremely hard to map that back out into human readable content.
It is, sorry. It was a Reaction to the downvotes. But at this point I'm a bit allergic to the "it's the same as every other invention" argument. It's not, precisely for this reason. It's a bit like "climate is always changing" - yes, but not within decades or centuries. These details are crucial.