this post was submitted on 09 Jan 2024
527 points (98.2% liked)

Technology

62691 readers
3434 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

‘Impossible’ to create AI tools like ChatGPT without copyrighted material, OpenAI says::Pressure grows on artificial intelligence firms over the content used to train their products

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 12 points 1 year ago (17 children)

The difference here is that a child can't absorb and suddenly use massive amounts of data.

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago) (16 children)

The act of learning is absorbing and using massive amounts of data. Almost any child can, for example, re-create copyrighted cartoon characters in their drawing or whistle copyrighted tunes.

If you look at, pretty much, any and all human created works, you will be able to trace elements of those works to many different sources. We, usually, call that "sources of inspiration". Of course, in case of human created works, it's not a big deal. Generally, it's considered transformative and a fair use.

[–] [email protected] 15 points 1 year ago* (last edited 1 year ago) (10 children)

I really don't understand this whole "learning" thing that everybody claims these models are doing.

A Markov chain algorithm with different inputs of text and the output of the next predicted word isn't colloquially called "learning", yet it's fundamentally the same process, just less sophisticated.

They take input, apply a statistical model to it, generate output derived from the input. Humans have creativity, lateral thinking and the ability to understand context and meaning. Most importantly, with art and creative writing, they're trying to express something.

"AI" has none of these things, just a probability for which token goes next considering which tokens are there already.

[–] sus 5 points 1 year ago* (last edited 1 year ago)

I don't think "learning" is a word reserved only for high-minded creativeness. Just rote memorization and repetition is sometimes called learning. And there are many intermediate states between them.

load more comments (9 replies)
load more comments (14 replies)
load more comments (14 replies)