this post was submitted on 22 Aug 2023
765 points (95.7% liked)

Technology

58303 readers
14 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

OpenAI now tries to hide that ChatGPT was trained on copyrighted books, including J.K. Rowling's Harry Potter series::A new research paper laid out ways in which AI developers should try and avoid showing LLMs have been trained on copyrighted material.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 87 points 1 year ago (3 children)

We have to distinguish between LLMs

  • Trained on copyrighted material and
  • Outputting copyrighted material

They are not one and the same

[–] [email protected] 26 points 1 year ago (2 children)

Yeah, this headline is trying to make it seem like training on copyrighted material is or should be wrong.

[–] [email protected] 25 points 1 year ago

Legally the output of the training could be considered a derived work. We treat brains differently here, that's all.

I think the current intellectual property system makes no sense and AI is revealing that fact.

[–] [email protected] 6 points 1 year ago (2 children)

I think this brings up broader questions about the currently quite extreme interpretation of copyright. Personally I don't think its wrong to sample from or create derivative works from something that is accessible. If its not behind lock and key, its free to use. If you have a problem with that, then put it behind lock and key. No one is forcing you to share your art with the world.

[–] [email protected] 7 points 1 year ago

Most books are actually locked behind paywalls and not free to use? Or maybe I don't understand what you meant?

[–] [email protected] 4 points 1 year ago

Following that, if a sailor is the sea were to put a copy of a protected book on the internet and ChatGPT was trained on it, how that argument would go? The copyright owner didn't place it there, so it's not "their decision". And savvy people can make sure it's accessible if they want to.

My belief is, if they can use all non locked data for free, then the model should be shared for free too and it's outputs shouldn't be subject to copyright. Just for context

[–] [email protected] 1 points 1 year ago (1 children)

Output from an AI has just been recently considered as not copyrightable.

I think it stemmed from the actors strikes recently.

It was stated that only work originating from a human can be copyrighted.

[–] [email protected] 4 points 1 year ago (1 children)

Output from an AI has just been recently considered as not copyrightable.

Where can I read more about this? I've seen it mentioned a few times, but never with any links.

[–] [email protected] 3 points 1 year ago (1 children)

They clearly only read the headline If they're talking about the ruling that came out this week, that whole thing was about trying to give an AI authorship of a work generated solely by a machine and having the copyright go to the owner of the machine through the work-for-hire doctrine. So an AI itself can’t be authors or hold a copyright, but humans using them can still be copyright holders of any qualifying works.

[–] [email protected] 0 points 1 year ago

They might’ve just been bringing it up conversationally as it’s in a similar vein too

[–] [email protected] 0 points 1 year ago (1 children)

Should we distinguish it though? Why shouldn't (and didn't) artists have a say if their art is used to train LLMs? Just like publicly displayed art doesn't provide a permission to copy it and use it in other unspecified purposes, it would be reasonable that the same would apply to AI training.

[–] [email protected] 1 points 1 year ago

Ah, but that's the thing. Training isn't copying. It's pattern recognition. If you train a model "The dog says woof" and then ask a model "What does the dog say", it's not guaranteed to say "woof".

Similarly, just because a model was trained on Harry Potter, all that means is it has a good corpus of how the sentences in that book go.

Thus the distinction. Can I train on a comment section discussing the book?