this post was submitted on 28 Jan 2024
354 points (95.2% liked)
Technology
58303 readers
15 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Reproduction of copyrighted material would be breaking the law. Studying it and using it as reference when creating original content is not.
I’m curious why we think otherwise when it is a student obtaining an unauthorized copy of a textbook to study, or researchers getting papers from sci-hub. Probably because it benefits corporations and they say so?
While I would like to be in a world where knowledge is free, this is apples and oranges.
OpenAI can purchase a textbook and read it. If their AI uses the knowledge gained to explain maths to an individual, without reproducing the original material, then there's no issue.
The difference is the student in your example didn't buy their textbook. Someone else bought it and reproduced the original for others to study from.
If OpenAI was pirating textbooks, that would be a wholly separate issue.
I agree that the issues
are separate, but I think they are related, in that AI companies are trying to impose whatever interpretation of copyright that is convenient to them to the rest of the society.
And indeed Meta pirated books to feed its AI.
https://www.techspot.com/news/101507-meta-admits-using-pirated-books-train-ai-but.html
The fact that the "AI" can spit out whole passages verbatim when given the right prompts, suggests that there is a big problem here and they haven't a clue how to fix it.
It's not "learning" anything other than the probable order of words.
I really hate this reduction of gpt models. Is the model probabilistic? Absolutely. But it isn't simply learning a comprehensible probability of words--it is generating a massively complex conditional probability sequence for words. Largely, humans might be said to do the same thing. We make a best guess at the sequence of words we decide to use based on conditional probabilities along a myriad number of conditions (including semantics of the thing we want to say).
Completely agree. And that should be the focal point of the issue.
Sam Altman is correctly stating that AI is not possible without using copyrighted materials. And I don't think there's anything wrong with that.
His mistake is not redirecting the conversation. He should be talking about the efforts they're making to stop their machine from reproducing copyrighted works. Not whether or not they should be allowed to use it in the first place.
What about these:
https://arxiv.org/abs/2310.02207
https://notes.aimodels.fyi/researchers-discover-emergent-linear-strucutres-llm-truth/
https://notes.aimodels.fyi/self-rag-improving-the-factual-accuracy-of-large-language-models-through-self-reflection/
I was under the impression they mentioned at some point torrenting things
Don't know about OpenAI, but Meta used pirated books to train its AI.
https://www.techspot.com/news/101507-meta-admits-using-pirated-books-train-ai-but.html
humans studying it, is fair use.
So if a tool is involved, it's no longer ok? So, people with glasses cannot consume copyrighted material?
No. A tool already makes it unnatural. /S
Because a human has to use talent+effort to make something that's fair use. They adapt a product into something that while similar is noticeably different. AI will
make things that are not just similar but not noticeably different.
There's not an effort in creation. There's human thought behind a prompt but not on the AI following it.
If allowed to AI companies will basically copyright everything...
You are aware of the insane amounts of research, human effort and the type of human talent that is required to make a simple piece of software, let alone a complex artificial neural network model whose function is to try and solve whatever stuff...right?
Good point. I say the software can be copywrite protected, but not the content the program generates.
And that is human effort, not the AIs.
What's the difference? Humans are just the intent suppliers, the rest of the art is mostly made possible by software, whether photoshop or stable diffusion.
I don't agree. The publisher of the material does not get to dictate what it is used for. What are we protecting at the end of the day and why?
In the case of a textbook, someone worked hard to explain certain materials in a certain way to make the material easily digestible. They produced examples to explain concepts. Reproducing and disseminating that material would be unfair to the author who worked hard to produce it.
But the author does not have jurisdiction over the knowledge gained. They cannot tell the reader that they are forbidden from using the knowledge gained to tutor another person in calculus. That would be absurd.
IP law protects the works of the creator. The author of a calculus textbook did not invent calculus. As such, copyright law does not apply.
The model itself is a derivative work. It's existence is what is under dispute. It's not about using the model to produce further works
Then every single student graduating college produces derivative work.
Everything that required the underlying knowledge gained from the textbooks studied, or research papers read, is derivative work.
At the core of this, what are we saying? Your machine could only explain calculus because it was provided information from multiple calculus textbooks? Well, that applies to literally everyone.
Charge AI recurring tuition then.