I wonder if this is because AI is trained on data that 'is' and has therefore no concept of how it 'should be'. Maybe it is an effective mirror of society....
this post was submitted on 04 Nov 2023
62 points (78.7% liked)
Technology
34906 readers
236 users here now
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
founded 5 years ago
MODERATORS
Actually it is trained on data 'the trainers have'. This is different from 'trained on data that "is"' or any other idealized view of data.
Data that 'the trainers have' is always an incomplete view of anything, and adding meaningfully to datasets is always very difficult.
I may have oversimplified my statement. Of course an objective description of reality is impossible. A curse on all social sciences and statistics.
My post was more a showerthought...even if the data is incomplete, whatever THAT data implies will also be the stereotype the AI will learn. Misrepresentation of minorities in sample data is absolutely nothing new. But even if the data WAS complete, it would probably still be very biased. I think we often don't notice structural discrimination and AI would simply reproduce those and confront us with it. In that sense I think it is a very interesting way to get a sort of 'outside look' at our own society and that is something that's very useful.