this post was submitted on 15 Nov 2024
24 points (90.0% liked)

Artificial Intelligence

1346 readers
21 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 1 year ago
24
New research shows people can’t tell the difference between human and AI poetry – and even prefer the latter. What gives? (theconversation.com)
submitted 1 week ago by [email protected] to c/[email protected]
15 comments fedilink hide all child comments
top 15 comments
sorted by: hot top controversial new old
[–] GetOffMyLan 8 points 1 week ago* (last edited 1 week ago) (2 children)

Humans think there's some magic to us that can't be reproduced by machines. But there really isn't.

We're a pattern matching machine with a conscious interface thrown over the top.

Neural networks are really good at finding patterns. Train it on the positions of the planets over a couple decades and it will internally come up with the equations to calculate them and apply those to future and past inputs.

It can come up with equations we don't even know as long as input and output is available for training. Somewhere deep in it's black box it has them.

Art is no different. There's a hidden pattern to art. Something that triggers our brains to react a certain way. You can literally get degrees in the study of it.

Give it enough data and it will learn the patterns.

[–] msage 3 points 1 week ago (1 children)

Yes, technically you are correct.

But current technology will not do that. LLMs are not going to get much better, we need more complex setups.

[–] [email protected] 5 points 1 week ago (1 children)

Current LLMs generate poems that people prefer to human-written poetry. Current image generators win art contests. They don't need to get better to produce more appealing art than humans. Maybe not every time, maybe the people writing the prompts and filtering results are inherent to producing quality results, but there's not some extra trick needed for people to find their outputs aesthetically appealing.

[–] msage -1 points 1 week ago (2 children)

It's like the old 'million monkeys on million typewriters will eventually write Shakespear'.

[–] [email protected] 5 points 1 week ago (1 children)

It's "infinite monkeys on infinite typewriters" because a million would be far too small a sample size to expect Shakespeare. The monkeys aren't trying to make anything, they're just randomly hitting keys. For Shakespeare to come out, there would likely need to be more Monkeys than there are atoms in the universe. Conversely, we're getting something people enjoy from AI right now. No need to approach infinity. It's not what most people wanted AI to be used for, but it's succeeding at it, and current models have only been around for a few years. This isn't random chance happening upon something we like - this is a pattern-recognizing machine getting progressively better at recognizing the patterns we enjoy.

[–] msage -2 points 1 week ago (1 children)

Yes, because 'these monkeys' have been reading all of available content humans created, not really fair comparison to infinite scale of pure randomness.

I would argue against pattern machines getting better at recognizing patterns better, but I don't think it would change any minds.

[–] [email protected] 2 points 1 week ago

Yes, I agree it's a bad comparison. That's why I said as such in my response to your comment that brought it up.

Though the current models have only been around for a few years, pattern recognition programs have been around for a long time. The latest ones are just a better model ...because they are getting better.

The monkeys are just random chance - if you don't yet have Shakespeare, you're no more likely to get it than when you started - but pattern recognition software is steadily improving. If it's not at some benchmark you want it to be at, it's at least closer than it was 10 years ago, and will continue getting closer over time.

[–] [email protected] 1 points 1 week ago

This research didn't use a million poems, it used 5 human and 5 generated poems. The 5 generated poems were simply the first five generated, they did not use a human to curate from a larger population.

[–] [email protected] 3 points 1 week ago

There's definitely nothing about humans that is irreproducible - but the machines aren't even close yet. You clearly didn't read the article.

The entire point here was that the poetry written by LLMs is valid, shallow and has appeal only to the uninformed.

Article:

In my view, the results of the study are less testaments to the “quality” of machine poetry than to the wider difficulty of giving life to poetry. It takes reading and rereading to experience what literary critic Derek Attridge has called the “event” of literature, where “new possibilities of meaning and feeling” open within us. In the most significant kinds of literary experiences, “we feel pulled along by the work as we push ourselves through it”.

[ ... ]

When readers say they prefer AI poetry, then, they would seem to be registering their frustration when faced with writing that does not yield to their attention. If we do not know how to begin with poems, we end up relying on conventional “poetic” signs to make determinations about quality and preference.

This is also true of AI art.

The pattern matching machines will give us more of the same: glossy and regurgitated.

You will not find a machine that will output excellent work that when found 20 years later will become a sensation. They produce gold painted dross.

This is another condemnation of art and cultural education in the West.

[–] [email protected] 5 points 1 week ago

From the paper:

Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.

[–] [email protected] 5 points 1 week ago* (last edited 1 week ago) (1 children)

Why is AI participating in human leisure activities? If it is so catastrophically energy dependant, AI shouldn't be used to do things that brings us joy. It should be a tool to fix difficult things and make our lives easier.

[–] [email protected] 2 points 1 week ago

You plebian fool! Your job isnt to think, it is to make money for the overlords. If their AI makes poems that they sell, then that is fewer poets they have to pay! The money that would go to them instead pads our wallets, as the overlords intended!

This is why they are over us, they are smarter and more wise.

[–] [email protected] 3 points 1 week ago (1 children)

I can't tell the difference between these two things but I do have a preference for one of them

[–] [email protected] 1 points 1 week ago

Yes. Like, literally.

If you watch two movies but you can't tell which one was made by Wes Anderson and which one by Adam Sandler, you'll still pick one you liked better.

[–] [email protected] 2 points 1 week ago

I wrote a poem at work (long story, boss asked me to write an email asking a personal favour of a higher up that he would pass on) and when I showed him my brilliant poem, which was an homage to the Lorax and was about asking for trees, he asked if I used chatgtp.

Crushing. Absolutely. What is the point if someone like me can't stretch a rarely used creative muscle to have a little fun if everyone's just gonna assume I plugged in "hey Chatgtp, I need a poem about x"

I'd post my poem here so I could bask in some sympathy comments but I would dox myself with the info.