TechTakes

1276 readers

107 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

[email protected]

952

The Google AI isn’t hallucinating about glue in pizza, it’s just over indexing an 11 year old Reddit post by a dude named fucksmith. (lemmy.dbzer0.com)

submitted 4 months ago by [email protected] to c/[email protected]

254 comments fedilink hide all child comments

Source

I see Google's deal with Reddit is going just great...

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 33 points 4 months ago (1 children)

I also wanted to post this post. But it is going to be very funny if it turns out that LLMs are partially very energy inefficient but very data efficient storage systems. Shannon would be pleased for us reaching the theoretical minimum of bits per char of words using AI.

[–] [email protected] 19 points 4 months ago* (last edited 4 months ago) (1 children)

huh, I looked into the LLM for compression thing and I found this survey CW: PDF which on the second page has a figure that says there were over 30k publications on using transformers for compression in 2023. Shannon must be so proud.

edit: never mind it's just publications on transformers, not compression. My brain is leaking through my ears.

[–] [email protected] 11 points 4 months ago

@sinedpick

I wonder how many of those 30k were LLM-generated.