This is a most excellent place for technology news and articles.
Honestly, any platforms hosting user-generated content who use the legal argument that they only provide hosting and aren't responsible for what their user post shouldn't also be able to sell the same data and claim owning any of it.
Otherwise, take away their legal immunity. Nazis or pedophiles post something awful? You get in front of the judge.
edit: typo
Exactly this. You can claim that their scraping is abusing your servers, but the moment you claim copyright for the content of the site, then you give up your Section 230 rights.
You'd also probably lose a whole lot more processing power trying to stop the crawlers vs just letting them have API access with some sort of limit to queries.
Eh, not really.
I block bot user agents to my Lemmy instance, and the overhead is pretty negligible for that (it's all handled in my web firewall/load balancer).
Granted, those are bots that correctly identify themselves via user agent and don't spoof a browser's.
It's also cheaper and easier to add another load balancer than size up or scale out my DB server to handle the bot traffic.
Systems admin here: You'll lose almost the same amount of processing time looking up limits and providing a "you're over your credits / rate limit" as you would by just providing the data.
Also, everyone will game the system with multiple accounts (cost be damned, the entities who want the data have cash to burn).
I don't think they actually block malicious bots, the change they've made is just to the robots.txt, they don't have to do anything.
Robots.txt does literally nothing. It's a piece of courtesy that's easily ignored if you don't care.
Yeah but it stops bing and a bunch of AI scrapers that want to act like they're following the rules
Good point!
Robots.txt isn’t a binding agreement, this isn’t stopping anyone for whom their drive for profit outweighs their ethics.
Also, Fuck Spez.
The enshittification cycle:
Phase one, attract users by providing a good service.
Phase two, once the users are locked in, squeeze them for all they're worth by selling them to business customers (advertisers and/or data buyers).
Phase three, once the business customers are locked in, squeeze them for all they're worth by threatening to deny them access to the users on whom they now depend.
Spez seems to think Reddit has the pull to make phase 3 happen. I rather doubt it, but we'll see.
https://catvalente.substack.com/p/stop-talking-to-each-other-and-start
Blog post (?) from Catherynne Valente about this exact topic
Stop benefitting from the internet, it’s not for you to enjoy, it’s for us to use to extract money from you. Stop finding beauty and connection in the world, loneliness is more profitable and easier to control.
If he really had balls he'd restrict access to the site and improve the built-in search engine.
If reddit's own search worked well nobody would care. Engines like DDG even have bang codes that send you to a site's own engine. So instead of having to add "site:reddit.com" to the search on DDG I'd just add "r!" and it would end up being the same thing. IF the internal search didn't suck.
Spez is tracing Elon's steps with X really closely.
Also fuck spez.
Yeah, as soon as the API thing happened I switched to Lemmy for mobile browsing and like it more than Reddit (Connect is pretty good, but even the mobile browser site is solid).
The more they squeeze, the more popular alternatives like Lemmy, Kbin/Mbin, Tildes, etc. will become.
My guess is that phase three will work for a while. But I think you're right that eventually they are going to drive that thing into the ground. Because it's never enough pure profit for rent-seeking scum, and there is no lower limit to the abuse they'll inflict on their content creators (who they call users but think of as products).
Honestly, my biggest issue with LLMs is how they source their training data to create "their own" stuff. A meme calling it a plagiarism machine struck a chord with me. Almost anyone else I'd sympathize with, but fuck Spez.
What resonated with me is people calling LLMs and Stable Diffusion "copyright laundering". If copyright ever swung in AI's favor it would be super easy to train an AI on stuff you want to steal, add in some generic training, and now you have a "new" piece of art.
LLMs and Stable Diffusion are just compression algorithms for abstract patterns, only one level above data.
The real takeaway of all of this is that copyright law is massively out of date and not fit for purpose in the 21st century or frankly the late 20th.
The current state of copyright law cannot deal with the internet, let alone AI
Yep they now get paid for the data we have them. I have no sympathy lol. At least these models can't actually store it all losslessly by any stretch of the imagination. The compression factors would have to be like 100-200X+ anything we've ever been able to achieve before. The numbers don't work out. The models do encode a lot though and some of it is going to include actual full text data etc but it'll still be kinda fuzzy.
I think we do need ALL OPEN SOURCE. Not just for AI, but I know on that point I'm preaching to the choir here lol
I'm sure plenty of others join me in the sentiment of thinking "Who the fuck are you to restrict MY free content that I contributed?"
God, fuck reddit so fucking hard
profiting off of user generated content 😒
What if I had an agreement with MS that they can scrape my data and anything I post online?
Reddit is dying anyway.
In all the ways that matter, it's already dead. Once something enshittifies beyond a certain point, is its zombified, shambling corpse really considered "alive" anymore?
It’s Digg v…5 6? v5 would be when they inflated all post scores and stopped showing upvotes and downvotes separately.
v6 is… gestures to the all of it
It's easy to say this as someone who is "on the other side". But the data doesn't really back up that statement.
It’s awful. Politics is unavoidable at this point, and the amount of general anger on the platform is crazy.
People love watching their videos of people getting TBIs… Or getting too excited about a “justice served” post where a woman gets hit.
It’s kinda nice to see someone get their comeuppance, but then you look in the comments and there are just weirdos saying stuff like “glad that bitch got hit”, like… wtf?
Fuck Reddit.
This deal is ridiculous and a terrible precedent for the Internet moving forward. Imagine having to juggle multiple search engines in order to actually search the Internet for things you were looking for because the results literally can’t show up.
What happens when certain news organizations only strike a deal with Bing? And certain forums only strike to deal with Google? This is so shortsighted and they didn’t even get an appreciable amount of money for fucking us over.
SearXNG
I never bothered to go edit or delete my comments after the API drama that caused me to move here, but now I might just go do that because the entire point of keeping old comments up was that maybe someone will find one from a search engine and find it useful. If reddit is going to monetize THAT, they can fuck right off.
Save your effort. What's already there is there forever. They can just roll back your comments, or even, if they're in the mood for it, make it appear under an entirely different username.
The only way to win is not give them any more. And that fight is already under way. They've already started recommending old comments after new ones because the quality isn't as high any more.
Think about it: The only people who contribute to Reddit now are the clueless and the sort of people who have willingly stayed.
I like to imagine Spez stomping around saying "Hmph! Hmph! It's not fair! Why did they all leave?! They're stealing my revenue by not giving me anything for free!". I mean, he's probably not doing that, but I do like to imagine it.
If you're still donating your content to the Facebook, Twitter and Reddit data stores, then I don't know what to tell you man, you're literally enriching the worst people, who will do the worst things, with your information, your stories, your answers, your comments, your labor, your effort. You are giving yourselves to them. Literally.
Whenever this comes up, I immediately think of how easy it would be to scrape the threadiverse.
They're already doing that, if only just for search.
Googling my username used to not give any results up until a few months ago... Since I'm on Lemmy you find my comments by throwing my username into a search engine
Fuck Spez
Gross.
No thanks.
Late stage capitalism
I'm not sure what Reddit is still doing with that spaz. Ditch the fucker.
How about starting a company that gathers people's CAD design....grabCAD!.... Oh can't scrape out design work Microsoft, you gotta pay!....or how about a company that stores people's records or drawings or movies.... Adobe! Oh Microsoft, you can't scrape our data! It's our data!
What if I had an agreement with MS that they can scrape my data and anything I post online?
What if Microsoft updated their Windows EULA to state that all users agree to allow MS to scrape their online data (if they haven't already), and then take that to court against reddit? It would certainly be an interesting court case to watch, especially if they could get actual users to stand up in court and confirm that they did indeed approve of this. And it might settle the issue once and for all regarding companies trying to block freely-visible internet content just because someone scraped the info.
