Programming.dev Meta

2468 readers

3 users here now

Welcome to the Programming.Dev meta community!

This is a community for discussing things about programming.dev itself. Things like announcements, site help posts, site questions, etc. are all welcome here.

Credits

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

founded 1 year ago

MODERATORS

snowe

Ategon

what about data scrapers? (self.meta)

submitted 1 year ago by lucoso to c/meta

7 comments fedilink hide all child comments

reddit and twitter (suposedly) jacked up their API prices because of data scrapers, what could lemmy to do try to stop them?

i dont think we can do anything

you are viewing a single comment's thread
view the rest of the comments

[–] Die4Ever 2 points 1 year ago (1 children)

I wonder how stuff like this would affect the scalability of the fediverse, I think having 1 instance like you describe would be good, but having many of them could become an issue maybe

[–] philm 3 points 1 year ago

Yeah but this is a general problem that ActivityPub has, it builds on the goodwill of the people/instances.

But I don't think it will be a really big issue, if there are really just a few of these instances (that is the premise though) But it's a good point, when something like this is open source, and anyone could spin it up to kinda DDOS the fediverse...

But when looking at it in more positive light/good will, it could probably also be used as an intermediate cache/index instance for other instances, which may save requests to the original instances.

Programming.dev Meta

Links

Credits