quollveth

joined 1 week ago
sorted by: new top controversial old
"A pseudonymous coder has created and released an open source “tar pit” to indefinitely trap AI training web crawlers in an infinitely, randomly-generating series of pages to waste their time and in c/[email protected]
[–] [email protected] 2 points 3 days ago

@[email protected] interesting, the hackernews thread linked in that article has someone talking about similar tools
https://news.ycombinator.com/item?id=42726426

"A pseudonymous coder has created and released an open source “tar pit” to indefinitely trap AI training web crawlers in an infinitely, randomly-generating series of pages to waste their time and in c/[email protected]
[–] [email protected] 10 points 3 days ago

@remixtures that's great, some days ago i saw some people on r/selfhosting discussing how to stop AI crawlers that don't respect robots.txt (so all of them) and there were a lot of people basically reinventing the tarpit idea, having a dedicated tool for that is great, combined with a simple logging of all ip ranges falling for it to get blacklisted we might get a fighting chance, there were even people serving zip bombs to ai bots, but i don't believe they would bother to open it