Opensource

2664 readers

64 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

Credits

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

⠀

founded 2 years ago

MODERATORS

pylapp

Anubis - Weighs the soul of incoming HTTP requests to stop AI crawlers (github.com)

submitted 5 days ago by [email protected] to c/opensource

8 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 3 days ago (1 children)

Adding some extra CPU compute or ASICs for solving puzzles will not slow down a bandwidth-constrained bot. Bandwidth is still the bottleneck and cost factor. With the current state of AI investments, I bet they will go to great lengths to scrape every little bit of the internet at whatever internet bandwidth they have available.

[–] bitfucker 1 points 1 day ago

Uhh, yes it did? CPU time costs money too. What used to take milliseconds now takes a seconds WILL cost them money. And usually CPU time is the most expensive one too while bandwidth is cheap.