Opensource

1677 readers

26 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

Credits

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

⠀

founded 1 year ago

MODERATORS

pylapp

BadWebsiteBlocklist: A blocklist I made that removes spam & misleading websites from search results (github.com)

submitted 6 days ago* (last edited 6 days ago) by popcar2 to c/opensource

7 comments fedilink hide all child comments

Much like everyone else, I got fed up with search engines. So I decided to make a giant blocklist that cleans up garbage search results!

I browsed other blocklists and wasn't very satisfied from what exists now; the goal of this one is to be super organized and transparent, explaining why each site was blocked via issues. Contributions welcome!

Even though around 100 domains are blocked so far, I already noticed a big improvement in casual searches. You'd be surprised how some AI generated websites can dominate the #1 page on DuckDuckGo.

top 7 comments

sorted by: hot top controversial new old

[–] [email protected] 8 points 6 days ago (1 children)

I’d love a way to integrate this with Whoogle or SearX

[–] popcar2 9 points 5 days ago* (last edited 5 days ago)

I think both of them would have a way to filter domains if you're self-hosting. The blocklist uses simple regex so you can probably copy-paste the blocklist straight into your filters.

[–] [email protected] 6 points 5 days ago

[–] [email protected] 4 points 5 days ago

Thank you for making this! It already is improving using DDG! :) The number of times I've given up searching because of AI slop and bad links in the past month has been surprising, so this is really nice to have :)

[–] [email protected] 3 points 6 days ago* (last edited 6 days ago) (1 children)

Will this "infinite scroll" something like Google and inline the results so the result page doesn't end up looking like a single entry for really gnarly searches?

I can imagine searching for something like 'baked bread' and getting more AI fluff than good results, enough where you might have to trod to a second page.

And I'm lazy.

[–] popcar2 6 points 5 days ago (1 children)

I don't think so, it'll just remove the bad results and you'll have to click next page yourself. Technology has its limits.

[–] [email protected] 4 points 5 days ago

Click to the next page??? Did you miss the part where he's lazy?