I don't think its a good idea to rely upon Lemmy search for community discovery. I agree that its where "users expect to go", but there's several downsides.
-
Servers don't know about other servers until someone on the server subscribes to them.
-
After the subscription, the server eventually pulls in the data needed to hook up. I don't know how long this takes, but its longer than "minutes".
For now, discussion-based discovery is how the community does things in practice. That is: [email protected] seems to be the pragmatic approach. Its a bit of a human-touch for now and not automated, but its probably our best bet for the near future.
A google-like approach, where a web-crawler creates a search engine is what the community needs. The web-crawler could be a [email protected], maybe its own instance for maximum "politeness".