this post was submitted on 13 Jun 2023
4 points (100.0% liked)

Lemmy

12538 readers
2 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to [email protected].

founded 4 years ago
MODERATORS
 

I subscribed to communities, but my Lemmy instance receives only a few posts, comments and votes. I can see linked instances, but whether or not they sync data feels hit or miss. I'm not quite sure if this is expected. Does Lemmy have a utility similar to the Matrix federation tester?

top 14 comments
sorted by: hot top controversial new old
[–] [email protected] 2 points 1 year ago (1 children)

Are you on a private instance? It can take a long while for your instance to catch up to current stuff.

As far as testing federation... you posted to lemmy.ml from your instance... federation is working :)

[–] [email protected] 1 points 1 year ago (2 children)

Something is seriously wrong. It's been hours and I looked at 7 or 8 instances, nobody has a complete copy. Your instance only shows your own comment: https://lemmy.saik0.com/post/4283

The comment you are reading is comment #14 on lemmy.ml

[–] [email protected] 2 points 1 year ago

Well it's possible that an instance blocks other instances. This also includes things like firewalls and proxy services. I for instance block all Russian and Chinese ip addresses outright. I want nothing to do with either of those countries from a web perspective. It's possible that on their instance they're blocking my instance, or IP so it's not quite populating properly. There's a lot that can go wrong... Doesn't help that lemmy.ml is getting HAMMERED recently.

[–] [email protected] 1 points 1 year ago

Actually looking at their instance... They're using Cloudflare (I see the email protection injected code). Cloudflare in particular likes to mark ActivityPub traffic as "bot" traffic and block it. It's more likely that lemmy.ml is blocked for that particular instance by cloudflare. Smaller instances like mine probably don't get flagged. So it shows up in their instance just fine... https://lemmy.haigner.me/post/8?scrollToComments=true

But other instances might have problems talking to them. They need to setup a page rule to allow lemmy traffic through cloudflares bot detection.

[–] [email protected] 1 points 1 year ago (1 children)

I'm also curious, with my new instance, sometimes it seems like we're receiving the content we should be, other times not so much.

[–] [email protected] 1 points 1 year ago

I looked at your instance and it isn't showing the other comments. https://lemmy.pro/post/1354

This is comment #15.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I observed my Cloudflare firewall events under Security > Events. Cloudflare takes actions against instances that use the Lemmy API through Tor since the launch of my instance. I will allow this traffic to see if that improves federation for my instance, somehow. I doubt it as the vast majority of traffic gets through without a Cloudflare challenge.

Cloudflare firewall rule that skip checks for Lemmy API calls

Update: WAF rule didn't work. I suspect page rules block the requests before they reach the WAF.

I whitelist everything under the sun as I only have 3 page rules. Lemmy requires the following paths as far as I saw:

  • /.well-known/nodeinfo
  • /nodeinfo/2.0.json
  • /api/v3 and v1
  • /pictrs

Update 2: Cloudflare neither blocks nor challenges API requests anymore. But federation is still whack.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I don't see all the comments yet on your home Instance either. https://lemmy.haigner.me/post/8

At lemmy.ml - the "owner" of this community, I am now creating the 5th comment (you are reading it).

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I'm seeing lemmy.ml communities that aren't replicating posts and comments properly to other major instances.

Everyone keeps upgrading the hardware, but the PostgreSQL database seems to have a lot of locking issues / concurrency contention with federation and user activity at the same time.

Example: this posting over on Beehaw is currently lacking the comments: https://beehaw.org/post/536574

Another site, it is there, but only 2 of the 4 current comments: https://sh.itjust.works/post/74015

[–] [email protected] 1 points 1 year ago (1 children)

The instance might be very busy and it won’t sync older content from before you subscribed.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

Your comment made it into lemmy.ml fine, but it seems outbound isn't getting to you very well. Your comment was the 9th comment on this posting, the one you are reading is number 10. Your home sever posting: https://lemmy.wtf/post/1021

Edit: the lemmy.ml posting with 10 total comments currently is here: https://lemmy.ml/post/1239920

[–] [email protected] 0 points 1 year ago (1 children)

Ok, so this at least gives me confidence that the issues I'm seeing around federation may not just be me. One issue I'm seeing is that I'm not confident my comments are appearing on other instances/ or that I'm seeing comments from other instances.

@fedora, do you see this comment?

[–] [email protected] 2 points 1 year ago (1 children)
[–] [email protected] 1 points 1 year ago

testing, 1,2,3. This is comment #22 you are reading, based on lemmy.ml posting.

load more comments
view more: next ›