this post was submitted on 09 Jun 2023
8 points (100.0% liked)

Sysadmin

7566 readers
1 users here now

A community dedicated to the profession of IT Systems Administration

No generic Lemmy issue posts please! Posts about Lemmy belong in one of these communities:
[email protected]
[email protected]
[email protected]
[email protected]

founded 1 year ago
MODERATORS
 

My job has been Database Admin for the past 25 years, still is. But nowadays it's more shifting to infrastructure and automation.

And of course I do some self-hosting.. like lemmy.world and mastodon.world and many others..

Thank you @[email protected] for creating this community!

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago (1 children)

Systems and software engineer here. I'm curious how the Lemmy project plans on scaling media uploads. It doesn't seem feasible to host on an instance server. Even Reddit had a problem with media over the years and some subs to this day enforce offloading media to third party.

[–] [email protected] 0 points 1 year ago (1 children)

For now it's 2GB. I hope we can use block storage soon. I use Wasabi for mastodon.world

[–] [email protected] 0 points 1 year ago (1 children)

Just Postgres or Postgres + Pics? Could you give me the number for Postgres? I'm thinking in hosting my server but I have concerns abot scalability and costs in the future.

[–] [email protected] 0 points 1 year ago (1 children)
du -sm *
2181	pictrs
1885	postgres
[–] [email protected] 0 points 1 year ago (1 children)

It seems a lot for little content. My experience tells me that Postgres is not going to scale well, some sort of NoSQL will be necessary.

[–] [email protected] 0 points 1 year ago (1 children)

Why not? My mastodon DB is 200 GB, works fine.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago) (1 children)

It depends on many things like the number of tables, the indexes, etc... but Postgres doesn't work well above 1 TB. Anyway, it will take several years to reach that point. Someone will figure out a solution.

Thank you for the info. Do you have any link with the specs of your server, bandwidth, cpu/ram usage, statistics...? Anything that could help me to do the maths.

[–] [email protected] 1 points 1 year ago (1 children)
[–] [email protected] 0 points 1 year ago (1 children)

I'm curious, how have the numbers changed in the last few weeks?

[–] [email protected] 1 points 1 year ago (1 children)

Well we use a new server now, with 32 core/64 threads and 128GB RAM. So quite some more..

[–] [email protected] 1 points 1 year ago

haha that's awesome! keep up the good work.