this post was submitted on 12 Feb 2024
80 points (93.5% liked)
Technology
58133 readers
4709 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
When we are talking terabytes of data there are faster ways for the initial sync job.
I would just use rsync/sftp/robocopy or similar for that first copy for faster transfers, then setup Syncthing on those shares for delta syncs.
Are you sure those are faster? The only obvious slowdown in Syncthing compared to them is the initial file scan. The file transfer saturates the pipes like any other option. If you meant the file scan overhead, then we're on the same page. ☺️
At the same time Syncthing is ultra resilient and will auto-restart and continue syncing no matter what happens to the network connection or the hosts during transfer without intervention. This is why I stopped using rsync for initial transfers. When the initial transfer would take a week over the Internet, using Syncthing and swallowing the initial scan is nice because you don't need to look after it.
Yep, with ST I can trust the files will get there. For large folders I just occasionally check on them.