this post was submitted on 03 Sep 2023
26 points (96.4% liked)

Selfhosted

39435 readers
8 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

After exporting my photos for migration to Synology, Google gave me 95 2GB zip files to download. I tried downloading directly into my mapped network drive, but the speed was super slow. My tip for you is if you are familiar with docker, you can spin up a Firefox container and map your desired network drive to the container. If you download from the Docker container, it will use the NAS's wired internet connection rather than your PC's WiFi connection. It is a much faster process, cutting it from days to hours for me. I'm sure most of you would have thought of this right away, but after 25 manual downloads, this was a huge relief for me.

top 17 comments
sorted by: hot top controversial new old
[–] [email protected] 11 points 1 year ago (1 children)

There's an option to change the download size. 2GB is the smallest, 50GB I believe is the biggest. Downloaded my Google Photos to import into Immich yesterday, I opted for 10GB files and had 17 zip files to download.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

Yeah I did 2GB files because I expected to download through the browser and didn't want anything to time out and fail in the middle. I never expected how slow it would be though. Moving to the docker container made things a lot faster. It went from 5mbps to 50mbps.

[–] [email protected] 8 points 1 year ago* (last edited 1 year ago)

I have a Syncthing container copying my entire DCIM folder on the phone. It's jank, but it works fast, and I have copies of stuff on my other devices by extension

[–] [email protected] 7 points 1 year ago (1 children)

This makes no sense to me. Why would a docker bind mount use your ethernet but using the mount directly uses wifi? And why not just turn off WiFi and force the ethernet connection to be used?

[–] [email protected] 9 points 1 year ago* (last edited 1 year ago)

The WiFi must be on his machine that he was using to manually download the files, but he later delegated that task to a docker image, sharing the wired connection of the Synology host machine.

[–] [email protected] 4 points 1 year ago (1 children)

Yes, doing it directly instead of downloading then uploading is generally faster. As is wired instead of wireless.

[–] [email protected] 2 points 1 year ago

As I mentioned, it is probably something that most of the people here would think of right away, but for those like me who don't have a wired connection to their router due to whatever reason, this can speed things up. This post was intended to help people like me looking for a faster way to degoogle.

[–] [email protected] 1 points 1 year ago (1 children)

A little off topic, but whats the estimates starting cost to using Synology? Ive been looking for a good syncing solution for media between my partner and I. Any good resources anyone has to share for getting started?

[–] [email protected] 1 points 1 year ago (1 children)

It's not a cheap hobby, but self hosting is fun. Learning more about Docker has made it a great way to learn self hosting. I guess Synology is like training wheels in the self hosting community, but when you only know Windows, it's a good introduction to Linux, servers, networking, RAID, and a ton of other topics.

The units aren't expensive when you compare it to the storage drives. I use a DS918+ which has 4 bays, and I have 14TB drives in each one. This is much more space than I need, but you always end up with more than you expect. I'd say each drive is probably $250 each right now.

[–] [email protected] 1 points 1 year ago

I'm a software engineer working with cloud hosting by profession, so I really dont mind training wheels for my home needs. In fact it is preferred because I want to spend the smallest amount of time possible just solving my problem (easily sharing photos between ios and Android without relying icloud or google). I do enough hard stuff at work haha.

14TB is perfect. I could probably get away with a four bay setup with a RAID config for redundancy.

[–] [email protected] 0 points 1 year ago (1 children)

It is a bit off topic but when I tried to generate the files from Google takeout it failed do you have any suggestions? Also this idea of downloading directly in the NAS is very good

[–] [email protected] 2 points 1 year ago (1 children)

"failed" is a pretty bad problem description. Did you get any error messages or unexpected blank pages, where the zip files empty? ... without any context no one can help you (I'm not saying I can help you with that context, but someone might be able to).

[–] [email protected] 1 points 1 year ago (1 children)

Yes I know. The problem is Google does not provide any more information just said it failed. This is a screenshot from the email

I tried again and failed, I think I will need to migrate it manually :(

[–] [email protected] 1 points 1 year ago

I used the default split size of 2GB and now worked. I was trying to use 50GB but I think Google didn't liked it so much

[–] [email protected] 0 points 1 year ago* (last edited 1 year ago) (1 children)

That's a biiig difference! Did you buy your wifi router within the last two years?

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago) (1 children)

No, it's older than that I think, but I'm not directly connected due to where my PC is in the house. This worked out perfectly for me, though. The firefox container jumped the speed from about 5mbps to 50mbps

[–] [email protected] 1 points 1 year ago