this post was submitted on 12 Nov 2023
1 points (100.0% liked)

Data Hoarder

0 readers
3 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
[email protected]
1
Unknown damaged files in backups scares me at night, is there a solution? (alien.top)
submitted 1 year ago by [email protected] to c/[email protected]
3 comments fedilink hide all child comments
 

I recently had an indicdent where I discovered that some image folders on the drive that I did a backup of were damaged which resulted in an incomplete/broken backup. Fortunately I managed to recover the damaged pictures from an old computer.

old computer and other devices (no damaged files ) --> backup (had some damaged files) --> backup of backup (also got the damaged files)

I know that the drive shouldn't had been used the state where files got damaged in the first place, but I'd like to know if there's a tool that can scan for inconsistencies among the files and identify if there are any damaged ones? Preferably without having to compare with the original files.

I discovered the broken images by pure luck (it was only a couple of folders), and the thought of not doing this and continuing to backup broken files scares me at night when I try to sleep.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago

I have personally moved to ZFS which can self-repair based on generated checksums and parity data on the fly.

If you are not using ZFS or another filesystem that has built in bitrot protection then you will want to use par2. You can also use rar which has recovery/parity data options available.