Data Hoarder

0 readers

3 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago

MODERATORS

[email protected]

How would you ensure a file with high level of error corrections/corruptions resistant? (alien.top)

submitted 1 year ago by [email protected] to c/[email protected]

15 comments fedilink hide all child comments

Hello, I have a 1 file that I would like to store for a long time (Offline)
I have put it on magnetic tape and in an sealed enclosure, but time will destroy everything, so was wondering if there is a way to like zip the file to make it able to get restored if/when the corruption happens? much like a raid but just for one file

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 1 year ago

While the par file suggestions are the most reasonable thing to do there are some more interesting alternatives.

Try horcrux. It'll split your file into several pieces and make it so you only need a few of the pieces to recreate your file. You could make 99 pieces and only require 3 of them to reassemble. That way if most of them are damaged somehow you can still recreate your file.

This is similar to how Storj splits your files into 80 pieces and only needs 29 to recreate your data. It is also similar to how satellites transmit data when part of the message can be lost in transmission.