this post was submitted on 09 Nov 2023
1 points (100.0% liked)

Data Hoarder

0 readers
3 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Hello, I have a 1 file that I would like to store for a long time (Offline)
I have put it on magnetic tape and in an sealed enclosure, but time will destroy everything, so was wondering if there is a way to like zip the file to make it able to get restored if/when the corruption happens? much like a raid but just for one file

top 15 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 1 year ago

Write it down an sealed in vacuum.

[–] [email protected] 1 points 1 year ago (1 children)

May help to get you down that rabbit hole for further research: https://www.newsgroupreviews.com/par-files.html

[–] [email protected] 1 points 1 year ago

I have some disk images that need to be bit perfect. I store them on a ZFS RAID AND I made PAR files for additional redundancy, and I keep two copies on two different computers.

[–] [email protected] 1 points 1 year ago

RAID is for uptime or speed, not for this. It also comes with the dubious feature that you can
lose
your
data
once more
without any disk failures

This question has been asked many times. Have multiple copies, replace bad copies with copies. That's it.

[–] [email protected] 1 points 1 year ago

raid but just for one file

Google "quickpar", it's exactly this.

[–] [email protected] 1 points 1 year ago

Use PAR files like the others suggested.

Or use WinRAR's recovery volumes.

[–] [email protected] 1 points 1 year ago

If it's really, really important I would probably RAR it with a larger % of recovery records, then use PAR files against it, then store it in many, many places. And every once in a while copy it to new places, checking the PAR files for checksum errors.

[–] [email protected] 1 points 1 year ago

Print out the binary code and scan it using OCR later on. Store that in a fireproof safe (/s but would work)

[–] [email protected] 1 points 1 year ago

While the par file suggestions are the most reasonable thing to do there are some more interesting alternatives.

Try horcrux. It'll split your file into several pieces and make it so you only need a few of the pieces to recreate your file. You could make 99 pieces and only require 3 of them to reassemble. That way if most of them are damaged somehow you can still recreate your file.

This is similar to how Storj splits your files into 80 pieces and only needs 29 to recreate your data. It is also similar to how satellites transmit data when part of the message can be lost in transmission.

[–] [email protected] 1 points 1 year ago

Many copies in many places, with some of the places being as far away as possible - a different country at least, a different continent even better.

[–] [email protected] 1 points 1 year ago

Par files are a good start, but if you want a truly resilient archive, you need to actively manage it. You need multiple copies in multiple places that you check on a regular schedule.

[–] [email protected] 1 points 1 year ago

Lzip is another nice format for this, I don't know how it compares to PAR though.

[–] [email protected] 1 points 1 year ago

If it's that important, I'd have multiple copies on multiple media, in multiple geographic locations. Like two hard drives and a flash drive, as well as the tape. And in multiple formats. Like raw, and rar'd.

My point is, anything important, you shouldn't have only one copy of it. The more important it is, the more copies in separate locations you should have.

[–] [email protected] 1 points 1 year ago

This might be a dumb question, but can you print it?

[–] [email protected] 1 points 1 year ago

M-Disc with another M-Disc copy stored off-site. Basically, the only way to get 100% instead of 99.9999% for the next 100 years.