SoylentNews is people
SoylentNews
Web developer Ukiah Smith wrote a blog post about which compression format to use when archiving. Obviously the algorithm must be lossless but beyond that he sets some criteria and then evaluates how some of the more common methods line up.
After some brainstorming I have arrived with a set of criteria that I believe will help ensure my data is safe while using compression.
- The compression tool must be opensource.
- The compression format must be open.
- The tool must be popular enough to be supported by the community.
- Ideally there would be multiple implementations.
- The format must be resilient to data loss.
Some formats I am looking at are zip, 7zip, rar, xz, bzip2, tar.
He closes by mentioning error correction. That has become more important than most acknowledge due to the large size of data files, the density of storage, and the propensity for bits to flip.
This discussion has been archived.
No new comments can be posted.
Which Compression Format to Use for Archiving?
|
Log In/Create an Account
| Top
| 100 comments
| Search Discussion
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
I don't want a pickle,
I just wanna ride on my motorsickle.
And I don't want to die,
I just want to ride on my motorcy.
Cle.
-- Arlo Guthrie
(Score: 2) by EJ on Thursday September 12 2019, @10:31PM
The only thing that really matters is that you can store the algorithm in plaintext form that is easily reconstructed in the future. If we're talking about archives for hundreds of years from now, the most important thing to consider is the media itself. You need to be sure there will be a way to read the data off the media, and then they can recreate the algorithm to interpret the data.