Six situations where you should not buy this
By Dylan Wolpe
The short version
- Changing an archive format costs migration effort, retraining, tooling changes and a new dependency. A storage saving has to clear all of that, not just be positive.
- If your data is mostly high-entropy, or you only need smallest-bytes-at-rest, a general-purpose compressor at maximum settings gets close enough that the change is not worth making.
- If nothing ever reads the archive and no regulator asks about it, the queryability and verification that justify our price are benefits you will never collect.
- The clearest signal you should buy is a specific question you cannot currently answer — 'prove this was not altered', 'delete this person', 'search this without restoring it' — rather than a storage line that looks large.
Every vendor page on this site argues for buying the product. This one argues against it in the cases where it should not be bought, partly because it is true and partly because a pilot that was never going to work costs us more than the deal was worth.
The cost nobody puts in the business case
A storage saving is easy to model. The other side of the ledger is not, and it is usually larger in year one:
- Migration compute, and the calendar time to run and validate it.
- Dual-running while you satisfy yourself nothing was lost.
- Every script, dashboard and runbook that touches the data.
- People learning something new for an infrastructure layer that was previously invisible.
- A new dependency in a path you will rely on for a decade.
None of that appears in a ratio. All of it appears in your quarter.
The six cases
- Storage cost is your only requirement. If you never need to read the archive again and nobody will ask questions about its integrity, a general-purpose compressor at maximum settings gets close enough. On some database corpora we land near xz on size alone. Paying for verification and queryability you will not use is a bad trade, and we would rather say so before the pilot than during the renewal.
- Your data is mostly high-entropy. Hashes, UUIDs, encrypted blobs, already-compressed media. There is no structure to model, so we floor out at roughly what a general compressor achieves. A tool claiming a large win on random data is broken.
- The volume is small. A 27% saving on 400GB is not a project. Percentage improvements need scale before they become money, and below a few hundred terabytes the engineering time usually costs more than the storage does.
- It is photographs or video. WebP and x265 beat us clearly and it is not close. We win on 16-bit medical, depth and astronomical imaging, where lossless is required. For ordinary media, use the media codecs.
- You are mid-migration on something else. A format change during a warehouse move or a cloud migration is a compounding risk with a shared blast radius. The saving will still be there in six months.
- Nobody has asked you a question you cannot answer. This is the real test, and it is the last one for a reason. Our advantages are queryable-in-place, verifiable, erasable. If no auditor asks whether records were altered, no data subject asks to be deleted, and nobody needs to search the archive without restoring it, then those properties are features you are buying and will not collect.
The buying signal is a question you cannot currently answer — not a storage line that looks large.
When it is worth it
The inverse of the sixth case, essentially. The organisations that get real value have a specific problem they have been working around, usually one of three: an auditor asking for proof records were not altered; a legal team asking to delete one person from something that cannot be edited; or an analytics team quietly maintaining a second copy of cold data because the archive cannot be searched.
In each case the storage saving is the smaller half. It also means the pilot has a clear success criterion — the question gets answered or it does not — instead of a percentage that everyone stares at, unsure what it was supposed to prove.
Why publish this
Because the alternative is worse for us. A customer who buys on a storage figure, migrates, and discovers the saving did not clear the switching cost is a bad reference, a renewal problem, and a story they tell other people in their industry. A prospect who reads this and decides not to proceed costs us nothing and occasionally comes back two years later with an auditor’s question and a budget.
It also keeps us honest in the other direction. Writing down where we should not be bought makes it much harder to quietly widen the claim when a quarter is looking thin.
Questions people ask about this
When is changing archive format not worth it?
When storage cost is your only concern and a general-purpose compressor at high settings gets you most of the way; when the data is high-entropy and will not compress further regardless; when nothing reads the archive so queryability is worthless to you; and when the volume is small enough that a percentage saving is not real money.
What are the hidden costs of a format migration?
Migration compute and time, dual-running while you validate, updating every tool and script that touches the data, retraining people, and accepting a new dependency in a path you rely on for years. These are usually larger than the storage saving in the first year.
How do I know if I actually need verified, queryable archives?
Ask whether there is a question you cannot currently answer without a lot of work: proving an archive was not altered, deleting one person from it, or searching it without restoring it. If none of those come up, you have a storage problem rather than an evidence problem, and a compressor solves storage problems more cheaply than we do.