Home

The archivers/mkz port

mkz-0.1.2 – reversible columnar pre-pass + zstd archiver (cvsweb github mirror)

Description

mkz is a tar-style archiver whose backend is a reversible, schema-free
auto-columnar transform followed by zstd. It is not a new compressor: it is
a structural pre-pass that makes zstd measurably smaller on structured,
line-oriented data (logs, CSV, JSONL, telemetry) and is provably never worse
anywhere else: each block keeps whichever of raw-zstd or transformed-zstd
is smaller.

Both creating and extracting stream in constant memory (roughly one block,
independent of archive or member size), and every archive carries a SHA-256
of the reconstructed original, verified on extract, so corruption is always
detected and reported (streaming extraction is not yet atomic, so already-
written files may remain on failure).

This is the pure-C build: it depends only on libzstd (SHA-256 and base-95 are
vendored) and is byte-compatible with the reference implementation.
WWW: https://github.com/gitspoked/mkz

Maintainer

Matt Klein

Categories

archivers

Library dependencies

Files

Search