d5flat compress --mode new --level 9 --threads auto ./data_folder ./archive.d5z Note: The output extension .d5z signals a standard zip container with the new d5flat headers. To generate only the changes between two massive flat-file directories:
| Metric | Standard ZIP (DEFLATE) | 7-Zip (LZMA2) | | | :--- | :--- | :--- | :--- | | Compressed Size | 3.2 GB | 2.1 GB | 1.4 GB | | Compression Time | 8m 22s | 14m 10s | 4m 01s | | Extraction Time | 2m 10s | 3m 45s | 0m 45s | | RAM Usage | 512 MB | 2,048 MB | 1,024 MB | d5flat zip new
d5flat extract --fast archive.d5z ./output We ran a stress test on a Ryzen 7950X (16 cores) with 64GB RAM, compressing a 10GB flat-file dataset (log files, SQL dumps, and JSON lines). d5flat compress --mode new --level 9 --threads auto