2018-12-13 20:13:35
can someone recommend a compression program for linx that has offers fast decompression? Just for a stream like gzip
mjay
2018-12-13 20:14:02
pigz has multicore compression, but only single core decompression
mjay
2018-12-13 20:14:20
pbzip2 also has multicore decompression, but thats too slow
mjay
2018-12-13 20:14:43
you want single stream but multicore on compress and decompress?
Fireduck
2018-12-13 20:15:13
yes, single stream, fast decompression. Compression is done only once, so single core is okay
mjay
2018-12-13 20:15:50
I can think of ways to design that, but I don't have any idea what exists now
Fireduck
2018-12-13 20:16:26
Designing a solution for this is probably overkill
mjay
2018-12-13 20:16:35
usually is
Fireduck
2018-12-13 20:20:34
brotli
Rotonen
2018-12-13 20:21:20
brotli - lossless compression algorithm and format (command line utility)
Fireduck
2018-12-13 20:21:25
see also: zstd
Rotonen
2018-12-13 20:22:12
I like how it says it is lossless. Like a general compression utility that had loss would in any way ever be useful
Fireduck
2018-12-13 20:22:50
"There was a bunch of code here, but it looked like bullshit so I compressed it into this comment. --Your Compression Algo"
Fireduck
2018-12-13 20:22:52
i think its predecessor, gipfeli, had issues
Rotonen
2018-12-13 20:22:57
hah
Fireduck
2018-12-13 20:23:11
it’s the google zürich guys
Rotonen
2018-12-13 20:23:16
when your binary needs more jpeg
Fireduck
2018-12-13 20:23:27
all of their stuff is swiss german for meeting snacks
Rotonen
2018-12-13 20:23:40
the next one is zopfli
Rotonen
2018-12-13 20:23:51
I had issues with brotli, when decompressing huge files sometimes the checksum did not match
mjay
2018-12-13 20:24:21
i guess metrify lz4
Rotonen
2018-12-13 20:24:33
that’s the use-case norm
Rotonen
2018-12-13 20:29:25
its all swiss snacks, the "li" is not used in germany
mjay
2018-12-13 21:51:59
only because you stopped to know how to write :P
Rotonen