#zstandard

Today I discovered that there is also an excellent compression format, #Zstandard (ZSTD), is fast with an excellent compression ratio, developed by #Meta, and released as #opensource
I needed to backup my files because I have to wipe my PC and reinstall #Linux. Now I have a dilemma: choosing between #antiX and #Lubuntu. I have a fairly decent computer, so I could even install a more full-featured OS, but I prefer an OS that doesn’t use too many resources.
#zstd
https://www.youtube.com/watch?v=k5XsiuxHv_A

Brand new PEP by @emmatyping to add Zstandard to the standard library:
https://peps.python.org/pep-0784/

Will it make it in to 3.14 before the feature freeze on 2025-05-06? It'll be close but it's possible!

The PEP also suggests namespacing the other compression libraries lzma, bz2 and zlib, with a 10-year deprecation for the old names.

Join the discussion to give your support, suggestions or feedback:

https://discuss.python.org/t/pep-784-adding-zstandard-to-the-standard-library/87377

#PEP #PEP784 #zstd #zstandard #stdlib #Python #compression

#Zstandard 1.5.7 has been released (#zstd / #RFC8878 / #RFC8478 / #Facebook / #Meta / #CompressionAlgorithm / #FileArchiver / #DataCompression) https://facebook.github.io/zstd/

#Zstandard (aka #zstd) v1.5.7 is out:

https://github.com/facebook/zstd/releases/tag/v1.5.7

'"[…] a significant release […] brings enhancements across various domains, including performance, stability, and functionality […]

The compression speed for small data blocks has been notably improved at fast compression levels[…]

The --patch-from functionality of the zstd CLI […] v1.5.7 largely mitigates the speed impact of high compression levels 18+,

The compression ratio has been enhanced slightly for large data across all compression levels […]"'

I love playing around with #compression

In this case, it's all text-based data in csv and xml formats.

Size:

32,696,320 202411.tar 4,384,020 202411.tar.bz2 4,015,912 202411.tar.zst 3,878,583 202411.tar.bz3 3,730,416 202411.tar.xz

zstd was invoked using zstd --ultra -22
xz was invoked using xz -9e
bzip2 was invoked using bzip2 -9
bzip3 has no compression level options

Speed:

zstd 54.31user 0.25system 0:54.60elapsed 99%CPU xz 53.80user 0.06system 0:53.93elapsed 99%CPU bzip2 5.33user 0.01system 0:05.35elapsed 99%CPU bzip3 3.98user 0.02system 0:04.01elapsed 99%CPU

Maximum memory usage (RSS):

zstd 706,312 xz 300,480 bzip3 75,996 bzip2 7,680

*RSS sampled up to ten times per second during execution of the commands in question

#bzip3 is freaking amazing, yo.

#DataCompression #bzip #bz3 #zstd #zst #zstandard #xz #lzma
#CouldaBeenABlost ;)

#Linux Firmware Updater #Fwupd 1.9.16 Adopts #Zstd for Compressing Metadata, Brings Support for #Acer T34 & U33 Docks and #Qualcomm Series 5 Devices https://9to5linux.com/fwupd-1-9-16-brings-support-for-acer-t34-and-u33-docks-qualcomm-series-5-devices

#OpenSource #Zstandard

Google: Chrome testet deutlich verbesserte Kompression - Golem.de
https://glm.io/182959?n #Webbrowser #Browser #Chrome #Brotli #Zstandard

We started with #LosslessCompression. Across a range of general-purpose (GP) compressors, we found that #Zstandard with
@Blosc2 achieves the best compromise between compression ratio and decompression speed!

NP1: compressed size ~36%
NP2: compressed size ~52%

(3/n)

Zstd (#Zstandard) in the #Linux #kernel is now up on par to #zstd 1.5.2 thx to this merge for #LinuxKernel 6.2: https://git.kernel.org/torvalds/c/158738ea75059fb4ddf812e2cb9fe1ff6e22bc70

We are moving to #Zstandard compression (in place of LZMA) https://lists.wikimedia.org/pipermail/offline-l/2020-September/001625.html

What extension should Zrythm projects have?

#yaml #zstandard #MIME

> zstd and xz trade blows in their compression ratio. Recompressing all packages to zstd with our options yields a total ~0.8% increase in package size on all of our packages combined, but the decompression time for all packages saw a ~1300% speedup.

Started using #Zstandard for compression, just tried compressing my first file. Compression is so fast that it runs faster than the hard drive itself, while still giving a first-tier compression rate. xz is still the best, but took 5x-10x more time to complete. #zstd FTW.

python-zstandard: #Python bindings to the #Zstandard (#zstd) compression library https://github.com/indygreg/python-zstandard

Here's an interesting read on the Zstandard compression algorithm (BSD licensed), and the other ones we use all the time. Nerd stuff!
https://gregoryszorc.com/blog/2017/03/07/better-compression-with-zstandard/
#Zstandard #Zstd #DataCompression #FOSS #LibreSoftware