I think I first heard about the Zstandard compression algorithm at a Mercurial developer sprint in 2015. At one end of a large table a few people were uttering expletives out of sheer excitement. At developer gatherings, that’s the universal signal for something is awesome. Long story short, a Facebook engineer shared a link to the RealTime Data Compression blog operated by Yann Collet (then known as the author of LZ4 – a compression algorithm known for its insane speeds) and people were completely nerding out over the excellent articles and the data within showing the beginnings of a new general purpose lossless compression algorithm named Zstandard. It promised better-than-deflate/zlib compression ratios and performance on both compression and decompression. This being a Mercurial meeting, many of us were intrigued because zlib is used by Mercurial for various functionality (including on-disk storage and compression over the wire protocol) and zlib operations frequently appear as performance hot spots.

Source: Gregory Szorc’s Digital Home | Better Compression with Zstandard

Categories: Uncategorized

Related Posts

Uncategorized

Cancer Gene Trust Search

Source: Cancer Gene Trust Search Related PostsScientists Find Form of Crispr Gene Editing With New Capabilities – The New York TimesPills of Science – 1 WeekDNA Extraction Virtual LabDNA Extraction Virtual LabCancer Gene Panels http://t.co/u8SHjG91I5

Uncategorized

The Long-Term Stock Exchange Is Worth a Shot – Bloomberg

Silicon Valley venture capitalists are shaking things up with “tenure voting.” Source: The Long-Term Stock Exchange Is Worth a Shot – Bloomberg Related PostsThe Right Way to Grant Equity to Your EmployeesHow CEO Anne Wojcicki Read more…

Uncategorized

How to Be a Know-It-All | The New Yorker

What you learn from the Very Short Introduction series. Source: How to Be a Know-It-All | The New Yorker Related PostsIntroduction to Scientific Python – StanfordDeep LearningIntroduction to Biostatistics and BioinformaticsIntroduction to Biostatistics and BioinformaticsThe Read more…