ADMIN NETWORK & SECURITY NEWS
Public release of OpenZL, an open source data compression framework for structured data, announced by Meta
www.admin-magazine.com/News/Meta-Re...
#OpenZL #DataCompression #Meta #OpenSource
Latest posts tagged with #DataCompression on Bluesky
ADMIN NETWORK & SECURITY NEWS
Public release of OpenZL, an open source data compression framework for structured data, announced by Meta
www.admin-magazine.com/News/Meta-Re...
#OpenZL #DataCompression #Meta #OpenSource
OpenZL's core concept: format-aware compression via SDDL (Self-Describing Data Language). It optimizes compression by leveraging data structure descriptions. Can LLMs or tools like imhex/Kaitai auto-generate SDDL? #DataCompression 3/5
🚀 Introducing OpenZL, a new #opensource, format-aware compression framework!
It uses a unique “graph model” for compression, enabling modular, high-performance codecs and a universal decoder - perfect for structured data at scale
Link: https://loom.ly/z09xoNw
#DataCompression
A key critique: the Zlib visualizer lacks clarity, especially for those unfamiliar with compression concepts like Huffman coding and dynamic blocks. Users suggested adding legends and detailed explanations to improve understanding. Better visualization is crucial! #DataCompression 2/5
The discussion highlighted strong links between coding theory and data compression. Both lossless (e.g., ZIP) and lossy (e.g., JPEG) compression techniques leverage principles related to redundancy and information density. #DataCompression 4/6
#PeaZip 10.6.1 has been released ( #7Z / #7ZIP / #ARC / #PEA / #RAR / #TAR / #ZIP / #ZIPX / #zstd / #Zstandard / #FileArchiver / #DataCompression ) peazip.github.io
#7Zip 25.01 has been released ( #SevenZip / #7z / #LZMA / #LZMA2 / #ZIP / #RAR / #FileArchiver / #DataCompression ) 7-zip.org
Tired of trial-and-error with #Blosc2 compression?
You can do better with #Btune! 🚀
Btune can be trained to automatically find the best parameters for your specific datasets and use case.
Learn more about optimizing your compression workflow: ironarray.io/btune
#DataCompression #Optimization
#WinRAR 7.12 has been released ( #RAR / #ZIP / #ZIPX / #7Zip / #7z / #GZip / #zstd / #Zstandard / #FileArchiver / #DataCompression / #DarkMode ) rarlab.com
#Blosc2 now runs directly in your browser! Leveraging the power of #WASM, #Pyodide, and #JupyterLite, you can harness efficient, adaptable compression through the web's universal interface.
Compress Better, Compute Bigger, Share Faster
#WebAssembly #DataCompression #WebDevelopment #DataScience
#7Zip 25.00 has been released ( #SevenZip / #7z / #LZMA / #LZMA2 / #ZIP / #RAR / #FileArchiver / #DataCompression ) 7-zip.org
Is LLM compression lossless or lossy? The discussion leans towards lossy, which affects data accuracy but enables generalization. This trade-off is key to their efficiency and broad understanding capabilities. #DataCompression 3/6
#PeaZip 10.5.0 has been released ( #7Z / #7ZIP / #ARC / #PEA / #RAR / #TAR / #ZIP / #ZIPX / #zstd / #Zstandard / #FileArchiver / #DataCompression ) peazip.github.io
#Python-Blosc2 is hitting 1 million weekly downloads on PyPI! 🎉
Users are rapidly adopting #Blosc2, which now accounts for over 95% of downloads compared to Blosc1. 📈 Thanks to our amazing users. 🙏 🚀
Our motto: Compress Better, Compute Bigger! 💪
#Milestone #CommunitySupport #DataCompression
A new compression strategy to reduce the size of nanopore sequencing data. #DataCompression #Nanopore #SequenceData #Bioinformatics #Genomics @nanoporetech.com @genomeresearch.bsky.social 🧬 🖥️
genome.cshlp.org/content/earl...
#libzip 1.11.4 has been released ( #LZMA / #ZIP / #Zip64 / #zstd / #Zstandard / #bzip2 / #AES / #PKWARE / #FileArchiver / #DataCompression ) libzip.org
In part 2 of the SIMD blog series, Folkert shows what to do when the compiler can't use the SIMD capabilities of modern CPUs effectively. We end up with a basic, but very effective, example of a custom SIMD implementation beating the compiler.
buff.ly/pEAmXBW
#rustlang #datacompression #simd
Backbit Impawsible Ep. 19 - Optimizing C64 Video with 128 Character Frames
#C64 #BackBitImpawsible #PETSCII #8BitCoding #RetroDev #Commodore64 #ChiptuneGraphics #CharacterSetHacks #8bitVideo #Commodore64 #DataCompression
theoasisbbs.com/backbit-impa...
🌍 EGU25 GI Highlights – Thursday, 1 May
#EGU25 #GI_EGU #GIevents #CosmicRays #PlanetaryInstrumentation #GravityMagneticField #BigData #DataCompression #MiningInnovation #LowFieldNMR #SeismicHazard #WaterSystems
#Gzip 1.14 has been released ( #GNU / #GNUZip / #Gz / #TarGz / #FileArchiver / #DataCompression / #DEFLATE / #LempelZiv / #LZ77 / #LempelZiv77 / #HuffmanCode ) gnu.org/software/gzip/
#PeaZip 10.4.0 has been released ( #7Z / #7ZIP / #ARC / #PEA / #RAR / #TAR / #ZIP / #ZIPX / #zstd / #Zstandard / #FileArchiver / #DataCompression ) peazip.github.io
#libarchive 3.7.9 has been released ( #MultiFormatArchive / #CompressionLibrary / #FileArchiver / #DataCompression / #7Zip / #7z / #RAR / #ZIP / #GZip / #TAR / #XAR / #WARC / #BZIP2 / #XZ ) www.libarchive.org
#XZUtils 5.8.1 (stable) has been released ( #xz / #LZMAUtils / #LZMA / #LZMA2 / #DataCompression ) tukaani.org/xz/
#XZUtils 5.8.0 (stable) has been released ( #xz / #LZMAUtils / #LZMA / #LZMA2 / #DataCompression ) tukaani.org/xz/
Björn and Folkert created a Rust replacement for the bzip2 compression library, using c2rust to translate the C code. Read about the translation and cleanup experience in Folkert's blog: buff.ly/VqtAb0h
@trifectatech.bsky.social
#datacompression #rustlang
#Zstandard 1.5.7 has been released ( #zstd / #RFC8878 / #RFC8478 / #Facebook / #Meta / #CompressionAlgorithm / #FileArchiver / #DataCompression ) facebook.github.io/zstd/
#WinRAR 7.11 beta 1 has been released ( #RAR / #ZIP / #ZIPX / #7Zip / #7z / #GZip / #zstd / #Zstandard / #FileArchiver / #DataCompression / #DarkMode ) rarlab.com
#XZUtils 5.7.1 Alpha (dev) has been released ( #xz / #LZMAUtils / #LZMA / #LZMA2 / #DataCompression ) tukaani.org/xz/
#XZUtils 5.6.4 (stable) has been released ( #xz / #LZMAUtils / #LZMA / #LZMA2 / #DataCompression ) tukaani.org/xz/
#PeaZip 10.3.0 has been released ( #7Z / #7ZIP / #ARC / #PEA / #RAR / #TAR / #ZIP / #ZIPX / #zstd / #Zstandard / #FileArchiver / #DataCompression ) peazip.github.io