Slashdot Mirror
Google Launches Brotli, a New Open Source Compression Algorithm For the Web
Mark Wilson writes: As websites and online services become ever more demanding, the need for compression increases exponentially. Fans of Silicon Valley will be aware of the Pied Piper compression algorithm, and now Google has a more efficient one of its own. Brotli is open source and is an entirely new data format that offers 20-26 percent greater compression than Zopfli, another compression algorithm from Google. Just like Zopfli, Brotli has been designed with the internet in mind, with the simple aim of making web pages load faster. It is a "lossless compressed data format that compresses data using a combination of the LZ77 algorithm and Huffman coding, with efficiency comparable to the best currently available general-purpose compression methods". Compression is better than LZMA and bzip2, and Google says that Brotli is "roughly as fast" as zlib's Deflate implementation.
What's the Weissman score?
It is a "lossless compressed data format that ompresses data
... by discarding random bits and pieces of redundant occurrences of words.
`echo $[0x853204FA81]|tr 0-9 ionbsdeaml`@gmail.com
If they want to make webpages load quicker, remove ads.
Hey, Google! I have a compression algorithm that can compress any size to a single byte. I just need a little help with the decompress and we can really speed things up.
for a better user experience. The real reason is so that ad blockers will no longer work. It will no longer be web "pages", they will be "apps". The walled garden will move to the web and have the doorway sealed shut.
Stop making my browser run 500 trips to DNS in order to run 500 trips to every ad server in the world.
Also, for the everloving sake of Christ, you don't need megabytes of scripts, or CSS, or any other shit loaded from 50 more random domains in order to serve up an article consisting of TEXT. One kilobyte of script will be permitted to setup a picture slideshow, if desired. /Get off my e-lawn
if Google was serious about speeding things up, they'd make a top 1000 list of stupid websites that load a crapton of useless scripts and ads just to present simple content across the web.
the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff
7z is pretty slow. Modern internet connection speeds are already between 100 Mbps (mobile) to up to 1 Gbps (fiber optics). Of course developing countries are still at about 50-100 Mbps level.
Thus something like LZ4 compresses much less, but total time of transmission is typically better. Who cares of the compression ratio, total time to complete the transaction matters.
From the paper:
Unlike other algorithms compared here, brotli includes a static dictionary. It contains 13’504
words or syllables of English, Spanish, Chinese, Hindi, Russian and Arabic, as well as common
phrases used in machine readable languages, particularly HTML and JavaScript.
This means that brotli isn't a general purpose algorithm, but only built for the web, not more. I guess that future versions of the algorithm will include customized support for other, smaller languages, whose compression databases are only downloaded if you open a web page in that language.
It wants its bottleneck back. From what I can see it's plugins, scripts and adverts loading from fifty different sites that clog web pages, not large file sizes or what have you. Yes I get that compression is vital for an outfit like Google and they want to showcase what they've been doing but most websites don't have their traffic volume.
Let it be said that the USA resents being called a developing country.
Minimum threshold fixed. Thanks!
It is a "lossless compressed data format..."
As opposed to what, a lossy compression formula for data?
Well hell, if you don't need the original data back I've got a compressor algorithm that'll reduce a 50GB file to 1 byte every time. Sometimes even less than a byte, like maybe 0.25 bytes. In fact it reduces the file to such a small size that just finding it again turns out to be a real challenge...
Just cruising through this digital world at 33 1/3 rpm...
Be careful, you might summon the flying spittle of APK.
APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
Then it needs to start acting like a developed country. It can start by having some decent telecom regulation so that internet speeds are sufficient and inexpensive (if the US can't beat Romania of all places, then it deserves to be called "third world"), and cellular coverage is as good as northern Finland while as inexpensive.
How do I block your ads for "hosts"?
FWIW... words ending with -li are usually Swiss. Austrians would use -le.
There are much better general purpose lossless compression algorithms than what is in 7-Zip (LZMA2) or WinRAR. They are also much slower, like the paq series that uses context modeling and arithmetic coding.
The challenge here is to do something that is also fast and memory efficient. In fact, we could improve the compression of Brotly very easily just by using arithmetic coding instead of Huffman coding. But the improvement probably wasn't worth the performance loss.
Google's algorithm addresses those issues by having a fixed dictionary. Compression is faster because there is no need to compute the dictionary, transmission is faster because there is no need to transmit the dictionary, and decompression uses less memory and is faster because the dictionary is shared between multiple streams.
const int one = 65536; (Silvermoon, Texture.cs)
SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
The very fact that your software requires a privilege escalation every time it updates indicates you don't understand security. Most people have no way to know what your software does when it updates, what is to stop you from having a Trojan load on your update? There is nothing, whereas your "rival" adblock requires no escalation.
APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?