Google Launches Brotli, a New Open Source Compression Algorithm For the Web

Mark Wilson writes: As websites and online services become ever more demanding, the need for compression increases exponentially. Fans of Silicon Valley will be aware of the Pied Piper compression algorithm, and now Google has a more efficient one of its own. Brotli is open source and is an entirely new data format that offers 20-26 percent greater compression than Zopfli, another compression algorithm from Google. Just like Zopfli, Brotli has been designed with the internet in mind, with the simple aim of making web pages load faster. It is a "lossless compressed data format that compresses data using a combination of the LZ77 algorithm and Huffman coding, with efficiency comparable to the best currently available general-purpose compression methods". Compression is better than LZMA and bzip2, and Google says that Brotli is "roughly as fast" as zlib's Deflate implementation.

Comments

What's the Weissman score?

[monkeyzoo]

What's the Weissman score?

ompresses data

[dmbasso]

It is a "lossless compressed data format that ompresses data

... by discarding random bits and pieces of redundant occurrences of words.

Re:ompresses data

[wickerprints]

No no no... you don't understand. It's just THAT good of a ompression gorithm.

A better idea

[Anonymous Coward]

If they want to make webpages load quicker, remove ads.

Re:A better idea

[Anonymous Coward]

If they want to make webpages load quicker, remove ads.

That would only be a linear improvement. They need to load exponentially faster.

To make web pages load faster:

[Anonymous Coward]

Stop making my browser run 500 trips to DNS in order to run 500 trips to every ad server in the world.

Also, for the everloving sake of Christ, you don't need megabytes of scripts, or CSS, or any other shit loaded from 50 more random domains in order to serve up an article consisting of TEXT. One kilobyte of script will be permitted to setup a picture slideshow, if desired. /Get off my e-lawn

name and shame

[Thud457]

if Google was serious about speeding things up, they'd make a top 1000 list of stupid websites that load a crapton of useless scripts and ads just to present simple content across the web.

Re:name and shame

[doconnor]

Google announced a while ago that they would take into account page load speed in search ranking.

For the web only, not much more

[NotInHere]

From the paper:

Unlike other algorithms compared here, brotli includes a static dictionary. It contains 13’504
words or syllables of English, Spanish, Chinese, Hindi, Russian and Arabic, as well as common
phrases used in machine readable languages, particularly HTML and JavaScript.

This means that brotli isn't a general purpose algorithm, but only built for the web, not more. I guess that future versions of the algorithm will include customized support for other, smaller languages, whose compression databases are only downloaded if you open a web page in that language.

Re:7zip

[sims 2]

Let it be said that the USA resents being called a developing country.