Support for Brotli compression

[joostdebruijn]

Is it an idea to add Brotli compression for https-requests to this module? Now support for Brotli has landed in the developer channels of Firefox and Chrome it is very likely that a significantly amount of clients will have support for this enabled in the very near future. So, it is maybe a good idea to support it in this module too.

I’m not (yet) very experienced with building modules for Node, but if there is anything I can help with, please let me know.

[dougwilson]

Hi! This was discussed before in #59 if you want to read the prior discussion.

The answer is that we certainly can, but for it to be built-in here, we need the support either added to Node.js core or a pure-JS library.

Barring that, another option is to make this module flexible and allow for alternative user-defined encodings. There was the PR #62 but it was never completed due to a disagreement between the author and myself over a feature I wanted to be supported.

[dantman]

The performance of brotli is something that should be kept in mind.

Some previous tests:

• https://blog.cloudflare.com/results-experimenting-brotli/
• https://www.opencpu.org/posts/brotli-benchmarks/

brotli isn't necessarily always more efficient than gzip. brotli's biggest advantage is that at higher compression levels, at the cost of compression time, you can get compression ratios beyond what you can do even by using zopfli.

So you don't really get an advantage from using zopfli or brotli for dynamic content. They work best when you can wait a few extra seconds to let the compressor do more work.

For most people this means making a .gz file (using zopfli) and a .bro file with brotli during your build step and using the pre-compressed files instead of dynamically compressing with either.

[LeandroFavero]

dougwilson, maybe this can help:
A JavaScript port of the Brotli compression algorithm
https://github.com/devongovett/brotli.js

[passcod]

Note that the above port of Brotli doesn't support streaming yet. People interested in brotli and zopfli in the meantime may want to have a look at https://github.com/aickin/shrink-ray.

[mikemaccana]

@dantman At level 4, Brotli uses less CPU AND compresses better than gzip - here's the results of a test using the top 1000 URLs on the internet: https://blogs.akamai.com/2016/02/understanding-brotlis-potential.html

[dougwilson]

It looks like Node.js is discussing adding support ad a built-in nodejs/node#18964 which should make it trivial to add to this module.

[yocontra]

This library supports streaming - https://github.com/MayhemYDG/iltorb#stream (native package though, maybe make it an optional dep?)

If the maintainers are interested I can send a PR, let me know.

[voxpelli]

Built in support in Node landed 2 days ago: nodejs/node#24938

[adrienharnay]

Node 11.7.0 has been released with brotli support 🎉

[dougwilson]

PR #150

[camillegrings]

Hey guys, when are you going to release the new version with support for brotli? I'm already using your lib, and i didn't wanted to change to another, because your lib is working fine in my project.

[patrickmichalina]

I submitted a PR #156 since there was not progress on the other one.

[KB1RMA]

Is there any reason Patrick's PR from above is still waiting for a merge? I'm running on 10.16 at the moment and would love to be able to turn brotli on - I can't see anything obvious holding up the release of that option via the PR.

[dougwilson]

It seems like a duplicate of #150 and doesn't even address the issues that were brought up in that issue.

[KB1RMA]

Ah I missed that PR, sorry. Looks like it addresses the testing well but not the options.

[patrickmichalina]

I can look into the options portion as well.

[nicksrandall]

Yet another PR #173

[mridang]

Hi everyone. 👋🏼 It's been a god couple of years since the last comment on this thread so I'm just checking if this still slated to be done? I would hate to run off a fork. Of course, if there ways I can contribute, happy to do this. Both #172 and #173 seem to be in limbo. Thank you

[Kikobeats]

I resolved this creating a standalone package: https://github.com/Kikobeats/http-compression
Working with no issues from a year.