How to speed up LZ4 decompression in ClickHouse?

How to speed up LZ4 decompression in ClickHouse?

When you run queries in ClickHouse, you might notice that the profiler often shows the LZ_decompress_fast function near the top. What is going on? This question had us wondering how to choose the best compression algorithm.

ClickHouse stores data in compressed form. When running queries, ClickHouse tries to do as little as possible, in order to conserve CPU resources. In many cases, all the potentially time-consuming computations are already well optimized, plus the user wrote a well thought-out query. Then all that's left to do is to perform decompression.

Read further

Share on HackerNewsShare on Reddit
2019-06-25
performance
lz4
article
decompression