Python gzip file performance

As the first release version, some features are not yet supported, such as seek and tell. Any contribution or improvement is appreciated. Mar 19, Nov 27, Jul 21, Download the file for your platform. If you're not sure which to choose, learn more about installing packages. Warning Some features may not work without JavaScript. Please try enabling it if you encounter problems.

Search PyPI Search. That zlib library is available on most systems as a shared library. Python's ctypes module gives Python code a way to talk directly to shared libraries like zlib. This mechanism is often called a foreign function interface. I wrote gzio. The zcat program gzcat on a Mac; use gzip -dc to be portable decompresses a gzip-compressed file and writes the results to stdout. Presumably this is well optimized and should let us know how much performance we can expect.

I did the above timings with the system version, gzip 1. I also installed gzip 1. I installed pigz 2. I primarily work on a Mac but I don't tend to do timings on it because the background system activity like web pages and media playing can have a big effect on the timing.

That's why I used a Debian machine for the above timings. I tried the system version of gzcat "Apple gzip This is free software. Written by Paul Eggert.

For what it's worth, I also tested pigz 2. This is more like what I expected which makes sense as I did most of my development on my laptop. I still don't know why GNU gzip is so much slower on that Debian machine. I am far from the first to point out that it's faster to use zcat than Python's gzip library.

This bytearray object is then written to a gzip file. In addition to these convenience functions, gzip module also has GzipFile class which defines the compress and decompress methods.

The constructor of this class takes file, mode and compressionlevel arguments exactly with same meaning as above. This will create a testnew.

You can unzip it using any utility to see that it contains testnew. Arjun Thakur.