This commit is contained in:
Edgar 2022-01-06 10:45:21 +01:00
parent 9b7c2d3fae
commit 371755f289
No known key found for this signature in database
GPG key ID: 8731E6C0166EAA85

View file

@ -15,7 +15,7 @@ Each `.tar.zstd` file contains a JSON file every 5 seconds starting from 00:00 t
## The problem
These files, while compressed use only about ~8mb, but they are very efficiently compressed, but when decompressed they take about 7gb.
These files, while compressed use only about ~8mb, but they are very efficiently compressed, when decompressed they take about 7gb.
So if we don't want to use a lot of disk space or RAM we need to parse the data in a streaming way.