Utilize este identificador para referenciar este registo:
https://hdl.handle.net/1822/31490
Título: | Two high-performance alternatives to ZLIB scientific-data compression |
Autor(es): | Almeida, Samuel Oliveira, Vitor Serafim Pereira Pina, António Manuel Silva Melle-Franco, M. |
Palavras-chave: | Data Compression Scientific Data ROOT Parallel Compression ZLIB LZ4 FPC |
Data: | Nov-2014 |
Editora: | Springer International Publishing AG |
Revista: | Lecture Notes in Computer Science |
Resumo(s): | ZLIB is used in diverse frameworks by the scientific community, both to reduce disk storage and to alleviate pressure on I/O. As it becomes a bottleneck on multi-core systems, higher throughput alternatives must be considered, exploring parallelism and/or more effective compression schemes. This work provides a comparative study of the ZLIB, LZ4 and FPC compressors (serial and parallel implementations), focusing on CR, bandwidth and speedup. LZ4 provides very high throughput (decompressing over 1GB/s versus 120MB/s for ZLIB) but its CR suffers a degradation of 5-10%. FPC also provides higher throughputs than ZLIB, but the CR varies a lot with the data. ZLIB and LZ4 can achieve almost linear speedups for some datasets, while current implementation of parallel FPC provides little if any performance gain. For the ROOT dataset, LZ4 was found to provide higher CR, scalability and lower memory consumption than FPC, thus emerging as a better alternative to ZLIB. |
Tipo: | Artigo em ata de conferência |
URI: | https://hdl.handle.net/1822/31490 |
ISBN: | 978-3-319-09146-4 |
DOI: | 10.1007/978-3-319-09147-1_45 |
ISSN: | 0302-9743 |
Arbitragem científica: | yes |
Acesso: | Acesso aberto |
Aparece nas coleções: | CCTC - Artigos em revistas internacionais LIP - Artigos/papers |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
85820623.pdf | 268,32 kB | Adobe PDF | Ver/Abrir |