Skip to main navigation Skip to search Skip to main content

Lempel-ziv parsing in external memory

  • University of Helsinki

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

34 Scopus citations

Abstract

In the 35 years since its discovery, the Lempel-Ziv factorization (or LZ77 parsing) has become a fundamental method for data compression and string processing. In many applications, computation of the factorization is a time-space bottleneck. However, and despite the increasing need to apply LZ77 to massive data sets (for both storage and indexing), no algorithm to date scales to inputs that exceed the size of RAM. In this paper we describe the first algorithms for computing the LZ77 parsing efficiently using external memory.

Original languageEnglish
Title of host publicationProceedings - DCC 2014
Subtitle of host publication2014 Data Compression Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages153-162
Number of pages10
ISBN (Print)9781479938827
DOIs
StatePublished - 2014
Event2014 Data Compression Conference, DCC 2014 - Snowbird, UT, United States
Duration: Mar 26 2014Mar 28 2014

Publication series

NameData Compression Conference Proceedings
ISSN (Print)1068-0314

Conference

Conference2014 Data Compression Conference, DCC 2014
Country/TerritoryUnited States
CitySnowbird, UT
Period03/26/1403/28/14

Keywords

  • External memory algorithms
  • Lempel-Ziv factorization
  • Text compression

Fingerprint

Dive into the research topics of 'Lempel-ziv parsing in external memory'. Together they form a unique fingerprint.

Cite this