
arXiv: 1908.10598
handle: 20.500.14243/377807 , 10278/5009264 , 11568/1106480
The data structure at the core of large-scale search engines is the inverted index , which is essentially a collection of sorted integer sequences called inverted lists . Because of the many documents indexed by such engines and stringent performance requirements imposed by the heavy load of queries, the inverted index stores billions of integers that must be searched efficiently. In this scenario, index compression is essential because it leads to a better exploitation of the computer memory hierarchy for faster query processing and, at the same time, allows reducing the number of storage machines. The aim of this article is twofold: first, surveying the encoding algorithms suitable for inverted index compression and, second, characterizing the performance of the inverted index through experimentation.
FOS: Computer and information sciences, data compression; efficiency; Inverted indexes, Inverted indexes; data compression; efficiency, Compression, Efficiency, Inverted index, Information Retrieval (cs.IR), Computer Science - Information Retrieval
FOS: Computer and information sciences, data compression; efficiency; Inverted indexes, Inverted indexes; data compression; efficiency, Compression, Efficiency, Inverted index, Information Retrieval (cs.IR), Computer Science - Information Retrieval
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 47 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 1% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
