vix.ing · top · new · best · stats · spec

A Critical Analysis of Recursive Model Indexes

2021/06/30 by Marcel Maltry, Jens Dittrich, Maltry, Marcel +1 · 1 citation
Computer Science · #Bayesian Modeling and Causal Inference #Data Management and Algorithms #Data Mining Algorithms and Applications #Databases (cs.DB) #FOS: Computer and information sciences #H.3.1

paper · pdf · doi:10.48550/arxiv.2106.16166

openalex publication_date 2021/06/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The recursive model index (RMI) has recently been introduced as a machine-learned replacement for traditional indexes over sorted data, achieving remarkably fast lookups. Follow-up work focused on explaining RMI's performance and automatically configuring RMIs through enumeration. Unfortunately, configuring RMIs involves setting several hyperparameters, the enumeration of which is often too time-consuming in practice. Therefore, in this work, we conduct the first inventor-independent broad analysis of RMIs with the goal of understanding the impact of each hyperparameter on performance. In particular, we show that in addition to model types and layer size, error bounds and search algorithms must be considered to achieve the best possible performance. Based on our findings, we develop a simple-to-follow guideline for configuring RMIs. We evaluate our guideline by comparing the resulting RMIs with a number of state-of-the-art indexes, both learned and traditional. We show that our simple guideline is sufficient to achieve competitive performance with other learned indexes and RMIs whose configuration was determined using an expensive enumeration procedure. In addition, while carefully reimplementing RMIs, we are able to improve the build time by 2.5x to 6.3x.

Cited by

Related