2021/11/12 by Florian Henkel, Henkel, Florian, Stephanie Schwaiger +3 · 1 citation
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies #Video Analysis and Summarization
paper · pdf · doi:10.48550/arxiv.2111.06643
We present a prototype of an automatic page turning system that works directly on real scores, i.e., sheet images, without any symbolic representation. Our system is based on a multi-modal neural network architecture that observes a complete sheet image page as input, listens to an incoming musical performance, and predicts the corresponding position in the image. Using the position estimation of our system, we use a simple heuristic to trigger a page turning event once a certain location within the sheet image is reached. As a proof of concept we further combine our system with an actual machine that will physically turn the page on command.