2025/09/30 by S. Caron, Nadezhda Dobreva, Caron, Sascha +15
Earth and Planetary Sciences · Medicine · #FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #Machine Learning (cs.LG) #Medical Imaging Techniques and Applications #Seismic Imaging and Inversion Techniques
paper · pdf · doi:10.48550/arxiv.2509.26411
openalex publication_date 2025/09/30 · openalex created_date 2025/10/19 · openalex updated_date 2026/07/28
High-Energy Physics experiments are rapidly escalating in generated data volume, a trend that will intensify with the upcoming High-Luminosity LHC upgrade. This surge in data necessitates critical revisions across the data processing pipeline, with particle track reconstruction being a prime candidate for improvement. In our previous work, we introduced "TrackFormers", a collection of Transformer-based one-shot encoder-only models that effectively associate hits with expected tracks. In this study, we extend our earlier efforts by conducting detailed investigations into more custom Transformer attention mechanisms, a new design combining geometric projection and lightweight clustering, and a joint model conditioning classification on a regressor's predictions. Furthermore, we discuss new datasets that allow the training on hit level for a range of physics processes. These developments collectively aim to boost both the accuracy and potentially the efficiency of our tracking models, offering a robust solution to meet the demands of next-generation high-energy physics experiments.