2023/11/23 by Ryan Liu, A. Gandrakota, Liu, Ryan +7 · 1 citation
Medicine · Physics and Astronomy · #FOS: Computer and information sciences #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #Machine Learning (cs.LG) #Medical Imaging Techniques and Applications #Particle Detector Development and Performance #Particle physics theoretical and experimental studies
paper · pdf · doi:10.48550/arxiv.2311.14160
openalex publication_date 2023/11/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/30
The challenging environment of real-time data processing systems at the Large Hadron Collider (LHC) strictly limits the computational complexity of algorithms that can be deployed. For deep learning models, this implies that only models with low computational complexity that have weak inductive bias are feasible. To address this issue, we utilize knowledge distillation to leverage both the performance of large models and the reduced computational complexity of small ones. In this paper, we present an implementation of knowledge distillation, demonstrating an overall boost in the student models' performance for the task of classifying jets at the LHC. Furthermore, by using a teacher model with a strong inductive bias of Lorentz symmetry, we show that we can induce the same inductive bias in the student model which leads to better robustness against arbitrary Lorentz boost.