2023/07/10 by Minxuan He, He, Minxuan, Daohan Wang +1 · 6 citations
Physics and Astronomy · #FOS: Physical sciences #High Energy Physics - Phenomenology (hep-ph) #High-Energy Particle Collisions Research #Particle Detector Development and Performance #Particle physics theoretical and experimental studies
paper · pdf · doi:10.48550/arxiv.2307.04723
openalex publication_date 2023/07/10 · openalex created_date 2023/07/12 · openalex updated_date 2026/07/28
Jet tagging is a crucial classification task in high energy physics. Recently the performance of jet tagging has been significantly improved by the application of deep learning techniques. In this study, we introduce a new architecture for jet tagging: the Particle Dual Attention Transformer (P-DAT). This novel transformer architecture stands out by concurrently capturing both global and local information, while maintaining computational efficiency. Regarding the self attention mechanism, we have extended the established attention mechanism between particles to encompass the attention mechanism between particle features. The particle attention module computes particle level interactions across all the particles, while the channel attention module computes attention scores between particle features, which naturally captures jet level interactions by taking all particles into account. These two kinds of attention mechanisms can complement each other. Further, we incorporate both the pairwise particle interactions and the pairwise jet feature interactions in the attention mechanism. We demonstrate the effectiveness of the P-DAT architecture in classic top tagging and quark-gluon discrimination tasks, achieving competitive performance compared to other benchmark strategies.