Towards Novel Charged Particle Tracking Approaches with Transformer and U-Net Models
Abstract
Inspired by the recent successes of language modelling and computer vision machine
learning techniques, we study the feasibility of repurposing these developments for
particle track reconstruction in the context of high energy physics. In particular,
drawing from developments in the field of language modelling we showcase the
performance of multiple implementations of the transformer model, including an
autoregressive transformer with the original encoder-decoder architecture, and
encoder-only architectures for the purpose of track parameter classification and
clustering. Furthermore, in the context of computer vision we study a U-net style model
with submanifold convolutions, treating the event as an image and highlighting those
pixels where a hit was detected.
We benchmark these models on simplified training data utilising a recently developed
simulation framework, REDuced VIrtual Detector (REDVID). These data include noisy
linear and helical track definitions, similar to those observed in particle detectors
from major LHC collaborations such as ATLAS and CMS. We find that the proposed
models can be used to effectively reconstruct particle tracks on this simplified
dataset, and we compare their performances both in terms of reconstruction efficiency
and runtime. As such, this work lays the necessary groundwork for developments in the
near future towards such novel machine learning strategies for particle tracking on
more realistic data.