Preserving New Physics while Simultaneously Unfolding All Observables

The Big Picture

Imagine trying to identify a rare flower in a dense forest using only a blurry photograph. That’s roughly the situation physicists face at the Large Hadron Collider (LHC). Particle detectors don’t record clean physics events. They record a smeared, distorted version of reality filtered through layers of hardware. The process of mathematically “unblurring” that image to recover the underlying physics is called unfolding, and for decades it has been a bottleneck in the search for new particles.

Traditional unfolding methods were designed for a world where we already know what we’re looking for. They compress data into a handful of hand-selected measurements and use simulations of known physics (the Standard Model, our best theory of matter and forces) to correct for detector distortions. But if something genuinely new is hiding in the data, something whose detector signature differs from anything we’ve simulated, the standard approach could systematically erase exactly the signal we’re trying to find.

A team from MIT and Lawrence Berkeley National Laboratory asked a sharp question: if you unfold everything at once, all particles, all their properties, the full shape of every collision event, can you preserve the fingerprint of new physics nobody was specifically looking for? Their answer, with important caveats, is yes.

Key Insight: Machine learning-powered full phase space unfolding can preserve signatures of exotic new particles in LHC data. This opens the door to model-agnostic searches on corrected data rather than raw detector output, but only when those signals are strong enough to survive the procedure.

How It Works

The central tool is OmniFold, a machine learning method that works differently from traditional approaches. Instead of sorting data into bins and inverting a correction table, OmniFold trains neural network classifiers to iteratively reweight simulated events until they match actual experimental data. The result is a corrected, detector-free snapshot of particle collisions, not for one measurement at a time, but for all measurements simultaneously.

The OmniFold loop runs in two alternating steps:

1. Step 1 — Match detector-level simulation to data: Train a classifier to distinguish real detector data from simulated detector events. Use the classifier output as event weights, pushing the simulation to look like the data.
2. Step 2 — Push weights back to particle level: Apply those detector-level weights to the corresponding particle-level simulated events. Train a second classifier to make the unweighted particle-level simulation match the newly weighted version. These particle-level weights are the unfolded result.

Repeat. Iterate. Converge.

OmniFold can tackle the full phase space (the complete description of every particle produced in every collision) because it uses particle cloud networks: neural architectures built to process any number of particles in any order, exactly as they emerge from a collision. Every particle track, every jet (a spray of particles from a quark or gluon), every photon gets included. Nothing is discarded.

The benchmark physics target is deliberately tricky: exotic Higgs boson decays into a Z boson (carrier of the weak nuclear force) plus a light neutral particle that decays into ordinary matter. This produces a distinctive particle cluster buried under ordinary Z+jets production, the everyday process where a Z boson appears alongside jets. Simple bump-hunting in a one-dimensional mass spectrum would miss it.

The team tested two variants. MultiFold processes the full event as a point cloud, treating each collision as a swarm of particles with no assumed structure, making it sensitive to complete event geometry. OmniFold operates on a compact numerical summary of the event, trading some information for computational tractability. Comparing the two reveals where information lives in high-dimensional event space.

Why It Matters

The results are nuanced, which is part of what makes them useful. When the signal cross section (roughly, how often the exotic decay occurs relative to all collisions) is high enough, OmniFold successfully preserves the new physics information. The researchers quantify this using the Fisher information, a measure of how much a dataset “knows” about a particular parameter. In favorable cases, the Fisher information in the unfolded data matches the raw detector data: quantifiably, nothing is lost.

But when the signal is rare, unfolding degrades. Classifiers trained overwhelmingly on Standard Model events don’t correctly model the rare signal’s detector response, and the corrected data can misrepresent the new physics in ways that are difficult to catch after the fact.

The team also tested what happens when new physics is included in the simulation used for unfolding, a more realistic scenario where physicists have some prior suspicion of what to look for. Including the signal in the generation step improves fidelity substantially. This suggests that hybrid strategies, part model-agnostic and part model-informed, may offer the best practical path forward.

For most of the LHC’s history, the workflow has been linear: theorists propose a model, experimentalists design a targeted analysis, and the two communities meet when results are published. Full phase space unfolding scrambles that workflow in the best possible way. Experimentalists could publish unfolded datasets that any theorist can analyze with any model, no access to raw detector data or proprietary simulation chains required.

The stakes are high. The LHC’s High-Luminosity upgrade will produce data at rates that make exhaustive model-by-model searches increasingly impractical. Methods that preserve new physics information in a corrected, model-agnostic form could become the primary interface between raw collision data and the broader physics community. This paper provides an honest benchmark, failure modes included, that the field needs before deploying these methods at scale.

Bottom Line: OmniFold-style full phase space unfolding can preserve exotic new physics signatures in LHC data when signals are strong, opening the door to model-agnostic searches on corrected data. Signal rarity remains a fundamental challenge that next-generation methods must address.