Mapping Machine-Learned Physics into a Human-Readable Space

The Big Picture

Imagine hiring a chess grandmaster to improve your game, but instead of explaining strategy, they just silently win every match. Their results are undeniable. You’ve learned nothing you can use yourself.

This is the situation physicists face when deploying deep neural networks to analyze particle collision data. The machine wins. The physicists scratch their heads.

At the Large Hadron Collider, neural networks classify jets (sprays of particles produced when fundamental matter collides at nearly the speed of light) with impressive accuracy. But that accuracy comes with a frustrating asterisk: nobody knows exactly how the machine does it. The network ingests thousands of detector readings and produces a classification through layers of opaque mathematics. Physicists need to validate that the machine is using real physical information, not artifacts of the training data. They need to estimate systematic uncertainties. They need to understand the physics.

Taylor Faucett, Jesse Thaler, and Daniel Whiteson built a systematic method to crack open that black box, not by peering inside, but by finding simple, human-readable quantities that make the same decisions as the neural network.

Key Insight: Rather than interpreting the neural network directly, the researchers use it as a guide to discover which human-understandable physical quantities capture the same information, closing the performance gap while revealing overlooked physics.

How It Works

The core challenge is defining what “makes the same decisions” means mathematically. The team introduces a metric called Average Decision Ordering (ADO), inspired by classical rank-correlation statistics. Instead of asking whether two classifiers assign the same numerical score to each event, ADO asks a subtler question: for any pair of events, do the two classifiers agree on which one is more signal-like? This pairwise comparison measures agreement in ranking order, independent of absolute scores.

With ADO as their compass, the researchers build an iterative search algorithm:

1. Start with a large library of candidate high-level physics observables
2. Find the single observable with the highest ADO relative to the neural network
3. Add it to the working set and combine them into a new classifier
4. Identify the event pairs the current set still misorients compared to the neural network
5. Repeat, focusing only on those remaining misoriented pairs

This focus on “hard cases” is what makes the search efficient. The algorithm doesn’t waste iterations on pairs already handled correctly; it drives directly toward the gaps.

The case study is boosted W boson classification: distinguishing jets from W bosons (particles carrying the weak nuclear force, which decay into two visible particle streams) versus jets from ordinary quarks and gluons that produce just one stream. The black box is a convolutional neural network trained on 37×37 pixel calorimeter images. The human-readable candidates are Energy Flow Polynomials (EFPs), a mathematically complete set of collider observables that remain physically well-defined even when soft or nearly collinear particles are present.

The team applies their method in two modes. In supplementation mode, the algorithm starts from six well-known jet substructure observables and searches for what’s missing. It quickly identifies a seventh, a specific EFP with a “triangle” graph topology that the jet substructure community had not previously considered for this task. Adding it nearly closes the performance gap between the human-engineered approach and the CNN. Physically, this EFP encodes a three-particle angular correlation matching the geometry expected from a W boson’s two-pronged decay.

In from-scratch mode, starting only from raw jet image inputs, the algorithm iteratively assembles a set of EFPs that matches CNN performance within statistical uncertainty. The selected EFPs tell a coherent physical story about what distinguishes W jets from QCD jets.

The black-box guided search also far outperforms both brute-force search and “truth-label guiding,” where the known particle labels serve as the guide instead of the neural network. The black box turns out to be a better teacher than the ground truth itself, because it encodes decision boundaries tuned to the actual structure of the data, not just the labels.

Why It Matters

Neural networks and interpretability are in tension throughout particle physics. The networks win the performance contest, but physics requires more than winning.

Results must be validated against physical models. Systematic uncertainties must be estimated and reported. Theoretical predictions must be tested. None of that is straightforward when your classifier is 40 layers of convolutions.

Faucett, Thaler, and Whiteson’s method sidesteps the tradeoff. Train the powerful network first and let it find the optimal decision boundary. Then use it as a guide to find the simplest human-readable approximation of that boundary. You end up with a compact set of physically interpretable observables that can be individually calibrated, theoretically predicted, and experimentally validated, while capturing essentially all the discriminating power of the original machine.

The technique generalizes beyond jet physics to anywhere a black-box ML system operates on high-dimensional data but a human-readable summary would be more useful. Medical imaging, climate modeling, materials discovery: if understanding the reason behind a prediction matters, not just the prediction itself, the same iterative search could apply.

Bottom Line: By treating a neural network as a guide rather than an oracle, this work translates black-box classification into discoverable physics, and in doing so, uncovers a jet substructure observable that physicists had overlooked for years.