Skip to content

A tutorial for data deconvolution, using discriminators to estimate the maximum likelihood between 2 distributions

Notifications You must be signed in to change notification settings

ftoralesacosta/OMNIFOLD_Tutorial

Repository files navigation

PHYSTAT 2024 OmniFold Tutorial

This Repository is an OminFold tutorial meant to walk through the steps of using Omnifold for unfolding at the PHYSTAT 2024 conference.

OmniFold, we use ML-based deconvolution (called “unfolding” in particle/nuclear physics) to measure moments defining properties of collisions. By iteratively reweighting a set of simulated events with deep learning, we can correct entire datasets for detector effects.

We first repurpose a classifier as a likelihood-ratio estimator to reweight synthetic data to match real data.  A second step acts on the synthetic data prior to detector simulation to locally average over the phase space.  The key aspect of this approach is that it can process unbinned (and high-dimensional) inputs, unlike classical methods like Lucy-Richardson deconvolution (called “iterative Bayesian unfolding” in particle/nuclear physics). 

Data

The data used for this tutorial is a Pythia/Herwig + Delphes Jet Datasets for OmniFold. You can load it easily using the EnergyFlow python packageThis dataset has the advantage of having small file sizes, as well as having detector and particle level events from different event generators. The tutorial notebook will step through the structure of the data, but please refer to the link for any confusion on the dataset. If you use this data, please give credit to the original authors!

Main Requirements

  • TensorFlow
  • numpy
  • matplotlib
  • Jupyter

Environment

  • python -m venv OMNIFOLD_venv
  • source OMNIFOLD_venv/bin/activate
  • pip install -r requirements.txt
  • python -m ipykernel install --user --name=OMNIFOLD_venv
  • jupyter-lab # or notebook

About

A tutorial for data deconvolution, using discriminators to estimate the maximum likelihood between 2 distributions

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published