Les Houches

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
===== Recasting at LH2017 =====

** interested people:** 	
fabio.maltoni@uclouvain.be,
sabine.kraml@gmail.com,
gabriel.facini@cern.ch,
D.Grellscheid@gmail.com,
ssekmen@cern.ch,
J.Butterworth@ucl.ac.uk,
nishita.desai@umontpellier.fr,
andy.buckley@cern.ch,
fuks@lpthe.jussieu.fr,
eric.conte@iphc.cnrs.fr,
peter.richardson@durham.ac.uk,
luca.perrozzi@cern.ch,
olivier.mattelaer@uclouvain.be,
Pasquale.Musella@cern.ch,
andre.lessa@cern.ch,
alexandra.oliveira@cern.ch,
ursula.laa@lpsc.in2p3.fr,
kristin.lohwasser@cern.ch,
thrynova@mail.cern.ch,
efe.yazgan@cern.ch,
philippe.gras@cern.ch,
sylvain@ift.unesp.br

This page is meant to collect information on the recasting discussions.

Outcome of the first meeting Fri, Jun 16th

== General Activities ==

  * Feasibility study of the implementation/portability of complicated MVA techniques (BDT, NN,...) into the analyses 
  * Improvement of results and recastability: how to provide correlations signal systematics, possibility of providing a few key observables unfolded. 
  * Comparison of between DELPHES results and simple object smearing.
  * Trying out the use of particle-level measurements to constrain model models

== Formats ==

  * Object efficiency tables : which format (HEPDATA?) 
 
== Benchmarking/Comparisons == 

  * Implementation of analyses of increasing complexity in the Analysis Description Format (LHADA Proposal) and in (BSM) Rivet and their comparison.
     - Choose an analysis of ATLAS or CMS which has cutflow and detector effects provided in some form, and possibly is already been implemented in the recasting codes CheckMate/MadAnalysis/Rivet/ATOM/. 
     - Implement the same analysis in LHADA and then use the dedicated parsers to provide the analysis for the recasting codes.
     - Reproduce the NP interpretation of the original paper (=validation implementation).
     - Recast the analysis for an other new physics model and compare the results.
     - Go to point one and choose a more complicated analysis...

AB: would be interesting to see how Delphes performance looks without analysis-specific cards, since a lot of people (outside the "big" recasting groups) are using it that way.

  * How to validate the analyses. 

{{:2017:groups:tools:lhada_benchmarking_excersise.png?400|}}

  * Analysis proposals
    - **arxiv:1605.03814** - Jets+MET - ATLAS - 13 TeV
        * Experimental cards --> Ben. The procedure for event generation is depicted {{2017:groups:tools:multijet.pdf?linkonly}} (Section 02), the three parameter_cards are given {{2017:groups:tools:param_cards.tgz?linkonly}} and the Pythia configuration files are {{2017:groups:tools:py8_scripts.tgz?linkonly}}
        * Plot conditions: HEPMC (after jet clustering), HEPMC + cuts, HEPMC + Detector effects, HEPMC + Detector effects + cuts 
        * Plots: pT of 1j, 2j and 3j, and MET: range [0,1] TeV, 50 bins
        * Plots: eta of 1j, 2j and 3j: range [-5,5], 20 bins
        * Analysis cutflows: Tables 1-7 in http://atlas.web.cern.ch/Atlas/GROUPS/PHYSICS/PAPERS/SUSY-2015-06/
        * 100K HepMC events with MG5_aMC LO, masses: gluino 1600, N1 0 --> Olivier+Nishita https://cernbox.cern.ch/index.php/s/3Ci4I2cgQmKwDXt
           * **Results:** [[2017:groups:tools:recasting:rivet_results|here]]
        * ?K HepMC events with MG5_aMC LO, masses: gluino 1100, N1 700 --> Olivier+Nishita
           * **Results:** [[2017:groups:tools:recasting:results_gluino_1100_N1_700|here]] 
        * LHADA implementation: [[https://github.com/lhada-hep/lhada/tree/master/analyses/ATLASSUSY1605.03814]]
    - **arxiv:1704.03848** - Monophoton - ATLAS - 13 TeV  Cutflow: https://atlas.web.cern.ch/Atlas/GROUPS/PHYSICS/PAPERS/EXOT-2016-32/. hepmc files: /eos/user/p/pgras/Houches2017Recast/DM_monophoton/hepmc.1/. Accessible from [[https://cernbox.cern.ch/index.php/s/8EZVNwJbSlovEBF|https://cernbox.cern.ch/index.php/s/8EZVNwJbSlovEBF]]. Asked Philippe Gras for direct access permissions to the eos directory. 
        * LHADA implementation: [[https://github.com/lhada-hep/lhada/tree/master/analyses/ATLASEXOT1704.03848]]                        
    - **CMS-SUS-16-039** - (Now superseded by paper: http://cms-results.web.cern.ch/cms-results/public-results/publications/SUS-16-039/index.html) 3 leptons + MET - CMS - 13 TeV (BDT with ~15 inputs; eff. 20-90%).  Cutflows: http://cms-results.web.cern.ch/cms-results/public-results/preliminary-results/SUS-16-039/index.html   Efficiencies: https://twiki.cern.ch/twiki/bin/view/CMSPublic/SUSMoriond2017ObjectsEfficiency
    - **arxiv:1706.04402** - 1 lepton + MET + Jets (>=1b) - CMS - 13 TeV (topness variable?)

== References ==

{{:2017:groups:tools:mctolls_bsm_1st_meeting.jpg?400|}}

  * [[2017:groups:tools:LHADA|LHADA Proposal]]
  * [[2017:groups:tools:Contur|Contur]]
 

== Simplified likelihood framework ==
--> Andy, Sylvain

CMS formalism:
https://cds.cern.ch/record/2242860/files/NOTE2017_001.pdf

AB implementations in GAMBIT and SciPy, marginalising over correlated background uncertainties (by unitary transformation + integral, and by MC sampling respectively). MadAnalysis: (Benj: I would like to do it, but time is my main problem. Anyone to help here?  AB: Maybe my Python code, when finished?)

AB: reporting of SR n & b arrays and covariance matrix (matrices?) currently ad hoc / non-standardised. Would be //really// good to establish a standard -- ideally in HepData.

Canonical example: CMS 0-lepton search with 174 SRs and covariance matrix:
http://cms-results.web.cern.ch/cms-results/public-results/publications/SUS-16-033/index.html

Improvements to the basic CMS proposal:
https://arxiv.org/abs/1603.03061

  * Use of exponential nuisance parameters to avoid negative rates.

  * Implement a covariance matrix dependent on the parameters of interest. Happens for example if there are uncertainties on both signal and background. Depends on availability of elementary sources of uncertainties. If released as weights, will open possibilities.

SF: Simplified likelihoods as an alternative to unfolding: comparison between both methods can be done in a specific example

== LHADA ==

Examples of analysis descriptions in LHADA format:

   * https://github.com/lhada-hep/lhada/blob/master/lhada2rivet.d/CMS-PAS-SUS-16-015.lhada
   * https://github.com/lhada-hep/lhada/blob/master/lhada2rivet.d/CMS-PAS-SUS-16-015.lhada

A first version of arxiv:1605.03814 is written.  It will be added/linked here after some cleanup.
Les Houches

User Tools

Site Tools

Page Tools
