This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
2023:groups:smtools:start [2023/06/16 14:39] josh.mcfayden |
2023:groups:smtools:start [2023/06/19 11:11] (current) stefan.kiebacher |
||
---|---|---|---|
Line 20: | Line 20: | ||
- Extending study from LH17 [[https://arxiv.org/abs/1803.07977|arXiv:1803.07977]] | - Extending study from LH17 [[https://arxiv.org/abs/1803.07977|arXiv:1803.07977]] | ||
- Effective/comprehensive uncertainty band | - Effective/comprehensive uncertainty band | ||
- | - Uncertainty recommendation using available tools [Josh] | + | - Uncertainty recommendation using available tools [Josh, Gianna] |
- Setup 4-point variations of all combinations of shower and hadronisation model | - Setup 4-point variations of all combinations of shower and hadronisation model | ||
- Tune these in a consistent way to get an uncertainty envelope | - Tune these in a consistent way to get an uncertainty envelope | ||
Line 41: | Line 41: | ||
* Use of ML | * Use of ML | ||
* Common frameworks | * Common frameworks | ||
- | Interested people: Josh, Vinny, Andrea, Stefan, Saptaparna, Maria V., Sergio, Chris G, Christian P, Ana, Max, Peter M, Simon | + | Interested people: Josh, Vinny, Andrea, Stefan, Saptaparna, Maria V., Sergio, Chris G, Christian P, Ana, Max, Peter M, Simon, Sudeepan |
**Agreed projects:** | **Agreed projects:** | ||
Line 106: | Line 106: | ||
Interested: Simon, Andrzej, Stefan K. | Interested: Simon, Andrzej, Stefan K. | ||
+ | |||
+ | |||
+ | ===Tuning Accord and Strategies=== | ||
+ | * What is currently done: | ||
+ | - Common framework for tuning exist, but no single script to run | ||
+ | - Nice to have a script, which automatically prints exactly what is done and with which flags | ||
+ | - Every generator team does tuning on their own | ||
+ | - Almost no documentation on the tunes provided | ||
+ | - Rarely publicly available weights | ||
+ | - Rarely publicly available tuning options (samples, interpolation order, flags used, ...) | ||
+ | - Often post-processing tune by eye | ||
+ | * Goals of the project: | ||
+ | - Coordination among generator authors of Herwig, Pythia and Sherpa (mattermost channel?) | ||
+ | - Common framework for tuning exist, but no single reproducible script: | ||
+ | - Stefan K. trying to provide this in Professor, which automatically documents what version, options, flags, etc. are being run | ||
+ | - Someone could do something similar in Apprentice | ||
+ | - Les Houches Accord on some Benchmark observable+weight sets: | ||
+ | - Observable quality & quantity requirements: | ||
+ | - No ratio Rivets if full information is available? | ||
+ | - Reduce double counting of observables: | ||
+ | - No gaps in histogram (see e.g. some ALEPH identified particle momentum distribution) | ||
+ | - Smaller bin-width is preferred | ||
+ | - Enough statistics: | ||
+ | - NOTE: If the errors of the data are to small a theory uncertainty should be provided to the tuning framework otherwise the minimization will likely over-fit this data | ||
+ | - Benchmark sets: | ||
+ | - Conservative set of selected (IRC safe?) Event Shapes: | ||
+ | - Input from perturbative experts needed | ||
+ | - Only close to the peak, where hadronization is not dominant | ||
+ | - Provide global sets from each generator to gather information | ||
+ | - Ultimate goals: | ||
+ | - Minimal set of accorded observables+weights among all generators for comparability | ||
+ | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
+ | - Maximal set of accorded observables+weights among all generators for comparability | ||
+ | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
+ | - Provide recommendations to experiments on tuning? | ||
+ | - ... | ||
+ | |||
+ | Interested: Simon, Andrzej, Stefan K., .... | ||