This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
2023:groups:smtools:start [2023/06/16 14:39] josh.mcfayden |
2023:groups:smtools:start [2023/06/19 11:11] (current) stefan.kiebacher |
||
|---|---|---|---|
| Line 20: | Line 20: | ||
| - Extending study from LH17 [[https://arxiv.org/abs/1803.07977|arXiv:1803.07977]] | - Extending study from LH17 [[https://arxiv.org/abs/1803.07977|arXiv:1803.07977]] | ||
| - Effective/comprehensive uncertainty band | - Effective/comprehensive uncertainty band | ||
| - | - Uncertainty recommendation using available tools [Josh] | + | - Uncertainty recommendation using available tools [Josh, Gianna] |
| - Setup 4-point variations of all combinations of shower and hadronisation model | - Setup 4-point variations of all combinations of shower and hadronisation model | ||
| - Tune these in a consistent way to get an uncertainty envelope | - Tune these in a consistent way to get an uncertainty envelope | ||
| Line 41: | Line 41: | ||
| * Use of ML | * Use of ML | ||
| * Common frameworks | * Common frameworks | ||
| - | Interested people: Josh, Vinny, Andrea, Stefan, Saptaparna, Maria V., Sergio, Chris G, Christian P, Ana, Max, Peter M, Simon | + | Interested people: Josh, Vinny, Andrea, Stefan, Saptaparna, Maria V., Sergio, Chris G, Christian P, Ana, Max, Peter M, Simon, Sudeepan |
| **Agreed projects:** | **Agreed projects:** | ||
| Line 106: | Line 106: | ||
| Interested: Simon, Andrzej, Stefan K. | Interested: Simon, Andrzej, Stefan K. | ||
| + | |||
| + | |||
| + | ===Tuning Accord and Strategies=== | ||
| + | * What is currently done: | ||
| + | - Common framework for tuning exist, but no single script to run | ||
| + | - Nice to have a script, which automatically prints exactly what is done and with which flags | ||
| + | - Every generator team does tuning on their own | ||
| + | - Almost no documentation on the tunes provided | ||
| + | - Rarely publicly available weights | ||
| + | - Rarely publicly available tuning options (samples, interpolation order, flags used, ...) | ||
| + | - Often post-processing tune by eye | ||
| + | * Goals of the project: | ||
| + | - Coordination among generator authors of Herwig, Pythia and Sherpa (mattermost channel?) | ||
| + | - Common framework for tuning exist, but no single reproducible script: | ||
| + | - Stefan K. trying to provide this in Professor, which automatically documents what version, options, flags, etc. are being run | ||
| + | - Someone could do something similar in Apprentice | ||
| + | - Les Houches Accord on some Benchmark observable+weight sets: | ||
| + | - Observable quality & quantity requirements: | ||
| + | - No ratio Rivets if full information is available? | ||
| + | - Reduce double counting of observables: | ||
| + | - No gaps in histogram (see e.g. some ALEPH identified particle momentum distribution) | ||
| + | - Smaller bin-width is preferred | ||
| + | - Enough statistics: | ||
| + | - NOTE: If the errors of the data are to small a theory uncertainty should be provided to the tuning framework otherwise the minimization will likely over-fit this data | ||
| + | - Benchmark sets: | ||
| + | - Conservative set of selected (IRC safe?) Event Shapes: | ||
| + | - Input from perturbative experts needed | ||
| + | - Only close to the peak, where hadronization is not dominant | ||
| + | - Provide global sets from each generator to gather information | ||
| + | - Ultimate goals: | ||
| + | - Minimal set of accorded observables+weights among all generators for comparability | ||
| + | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
| + | - Maximal set of accorded observables+weights among all generators for comparability | ||
| + | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
| + | - Provide recommendations to experiments on tuning? | ||
| + | - ... | ||
| + | |||
| + | Interested: Simon, Andrzej, Stefan K., .... | ||