2023:groups:smtools:start
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
2023:groups:smtools:start [2023/06/19 10:25] stefan.kiebacher adding Tuning Accord and Strategies |
2023:groups:smtools:start [2023/06/19 11:11] (current) stefan.kiebacher |
||
|---|---|---|---|
| Line 109: | Line 109: | ||
| ===Tuning Accord and Strategies=== | ===Tuning Accord and Strategies=== | ||
| - | * What is currently done? | + | * What is currently done: |
| - | * Common framework? | + | - Common framework for tuning exist, but no single script to run |
| - | * Better documentation of existing framework | + | - Nice to have a script, which automatically prints exactly what is done and with which flags |
| - | * Benchmark sets of data | + | - Every generator team does tuning on their own |
| + | - Almost no documentation on the tunes provided | ||
| + | - Rarely publicly available weights | ||
| + | - Rarely publicly available tuning options (samples, interpolation order, flags used, ...) | ||
| + | - Often post-processing tune by eye | ||
| + | * Goals of the project: | ||
| + | - Coordination among generator authors of Herwig, Pythia and Sherpa (mattermost channel?) | ||
| + | - Common framework for tuning exist, but no single reproducible script: | ||
| + | - Stefan K. trying to provide this in Professor, which automatically documents what version, options, flags, etc. are being run | ||
| + | - Someone could do something similar in Apprentice | ||
| + | - Les Houches Accord on some Benchmark observable+weight sets: | ||
| + | - Observable quality & quantity requirements: | ||
| + | - No ratio Rivets if full information is available? | ||
| + | - Reduce double counting of observables: | ||
| + | - No gaps in histogram (see e.g. some ALEPH identified particle momentum distribution) | ||
| + | - Smaller bin-width is preferred | ||
| + | - Enough statistics: | ||
| + | - NOTE: If the errors of the data are to small a theory uncertainty should be provided to the tuning framework otherwise the minimization will likely over-fit this data | ||
| + | - Benchmark sets: | ||
| + | - Conservative set of selected (IRC safe?) Event Shapes: | ||
| + | - Input from perturbative experts needed | ||
| + | - Only close to the peak, where hadronization is not dominant | ||
| + | - Provide global sets from each generator to gather information | ||
| + | - Ultimate goals: | ||
| + | - Minimal set of accorded observables+weights among all generators for comparability | ||
| + | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
| + | - Maximal set of accorded observables+weights among all generators for comparability | ||
| + | - Tune using $\chi^2$ (more strict) and $\chi^2/(1+\chi^2)$ (less strict) | ||
| + | - Provide recommendations to experiments on tuning? | ||
| + | - ... | ||
| Interested: Simon, Andrzej, Stefan K., .... | Interested: Simon, Andrzej, Stefan K., .... | ||
2023/groups/smtools/start.1687163114.txt.gz · Last modified: 2023/06/19 10:25 by stefan.kiebacher
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
