Skip to content

Add barrel reco configParams to AOD metadata. - #15645

Open
shahor02 wants to merge 3 commits into
AliceO2Group:devfrom
shahor02:pr_conf2AODMDir
Open

Add barrel reco configParams to AOD metadata.#15645
shahor02 wants to merge 3 commits into
AliceO2Group:devfrom
shahor02:pr_conf2AODMDir

Conversation

@shahor02

Copy link
Copy Markdown
Collaborator

Add all barrel tracking configurables to AOD metadata: write them as ConfigParam__.json files from every device (1st lane only in pipelined)
Also, send them as META//0 sporadic DPL output only once for the direct collection by the
metadata writer (when it will be supported by the DPL).

With the option --collect-config-files provided, the AODProducer will collect the json dumps of ConfigParams
made by the upstream processes and will add them as <configName> : <configParam json> TObjString pairs
in the AOD metadata.
Once the DPL supports collecting META//0 sporadic inputs, the metadata will be created directly
from these inputs, so this option will not be needed for the data processing.
But in the case of MC, collecting json files via this option is the only way to add configs to the AOD metadata.

@alibuild

Copy link
Copy Markdown
Collaborator

Error while checking build/O2/fullCI_slc9 for 48e1a14 at 2026-07-29 05:18:

[1148/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-dstar-hadrons
[1149/2712] Linking CXX executable stage/bin/o2-analysis-hf-tree-creator-electron-d-c-a
[1150/2712] Building CXX object PWGHF/HFC/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-correlation-d0-hadrons.dir/taskCorrelationD0Hadrons.cxx.o
[1151/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-cellmonitor
[1152/2712] Building CXX object PWGHF/HFC/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-correlation-hfe-hadrons.dir/taskCorrelationHfeHadrons.cxx.o
[1153/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-clustermonitor
[1154/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-d0-hadrons
[1155/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-eventselection-qa
[1156/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-hfe-hadrons
[1157/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-vertexselection-qa
[1158/2712] Linking CXX executable stage/bin/o2-analysis-je-emcal-gamma-gamma-bc-wise
[1159/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-pi0-energyscale-calib
[1160/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-derived-data-creator-correlations-reduced.dir/derivedDataCreatorCorrelationsReduced.cxx.o
[1161/2712] Linking CXX executable stage/bin/o2-analysis-je-emc-tmmonitor
[1162/2712] Linking CXX executable stage/bin/o2-analysis-je-mc-generator-studies
[1163/2712] Linking CXX executable stage/bin/o2-analysis-hf-derived-data-creator-correlations-reduced
[1164/2712] Building CXX object PWGHF/HFC/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-correlation-dplus-hadrons.dir/taskCorrelationDplusHadrons.cxx.o
[1165/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-correlator-d0-hadrons.dir/correlatorD0Hadrons.cxx.o
[1166/2712] Building CXX object PWGHF/HFL/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-single-muon-reader-assoc.dir/taskSingleMuonReaderAssoc.cxx.o
[1167/2712] Building CXX object PWGHF/HFL/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-electron-weak-boson.dir/taskElectronWeakBoson.cxx.o
[1168/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-dplus-hadrons
[1169/2712] Building CXX object PWGHF/HFL/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-single-electron.dir/taskSingleElectron.cxx.o
[1170/2712] Linking CXX executable stage/bin/o2-analysis-hf-correlator-d0-hadrons
[1171/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-electron-weak-boson
[1172/2712] Building CXX object PWGHF/HFL/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-single-muon-reader.dir/taskSingleMuonReader.cxx.o
[1173/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-single-electron
[1174/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-correlator-hfe-hadrons.dir/correlatorHfeHadrons.cxx.o
[1175/2712] Building CXX object PWGHF/HFL/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-electron-selection-with-tpc-emcal.dir/electronSelectionWithTpcEmcal.cxx.o
[1176/2712] Linking CXX executable stage/bin/o2-analysis-hf-correlator-hfe-hadrons
[1177/2712] Linking CXX executable stage/bin/o2-analysis-hf-electron-selection-with-tpc-emcal
[1178/2712] Building CXX object PWGHF/HFC/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-correlation-lc-hadrons.dir/taskCorrelationLcHadrons.cxx.o
[1179/2712] Building CXX object PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-task-emc-extensive-mc-qa.dir/taskEmcExtensiveMcQa.cxx.o
[1180/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-lc-hadrons
[1181/2712] Linking CXX executable stage/bin/o2-analysis-je-task-emc-extensive-mc-qa
[1182/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-correlator-dplus-hadrons.dir/correlatorDplusHadrons.cxx.o
[1183/2712] Building CXX object PWGHF/HFC/Tasks/CMakeFiles/O2Physicsexe-analysis-hf-task-correlation-ds-hadrons.dir/taskCorrelationDsHadrons.cxx.o
[1184/2712] Linking CXX executable stage/bin/o2-analysis-hf-correlator-dplus-hadrons
[1185/2712] Linking CXX executable stage/bin/o2-analysis-hf-task-correlation-ds-hadrons
[1186/2712] Building CXX object PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-photon-isolation-qa.dir/photonIsolationQA.cxx.o
[1187/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-correlator-ds-hadrons.dir/correlatorDsHadrons.cxx.o
[1188/2712] Linking CXX executable stage/bin/o2-analysis-je-photon-isolation-qa
[1189/2712] Linking CXX executable stage/bin/o2-analysis-hf-correlator-ds-hadrons
[1190/2712] Building CXX object PWGHF/HFC/TableProducer/CMakeFiles/O2Physicsexe-analysis-hf-correlator-lc-hadrons.dir/correlatorLcHadrons.cxx.o
[1191/2712] Building CXX object PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-v0-spectra.dir/v0JetSpectra.cxx.o
[1192/2712] Linking CXX executable stage/bin/o2-analysis-hf-correlator-lc-hadrons
[1193/2712] Linking CXX executable stage/bin/o2-analysis-je-jet-v0-spectra
[1194/2712] Building CXX object PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-jet-background-analysis.dir/jetBackgroundAnalysis.cxx.o
[1195/2712] Building CXX object PWGJE/Tasks/CMakeFiles/O2Physicsexe-analysis-je-photon-charged-trigger-producer.dir/photonChargedTriggerProducer.cxx.o
[1196/2712] Linking CXX executable stage/bin/o2-analysis-je-jet-background-analysis
[1197/2712] Linking CXX executable stage/bin/o2-analysis-je-photon-charged-trigger-producer

Full log here.

shahor02 added 2 commits July 29, 2026 16:51
Add all barrel tracking configurables to AOD metadata:
write them as ConfigParam_<device>_<configname>.json
files from every device (1st lane only in pipelined)
Also, send them as META/<PROCNAME>/0 sporadic DPL output
only once for the direct collection by the metadata writer
(when it will be supported by the DPL).
With the option `--collect-config-files` provided, the AODProducer will collect the json dumps of ConfigParams
made by the upstream processes and will add them as `<configName> : <configParam json>` TObjString pairs
in the AOD metadata.
Once the DPL supports collecting META/<PROCNAME>/0 sporadic inputs, the metadata will be created directly
from these inputs, so this option will not be needed for the data processing.
But in the case of MC, collecting json files via this option is the only way to add configs to the AOD metadata
(as it is done in the sim_challenge.sh).
@alibuild

Copy link
Copy Markdown
Collaborator

Error while checking build/O2/fullCI_slc9 for 970d411 at 2026-07-29 20:19:

## sw/BUILD/O2Physics-latest/log
c++: fatal error: Killed signal terminated program cc1plus
ninja: build stopped: subcommand failed.


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
grep: error-log.txt: binary file matches
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/507c8a74b95ae5681f924f90ad69d8c8ed2e2b31/slc9_x86-64/o2checkcode/1.0-local233/etc/modulefiles
++ alibuild-generate-module
+ HAS_BIN=
+ HAS_LIB=
+ HAS_CMAKE=
+ HAS_ROOT=
+ '[' 0 '!=' 0 ']'
+ cat
+ printf 'if ![ is-loaded '\''BASE/1.0'\'' ] {\n module load BASE/1.0\n}'
+ echo 'BUILD_REQUIRES=CMake alibuild-recipe-tools defaults-release'
BUILD_REQUIRES=CMake alibuild-recipe-tools defaults-release
+ FULL_BUILD_REQUIRES='ninja MPFR UUID defaults-release FairCMakeModules ninja-fortran json-c double-conversion O2-customization pytorch_cpuinfo date Alice-GRID-Utils safe_int googlebenchmark bz2 CMake Python-modules-list alibuild-recipe-tools'
+ echo 'FULL_BUILD_REQUIRES=ninja MPFR UUID defaults-release FairCMakeModules ninja-fortran json-c double-conversion O2-customization pytorch_cpuinfo date Alice-GRID-Utils safe_int googlebenchmark bz2 CMake Python-modules-list alibuild-recipe-tools'
FULL_BUILD_REQUIRES=ninja MPFR UUID defaults-release FairCMakeModules ninja-fortran json-c double-conversion O2-customization pytorch_cpuinfo date Alice-GRID-Utils safe_int googlebenchmark bz2 CMake Python-modules-list alibuild-recipe-tools
++ env
++ cut -f1 -d=
++ grep -v '^DEFAULT_'
++ grep -v ALIBUILD_RECIPE_TOOLS
++ grep REVISION
++ grep -v PKGREVISION
++ sed -e s/_REVISION//
+ for x in $(env | cut -f1 -d= | grep -v "^DEFAULT_" | grep -v PKGREVISION | grep -v ALIBUILD_RECIPE_TOOLS | grep REVISION | sed -e 's/_REVISION//')
++ eval 'echo $LIBFFI_REVISION'
+++ echo 10
+ REVISION_VALUE=10
++ eval 'echo $LIBFFI_VERSION'
+++ echo v3.2.1-alice1
+ VERSION_VALUE=v3.2.1-alice1
++ eval 'echo $LIBFFI_ROOT'
+++ echo /sw/slc9_x86-64/libffi/v3.2.1-alice1-10
+ ROOT_PATH_VALUE=/sw/slc9_x86-64/libffi/v3.2.1-alice1-10
+ '[' -z 10 ']'
+ echo 'ninja MPFR UUID defaults-release FairCMakeModules ninja-fortran json-c double-conversion O2-customization pytorch_cpuinfo date Alice-GRID-Utils safe_int googlebenchmark bz2 CMake Python-modules-list alibuild-recipe-tools'
+ tr '[:lower:]' '[:upper:]'
+ tr - _
[0 more errors; see full log]

Full log here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants