FST [internal-dpl-ccdb-backend]:[ERROR] Failed to open file

O²
1

Hi,

I’m trying to run the FST (for a limited set of detectors and with QC enabled, but don’t think that’s really what’s relevant here) :

BEAMTYPE=PbPb QC_CONFIG_PARAM="--local-batch=QC-reco-mft-mch-mid.root" FST_SYNC_EXTRA_WORKFLOW_PARAMETERS=QC WORKFLOW_DETECTORS="MFT,MCH,MID" WORKFLOW_DETECTORS_RECO="MFT,MCH,MID" GEN_TOPO_WORKDIR=$HOME/tmp WORKFLOW_EXTRA_PROCESSING_STEPS=MFT_RECO,MCH_RECO,MID_RECO,MUON_SYNC_RECO bash ../O2/prodtests/full_system_test.sh

and I’m getting a crash at digitisation stage, because some CCDB files can’t be found (note that I do have a token).

ernal-dpl-ccdb-backend]: [10:41:45][ERROR] Failed to open file alien:///alice/data/CCDB/TPC/Calib/VDriftTgl/04/00148/01683855-2e90-11ed-ac0b-200114580202?filetype=raw
[82379:internal-dpl-ccdb-backend]: [10:41:45][INFO] ccdb reads https://alice-ccdb.cern.ch/TPC/Calib/VDriftTgl/1546300800000/01683855-2e90-11ed-ac0b-200114580202 for 1550600800000 (load to memory, agent_id: nanpc707-1669196498-5PN2qm), 
[82379:internal-dpl-ccdb-backend]: [10:41:46][ERROR] Failed to open file alien:///alice/data/CCDB/TPC/Calib/LaserTracks/14/60057/dd26d771-0929-11ed-8000-2a010e0a0b16?filetype=raw
[82379:internal-dpl-ccdb-backend]: [10:41:46][INFO] ccdb reads https://alice-ccdb.cern.ch/TPC/Calib/LaserTracks/1546300800000/dd26d771-0929-11ed-8000-2a010e0a0b16 for 1550600800000 (load to memory, agent_id: nanpc707-1669196498-5PN2qm), 
[82379:internal-dpl-ccdb-backend]: [10:41:46][ERROR] Failed to open file alien:///alice/data/CCDB/CPV/Config/CPVSimParams/02/18202/5ce9988b-d60c-11ec-8000-0aa202a21b9a?filetype=raw
[82379:internal-dpl-ccdb-backend]: [10:41:46][FATAL] Unable to find object CPV/Config/CPVSimParams/1550600800000

As far as I can tell this is because of the timestamp used (startTime=1550600800000 that I see e.g. in o2simdigitizerworkflow_configuration.ini).

o2-ccdb-downloadccdbfile --host http://alice-ccdb.cern.ch -p TPC/Calib/LaserTracks -t 1550600800000
[INFO] Init CcdApi with UserAgentID: nanpc707.in2p3.fr-1669201993-5PN2qm, Host: http://alice-ccdb.cern.ch
Querying host http://alice-ccdb.cern.ch for path(s) TPC/Calib/LaserTracks ... and timestamp 1550600800000
Info in <TJAlienConnectionManager>: Opening connection to JCentral. Please wait
Info in <TJAlienConnectionManager>: Opening connection to 137.138.47.221
Info in <TJAlienConnectionManager>: Successfully connected to 137.138.47.221
[ERROR] Failed to open file alien:///alice/data/CCDB/TPC/Calib/LaserTracks/14/60057/dd26d771-0929-11ed-8000-2a010e0a0b16?filetype=raw
[INFO] ccdb reads http://alice-ccdb.cern.ch/TPC/Calib/LaserTracks/1546300800000/dd26d771-0929-11ed-8000-2a010e0a0b16 for 1550600800000 (retrieve, agent_id: nanpc707.in2p3.fr-1669201993-5PN2qm),

Is there something I miss in my command above to get a more valid timestamp during simulation ?

Cheers,

2

@laphecet
the timestamp should not be a problem: the objects exist and are found, what fails is the access to the corresponding alien file. Should be alien-related problem, perhaps @grigoras can tell more.

3

ah, indeed alien_cp works but TFile::Open does not.

$ alien_cp alien:///alice/data/CCDB/TPC/Calib/LaserTracks/14/60057/dd26d771-0929-11ed-8000-2a010e0a0b16 file:toto.root
jobID: 1/1 >>> Start
jobID: 1/1 >>> STATUS OK >>> SPEED 4.76 KiB/s
Succesful jobs (1st try): 1/1

root [0] TGrid::Connect("alien://")
Info in <TJAlienConnectionManager>: Opening connection to JCentral. Please wait
Info in <TJAlienConnectionManager>: Opening connection to 137.138.47.219
Info in <TJAlienConnectionManager>: Successfully connected to 137.138.47.219
(TGrid *) 0x11be7e310
root [1] TFile::Open("alien:///alice/data/CCDB/TPC/Calib/LaserTracks/14/60057/dd26d771-0929-11ed-8000-2a010e0a0b16")
(TFile *) nullptr

Must have screwed up my jalien-root installation somehow on my machine. Will x-check.

4

ok, found the origin of the problem.
Somehow I ended up with my ROOT_PLUGIN_PATH having root plugins path appear before the jalien-root one, and hence TAlienFile was used instead of TJAlienFile…
(will have to find out how that happened, but that’s another, personal, story :wink: )

Sorry for the noise.