Basic QC command fails

O²
1

Dear Developers,

I have a fresh install of QualityControl on my WSL2 Ubuntu 20.04. The full output of the alienv list is

$ alienv list
Currently Loaded Modulefiles:
 1) BASE/1.0                        14) arrow/v5.0.0-alice3-4   27) re2/2019-09-01-2                  40) libxml2/v2.9.3-1           53) HepMC3/3.2.2-28
 2) GCC-Toolchain/v10.2.0-alice2-1  15) fmt/8.0.1-1             28) grpc/v1.34.0-alice2-local1        41) XRootD/v5.3.3-2            54) Monitoring/v3.10.1-5
 3) zlib/v1.2.8-1                   16) FairLogger/v1.10.4-1    29) Configuration/v2.6.3-4            42) xjalienfs/1.3.7-2          55) Common-O2/v1.6.0-8
 4) OpenSSL/v1.0.2o-1               17) curl/7.70.0-3           30) Control-OCCPlugin/v0.30.1-local1  43) ApMon-CPP/v2.2.8-alice5-1  56) JAliEn-ROOT/0.6.6-32
 5) lz4/v1.9.3-2                    18) libInfoLogger/v2.4.2-1  31) lhapdf/v6.2.1-alice2-2            44) GEANT4/v10.7.2-2           57) cgal/4.12.2-8
 6) AliEn-Runtime/v2-19-le-3        19) Ppconsul/v0.2.2-7       32) pythia/v8304-8                    45) lzma/v5.2.3-1              58) fastjet/v3.3.3_1.042-alice1-8
 7) FreeType/v2.10.1-3              20) ZeroMQ/v4.3.3-4         33) pythia6/428-alice2-2              46) ROOT/v6-24-06-14           59) libjalienO2/0.1.3-4
 8) libpng/v1.6.34-2                21) ofi/v1.7.1-2            34) generators/v1.0-8                 47) vgm/v4-9-28                60) KFParticle/v1.1-4-14
 9) Python-modules/1.0-7            22) asio/v1.19.1-2          35) libuv/v1.40.0-3                   48) GEANT4_VMC/v5-3-28         61) FFTW3/v3.3.9-4
10) boost/v1.75.0-7                 23) asiofi/v0.5.1-2         36) GLFW/3.3.2-3                      49) GEANT3/v3-7-28             62) O2/dev-local3
11) protobuf/v3.15.8-3              24) DDS/3.5.21-2            37) DebugGUI/v0.6.2-1                 50) simulation/v1.0-28         63) MCStepLogger/v0.4.0-1
12) Clang/v13.0.0-2                 25) FairMQ/v1.4.46-1        38) ms_gsl/3.1.0-2                    51) FairRoot/v18.4.2-29        64) VecGeom/89a05d148cc708d4efc2e7b0eb6e2118d2610057-29
13) utf8proc/v2.6.1-3               26) c-ares/v1.17.1-local1   39) GSL/v1.16-2                       52) Vc/1.4.1-3                 65) QualityControl/latest

I try to run the basic QC command o2-qc-run-basic -b but it fails (full output here):

o2-qc-run-basic -b
[ERROR] pid 30487 crashed with 128
[INFO] QUIT_REQUESTED
[30485:Dispatcher]: [11:57:22][INFO] Correctly handshaken websocket connection.
[30485:Dispatcher]: [11:57:22][WARN] DriverClient connected successfully. Flushing message backlog of 4577 messages. All is good.
[ERROR] pid 30486 crashed with 128
[ERROR] pid 30488 crashed with 128
[30484:producer-0]: [11:57:22][WARN] Unable to communicate with driver because client is not connected. Continuing connection attempts.
[30484:producer-0]: [11:57:22][INFO] Correctly handshaken websocket connection.
[30484:producer-0]: [11:57:22][WARN] DriverClient connected successfully. Flushing message backlog of 2186 messages. All is good.
[30485:Dispatcher]: [11:57:22][INFO] Received device shutdown request (signal 15).
[30485:Dispatcher]: [11:57:22][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately.
[30484:producer-0]: [11:57:22][INFO] Received device shutdown request (signal 15).
[30484:producer-0]: [11:57:22][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately.
[30483:internal-dpl-clock]: [11:57:22][INFO] Received device shutdown request (signal 15).
[30483:internal-dpl-clock]: [11:57:22][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately.
[30484:producer-0]: [11:57:22][STATE] RUNNING ---> READY
[30484:producer-0]: [11:57:22][STATE] READY ---> RESETTING TASK
[30484:producer-0]: [11:57:22][STATE] RESETTING TASK ---> DEVICE READY
[30484:producer-0]: [11:57:22][STATE] DEVICE READY ---> RESETTING DEVICE
[30483:internal-dpl-clock]: [11:57:22][STATE] RUNNING ---> READY
[30483:internal-dpl-clock]: [11:57:22][STATE] READY ---> RESETTING TASK
[30483:internal-dpl-clock]: [11:57:22][STATE] RESETTING TASK ---> DEVICE READY
[30483:internal-dpl-clock]: [11:57:22][STATE] DEVICE READY ---> RESETTING DEVICE
[30485:Dispatcher]: [11:57:22][STATE] RUNNING ---> READY
[30485:Dispatcher]: [11:57:22][STATE] READY ---> RESETTING TASK
[30485:Dispatcher]: [11:57:22][STATE] RESETTING TASK ---> DEVICE READY
[30485:Dispatcher]: [11:57:22][STATE] DEVICE READY ---> RESETTING DEVICE
[ERROR] pid 30483 crashed with 128
[ERROR] pid 30484 crashed with 128
[ERROR] pid 30485 crashed with 128
[INFO] Dumping used configuration in dpl-config.json
[ERROR] SEVERE: Device internal-dpl-clock (30483) returned with 128

Do you have an idea what could be the problem?

Thanks in advance, Sandor

2

Hi @slokos ,

Notice that the workflow crashes just after
[30487:qc-check-TSTQcCheck]: 2022-01-24 11:57:22.543952 CCDB backend selected
which may indicate communication problem with CCDB. The first backtrace indicates it is checking JAlien credentials.

On a side note, I also use Ubuntu 20.04 and since late December I have call aliBuild build with --no-system option to avoid crashes. I could not trace the problem and have not seen this on other systems.

1 Like
3

Hello,

I don’t see the full log, but do you have the alien token? If so, please, try removing it. Currently QC does not work with the token in the /tmp folder.

Chiara

4

Dear @pezzi and @zampolli ,

Thanks for the suggestions. Chiara is right! I had two files in /tmp directory. A tokencert_1000.pem and a tokenkey_1000.pem. After I deleted them o2-qc-run-basic -b command runs like a charm.

Thank you, Sandor

5

Very good!

Chiara

6

Hello @zampolli @bvonhall

how is situation now with QC and alien-token?
I see closed ticket Cern Authentication
What do you think about updating alidist and rebuilding O2&QC on ubuntu 20.04? Will it work?
I have alidist dated 21 of April 2022. Now it fails with complains about TJAlien credentials.

Cheers,
Sergey

7

Dear Sergey,

I did not follow up this, thus I will have to rely on Chiara or others to answer.

Cheers,
Barth

8

Hello Barth, all,

so I rebuilded my installation and now QC is working fine with alien token. This is great!

Cheers,
Sergey

9

Excellent !