[O2/latest] ~ $> o2-analysistutorial-track-iteration --aod-file AO2D.root -b [INFO] Initialising O2 Data Processing Layer. Driver PID: 19790. [INFO] O2 Data Processing Layer initialised. We brake for nobody. [INFO] Optimised build. O2DEBUG / LOG(DEBUG) / LOGF(DEBUG) / assert statement will not be shown. [INFO] Redeployment of configuration asked. [INFO] Starting internal-dpl-clock on pid 19791 [INFO] Starting internal-dpl-aod-reader on pid 19792 [INFO] Starting internal-dpl-aod-spawner on pid 19793 [INFO] Starting all-tracks on pid 19794 [INFO] Starting internal-dpl-injected-dummy-sink on pid 19795 [INFO] Starting single-tracks on pid 19796 [INFO] Redeployment of configuration done. [19794:all-tracks]: [INFO] Spawing new device all-tracks in process with pid 19794 [19794:all-tracks]: [06:57:33][INFO] [19794:all-tracks]: ______ _ _______ _________ [19794:all-tracks]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19794:all-tracks]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19794:all-tracks]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19794:all-tracks]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19794:all-tracks]: [19793:internal-dpl-aod-spawner]: [INFO] Spawing new device internal-dpl-aod-spawner in process with pid 19793 [19794:all-tracks]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [19793:internal-dpl-aod-spawner]: [06:57:33][INFO] [19793:internal-dpl-aod-spawner]: ______ _ _______ _________ [19793:internal-dpl-aod-spawner]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19793:internal-dpl-aod-spawner]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19793:internal-dpl-aod-spawner]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19793:internal-dpl-aod-spawner]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [19794:all-tracks]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [19794:all-tracks]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [19794:all-tracks]: [06:57:33][STATE] INITIALIZED ---> BINDING [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] INITIALIZED ---> BINDING [19794:all-tracks]: [06:57:33][STATE] BINDING ---> BOUND [19794:all-tracks]: [06:57:33][STATE] BOUND ---> CONNECTING [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] BINDING ---> BOUND [19794:all-tracks]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] BOUND ---> CONNECTING [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [19794:all-tracks]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] INITIALIZING TASK ---> READY [19793:internal-dpl-aod-spawner]: [06:57:33][STATE] READY ---> RUNNING [19793:internal-dpl-aod-spawner]: [06:57:33][INFO] DEVICE: Running... [19793:internal-dpl-aod-spawner]: [06:57:33][INFO] Correctly handshaken websocket connection. [INFO] Offering 1000MB to internal-dpl-aod-reader [INFO] Offering 1000MB to internal-dpl-aod-reader [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19794:all-tracks]: [06:57:33][STATE] INITIALIZING TASK ---> READY [19794:all-tracks]: [06:57:33][STATE] READY ---> RUNNING [19794:all-tracks]: [06:57:33][INFO] DEVICE: Running... [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19794:all-tracks]: [06:57:33][INFO] Correctly handshaken websocket connection. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19791:internal-dpl-clock]: [INFO] Spawing new device internal-dpl-clock in process with pid 19791 [19791:internal-dpl-clock]: [06:57:33][INFO] [19791:internal-dpl-clock]: ______ _ _______ _________ [19791:internal-dpl-clock]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19791:internal-dpl-clock]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19791:internal-dpl-clock]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19791:internal-dpl-clock]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19791:internal-dpl-clock]: [19791:internal-dpl-clock]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [19791:internal-dpl-clock]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [19791:internal-dpl-clock]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [19791:internal-dpl-clock]: [06:57:33][STATE] INITIALIZED ---> BINDING [19791:internal-dpl-clock]: [06:57:33][STATE] BINDING ---> BOUND [19791:internal-dpl-clock]: [06:57:33][STATE] BOUND ---> CONNECTING [19791:internal-dpl-clock]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [19791:internal-dpl-clock]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [19791:internal-dpl-clock]: [06:57:33][STATE] INITIALIZING TASK ---> READY [19791:internal-dpl-clock]: [06:57:33][STATE] READY ---> RUNNING [19791:internal-dpl-clock]: [06:57:33][INFO] DEVICE: Running... [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19791:internal-dpl-clock]: [06:57:33][INFO] Correctly handshaken websocket connection. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [INFO] Spawing new device internal-dpl-injected-dummy-sink in process with pid 19795 [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][INFO] [19795:internal-dpl-injected-dummy-sink]: ______ _ _______ _________ [19795:internal-dpl-injected-dummy-sink]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19795:internal-dpl-injected-dummy-sink]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19795:internal-dpl-injected-dummy-sink]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19795:internal-dpl-injected-dummy-sink]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19795:internal-dpl-injected-dummy-sink]: [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] INITIALIZED ---> BINDING [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] BINDING ---> BOUND [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] BOUND ---> CONNECTING [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] INITIALIZING TASK ---> READY [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][STATE] READY ---> RUNNING [19795:internal-dpl-injected-dummy-sink]: [06:57:33][INFO] DEVICE: Running... [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19795:internal-dpl-injected-dummy-sink]: [06:57:33][INFO] Correctly handshaken websocket connection. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [INFO] Spawing new device single-tracks in process with pid 19796 [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][INFO] [19796:single-tracks]: ______ _ _______ _________ [19796:single-tracks]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19796:single-tracks]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19796:single-tracks]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19796:single-tracks]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19796:single-tracks]: [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [INFO] Spawing new device internal-dpl-aod-reader in process with pid 19792 [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][INFO] [19792:internal-dpl-aod-reader]: ______ _ _______ _________ [19792:internal-dpl-aod-reader]: / ____/___ _(_)_______ |/ /_ __ \ version 1.4.38 [19792:internal-dpl-aod-reader]: / /_ / __ `/ / ___/__ /|_/ /_ / / / build RELWITHDEBINFO [19792:internal-dpl-aod-reader]: / __/ / /_/ / / / _ / / / / /_/ / https://github.com/FairRootGroup/FairMQ [19792:internal-dpl-aod-reader]: /_/ \__,_/_/_/ /_/ /_/ \___\_\ LGPL-3.0 © 2012-2021 GSI [19792:internal-dpl-aod-reader]: [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] Starting FairMQ state machine --> IDLE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] IDLE ---> INITIALIZING DEVICE [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [19796:single-tracks]: [06:57:33][STATE] INITIALIZED ---> BINDING [19796:single-tracks]: [06:57:33][STATE] BINDING ---> BOUND [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][STATE] BOUND ---> CONNECTING [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] INITIALIZING DEVICE ---> INITIALIZED [19792:internal-dpl-aod-reader]: [06:57:33][STATE] INITIALIZED ---> BINDING [19796:single-tracks]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [19796:single-tracks]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [19796:single-tracks]: [06:57:33][STATE] INITIALIZING TASK ---> READY [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][STATE] READY ---> RUNNING [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19796:single-tracks]: [06:57:33][INFO] DEVICE: Running... [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] BINDING ---> BOUND [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] BOUND ---> CONNECTING [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] CONNECTING ---> DEVICE READY [19792:internal-dpl-aod-reader]: [06:57:33][STATE] DEVICE READY ---> INITIALIZING TASK [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][STATE] INITIALIZING TASK ---> READY [19792:internal-dpl-aod-reader]: [06:57:33][STATE] READY ---> RUNNING [19792:internal-dpl-aod-reader]: [06:57:33][INFO] DEVICE: Running... [INFO] Controller for internal-dpl-aod-reader not yet available. [INFO] Controller for internal-dpl-aod-reader not yet available. [19792:internal-dpl-aod-reader]: [06:57:33][INFO] Correctly handshaken websocket connection. [19792:internal-dpl-aod-reader]: [06:57:33][INFO] Received shared memory offer [19792:internal-dpl-aod-reader]: [06:57:33][INFO] Received shared memory offer [19796:single-tracks]: [06:57:33][INFO] Correctly handshaken websocket connection. [19792:internal-dpl-aod-reader]: [06:57:35][INFO] Read info: lfn=AO2D.root,size=42733127,total_tf=1,read_tf=1,read_bytes=16187621,read_calls=8,io_time=1.7,wait_time=0.1 [19792:internal-dpl-aod-reader]: [06:57:35][INFO] No input files left to read for reader 0! [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: *** Break *** illegal instruction [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: =========================================================== [19793:internal-dpl-aod-spawner]: There was a crash. [19793:internal-dpl-aod-spawner]: This is the entire stack trace of all threads: [19793:internal-dpl-aod-spawner]: =========================================================== [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 10 (Thread 0x7fd301f34700 (LWP 19814) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd3853f6de2 in pthread_cond_timedwait [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #1 0x00007fd3840289b3 in __gthread_cond_timedwait (__abs_timeout=0x7fd301f2dc70, __mutex=, __cond=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:872 [19793:internal-dpl-aod-spawner]: #2 std::condition_variable::__wait_until_impl > > (__lock=..., __lock=..., __atime=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:232 [19793:internal-dpl-aod-spawner]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:141 [19793:internal-dpl-aod-spawner]: #4 std::condition_variable::wait_until >, fair::mq::StateMachine::WaitForPendingStateFor(int) const:: > (__p=..., __atime=..., __lock=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:158 [19793:internal-dpl-aod-spawner]: #5 std::condition_variable::wait_for, fair::mq::StateMachine::WaitForPendingStateFor(int) const:: > (__rtime=..., __rtime=..., __p=..., __lock=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:185 [19793:internal-dpl-aod-spawner]: #6 fair::mq::StateMachine::WaitForPendingStateFor (this=this [19793:internal-dpl-aod-spawner]: entry=0x175d830, durationInMs=durationInMs [19793:internal-dpl-aod-spawner]: entry=1000) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:364 [19793:internal-dpl-aod-spawner]: #7 0x00007fd3845b3b82 in FairMQDevice::WaitFor > (duration=..., this=0x175d770) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/chrono:422 [19793:internal-dpl-aod-spawner]: #8 FairMQDevice::LogSocketRates (this=0x175d770) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/FairMQDevice.cxx:730 [19793:internal-dpl-aod-spawner]: #9 0x00007fd3845b516d in std::__invoke_impl (__f=, __t=, __f=, __t=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:73 [19793:internal-dpl-aod-spawner]: #10 std::__invoke (__fn=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:95 [19793:internal-dpl-aod-spawner]: #11 std::thread::_Invoker >::_M_invoke<0ul, 1ul> (this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:264 [19793:internal-dpl-aod-spawner]: #12 std::thread::_Invoker >::operator() (this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:271 [19793:internal-dpl-aod-spawner]: #13 std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void>::operator() (this=0x7fd301f2e740) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/future:1365 [19793:internal-dpl-aod-spawner]: #14 std::__invoke_impl, std::__future_base::_Result_base::_Deleter>, std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void>&> (__f=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:60 [19793:internal-dpl-aod-spawner]: #15 std::__invoke_r, std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void>&> (__fn=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:113 [19793:internal-dpl-aod-spawner]: #16 std::_Function_handler (), std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void> >::_M_invoke(std::_Any_data const&) (__functor=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:292 [19793:internal-dpl-aod-spawner]: #17 0x00007fd3845b545b in std::function ()>::operator()() const (this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:622 [19793:internal-dpl-aod-spawner]: #18 std::__future_base::_State_baseV2::_M_do_set(std::function ()>*, bool*) (this=0x1768740, __f=, __did_set=0x7fd301f2e717) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/future:564 [19793:internal-dpl-aod-spawner]: #19 0x00007fd3853f120b in __pthread_once_slow () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #20 0x00007fd3845b61c6 in __gthread_once (__func=, __once=0x1768758) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:700 [19793:internal-dpl-aod-spawner]: #21 std::call_once ()>*, bool*), std::__future_base::_State_baseV2*, std::function ()>*, bool*>(std::once_flag&, void (std::__future_base::_State_baseV2::*&&)(std::function ()>*, bool*), std::__future_base::_State_baseV2*&&, std::function ()>*&&, bool*&&) (__f= [19793:internal-dpl-aod-spawner]: 0x7fd301f2e730: (void (std::__future_base::_State_baseV2::*)(std::__future_base::_State_baseV2 * const, std::function()> *, bool *)) 0x7fd3845b5440 ()>*, bool*)>, __once=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/mutex:729 [19793:internal-dpl-aod-spawner]: #22 std::__future_base::_State_baseV2::_M_set_result(std::function ()>, bool) (__ignore_failure=false, __res=..., this=0x1768740) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/future:404 [19793:internal-dpl-aod-spawner]: #23 std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}::operator()() const (this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/future:1674 [19793:internal-dpl-aod-spawner]: #24 std::__invoke_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}>(std::__invoke_other, std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}&&) (__f=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:60 [19793:internal-dpl-aod-spawner]: #25 std::__invoke >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}>(std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}&&) (__fn=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/invoke.h:95 [19793:internal-dpl-aod-spawner]: #26 std::thread::_Invoker >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> >::_M_invoke<0ul>(std::_Index_tuple<0ul>) (this=0x176b138) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:264 [19793:internal-dpl-aod-spawner]: #27 std::thread::_Invoker >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> >::operator()() (this=0x176b138) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:271 [19793:internal-dpl-aod-spawner]: #28 std::thread::_State_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> > >::_M_run() (this=0x176b130) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:215 [19793:internal-dpl-aod-spawner]: #29 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x176b130) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #30 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #31 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 9 (Thread 0x7fd302735700 (LWP 19812) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd3853f6a35 in pthread_cond_wait [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #1 0x00007fd3845d21d4 in boost::interprocess::ipcdetail::posix_condition::do_wait (mut=..., this=0x7fd385e90038) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/posix/condition.hpp:174 [19793:internal-dpl-aod-spawner]: #2 boost::interprocess::ipcdetail::posix_condition::wait > > (lock=..., this=0x7fd385e90038) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/posix/condition.hpp:67 [19793:internal-dpl-aod-spawner]: #3 boost::interprocess::interprocess_condition::wait > (lock=..., this=0x7fd385e90038) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/interprocess_condition.hpp:107 [19793:internal-dpl-aod-spawner]: #4 boost::interprocess::ipcdetail::condition_any_algorithm::do_wait > > (data=..., lock=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:126 [19793:internal-dpl-aod-spawner]: #5 0x00007fd3845fbc92 in boost::interprocess::ipcdetail::condition_any_algorithm::wait > > (abs_time=..., tout_enabled=false, lock=..., data=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:108 [19793:internal-dpl-aod-spawner]: #6 boost::interprocess::ipcdetail::condition_any_wrapper::wait >, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}>(boost::interprocess::ipcdetail::internal_mutex_lock >&, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}) (pred=..., lock=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:194 [19793:internal-dpl-aod-spawner]: #7 boost::interprocess::ipcdetail::shm_named_condition::wait >, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}>(boost::interprocess::ipcdetail::internal_mutex_lock >&, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}) (pred=..., lock=..., this=0x17a3ee0) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/shm/named_condition.hpp:216 [19793:internal-dpl-aod-spawner]: #8 boost::interprocess::named_condition::wait, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}>(boost::interprocess::scoped_lock&, fair::mq::shmem::Manager::RegionEventsSubscription()::{lambda()#1}) (pred=..., lock=..., this=0x17a3ee0) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/interprocess/sync/named_condition.hpp:170 [19793:internal-dpl-aod-spawner]: #9 fair::mq::shmem::Manager::RegionEventsSubscription (this=0x17a3e20) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/shmem/Manager.h:527 [19793:internal-dpl-aod-spawner]: #10 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x17847f0) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #11 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #12 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 8 (Thread 0x7fd302f36700 (LWP 19810) "ZMQbg/IO/0"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd37ee09fd3 in epoll_wait () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #1 0x00007fd37e77b301 in zmq::epoll_t::loop() () from /persist/sw/slc7_x86-64/ZeroMQ/v4.3.3-local1/lib/libzmq.so.5 [19793:internal-dpl-aod-spawner]: #2 0x00007fd37e7b3068 in thread_routine () from /persist/sw/slc7_x86-64/ZeroMQ/v4.3.3-local1/lib/libzmq.so.5 [19793:internal-dpl-aod-spawner]: #3 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #4 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 7 (Thread 0x7fd303737700 (LWP 19809) "ZMQbg/Reaper"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd37ee09fd3 in epoll_wait () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #1 0x00007fd37e77b301 in zmq::epoll_t::loop() () from /persist/sw/slc7_x86-64/ZeroMQ/v4.3.3-local1/lib/libzmq.so.5 [19793:internal-dpl-aod-spawner]: #2 0x00007fd37e7b3068 in thread_routine () from /persist/sw/slc7_x86-64/ZeroMQ/v4.3.3-local1/lib/libzmq.so.5 [19793:internal-dpl-aod-spawner]: #3 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #4 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 6 (Thread 0x7fd37b292700 (LWP 19808) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd3853f6de2 in pthread_cond_timedwait [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #1 0x00007fd384604f0a in __gthread_cond_timedwait (__abs_timeout=0x7fd37b28c110, __mutex=, __cond=0x17a4000) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:872 [19793:internal-dpl-aod-spawner]: #2 std::condition_variable::__wait_until_impl > > (__lock=..., __lock=..., __atime=..., this=0x17a4000) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:232 [19793:internal-dpl-aod-spawner]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=0x17a4000) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:141 [19793:internal-dpl-aod-spawner]: #4 std::condition_variable::wait_until >, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}>(std::unique_lock&, std::chrono::time_point > > const&, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}) (__p=..., __atime=..., __lock=..., this=0x17a4000) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:158 [19793:internal-dpl-aod-spawner]: #5 std::condition_variable::wait_for, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}>(std::unique_lock&, std::chrono::duration > const&, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}) (__rtime=..., __rtime=..., __p=..., __lock=..., this=0x17a4000) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:185 [19793:internal-dpl-aod-spawner]: #6 fair::mq::shmem::Manager::SendHeartbeats (this=0x17a3e20) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/shmem/Manager.h:563 [19793:internal-dpl-aod-spawner]: #7 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x17a4040) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #8 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #9 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 5 (Thread 0x7fd37c0d3700 (LWP 19804) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd3853f9e9d in nanosleep () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #1 0x00007fd384698de3 in std::this_thread::sleep_for > (__rtime=..., __rtime=...) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/thread:405 [19793:internal-dpl-aod-spawner]: #2 fair::mq::plugins::Control::SignalHandler (this=0x1731ce0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/plugins/control/Control.cxx:394 [19793:internal-dpl-aod-spawner]: #3 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x1753b70) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #4 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #5 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 4 (Thread 0x7fd37c8d4700 (LWP 19803) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd3853f6de2 in pthread_cond_timedwait [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #1 0x00007fd3846991e4 in __gthread_cond_timedwait (__abs_timeout=0x7fd37c8ce070, __mutex=, __cond=0x1731e18) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:872 [19793:internal-dpl-aod-spawner]: #2 std::condition_variable::__wait_until_impl > > (__lock=..., __lock=..., __atime=..., this=0x1731e18) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:232 [19793:internal-dpl-aod-spawner]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=0x1731e18) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:141 [19793:internal-dpl-aod-spawner]: #4 std::condition_variable::wait_for > (__rtime=..., __rtime=..., __lock=..., this=0x1731e18) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/condition_variable:172 [19793:internal-dpl-aod-spawner]: #5 fair::mq::StateQueue::WaitForNext > (this=this [19793:internal-dpl-aod-spawner]: entry=0x1731da0, duration=...) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateQueue.h:50 [19793:internal-dpl-aod-spawner]: #6 0x00007fd384698d5f in fair::mq::plugins::Control::StaticMode (this=0x1731ce0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/plugins/control/Control.cxx:379 [19793:internal-dpl-aod-spawner]: #7 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x175a010) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #8 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #9 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 3 (Thread 0x7fd37d0d5700 (LWP 19800) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd37edd08ed in nanosleep () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #1 0x00007fd37ee011c4 in usleep () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #2 0x00007fd385d5c493 in InfoLoggerClient::reconnect() () from /persist/sw/slc7_x86-64/libInfoLogger/v2.1.0-local1/lib/libO2Infologger.so [19793:internal-dpl-aod-spawner]: #3 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x175c310) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #4 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #5 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 2 (Thread 0x7fd37d8d6700 (LWP 19799) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd37edd08ed in nanosleep () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #1 0x00007fd37ee011c4 in usleep () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #2 0x00007fd385d5c493 in InfoLoggerClient::reconnect() () from /persist/sw/slc7_x86-64/libInfoLogger/v2.1.0-local1/lib/libO2Infologger.so [19793:internal-dpl-aod-spawner]: #3 0x00007fd37f4ccf10 in std::execute_native_thread_routine (__p=0x1731ff0) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:80 [19793:internal-dpl-aod-spawner]: #4 0x00007fd3853f2ea5 in start_thread () from /lib64/libpthread.so.0 [19793:internal-dpl-aod-spawner]: #5 0x00007fd37ee099fd in clone () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: Thread 1 (Thread 0x7fd37e136e80 (LWP 19793) "o2-analysistuto"): [19793:internal-dpl-aod-spawner]: #0 0x00007fd37edd0549 in waitpid () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #1 0x00007fd37ed4df62 in do_system () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #2 0x00007fd37ed4e311 in system () from /lib64/libc.so.6 [19793:internal-dpl-aod-spawner]: #3 0x00007fd37f8a5dbc in TUnixSystem::Exec (shellcmd=, this=0x153f570) at /persist/sw/SOURCES/ROOT/v6-20-08-alice1/v6-20-08-alice1/core/unix/src/TUnixSystem.cxx:2107 [19793:internal-dpl-aod-spawner]: #4 TUnixSystem::StackTrace (this=0x153f570) at /persist/sw/SOURCES/ROOT/v6-20-08-alice1/v6-20-08-alice1/core/unix/src/TUnixSystem.cxx:2397 [19793:internal-dpl-aod-spawner]: #5 0x00007fd37f8a32ec in TUnixSystem::DispatchSignals (this=0x153f570, sig=kSigIllegalInstruction) at /persist/sw/SOURCES/ROOT/v6-20-08-alice1/v6-20-08-alice1/core/unix/src/TUnixSystem.cxx:3628 [19793:internal-dpl-aod-spawner]: #6 [19793:internal-dpl-aod-spawner]: #7 0x00007fd385e8f169 in expr_0_0 () [19793:internal-dpl-aod-spawner]: #8 0x00007fd3802418ae in gandiva::LLVMGenerator::Execute(arrow::RecordBatch const&, gandiva::SelectionVector const*, std::vector, std::allocator > > const&) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #9 0x00007fd38025667b in gandiva::Projector::Evaluate(arrow::RecordBatch const&, gandiva::SelectionVector const*, arrow::MemoryPool*, std::vector, std::allocator > >*) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #10 0x00007fd380256b92 in gandiva::Projector::Evaluate(arrow::RecordBatch const&, arrow::MemoryPool*, std::vector, std::allocator > >*) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #11 0x00007fd38578d694 in o2::framework::spawner (columns=..., name=, atable=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/shared_ptr_base.h:1324 [19793:internal-dpl-aod-spawner]: #12 operator() (metadata=..., __closure=) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/AODReaderHelpers.cxx:170 [19793:internal-dpl-aod-spawner]: #13 operator() (__closure=, pc=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/AODReaderHelpers.cxx:174 [19793:internal-dpl-aod-spawner]: #14 0x00007fd38581adfd in std::function::operator()(o2::framework::ProcessingContext&) const (__args#0=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:248 [19793:internal-dpl-aod-spawner]: #15 o2::framework::DataProcessingDevice::tryDispatchComputation (context=..., completed=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:1160 [19793:internal-dpl-aod-spawner]: #16 0x00007fd38581b719 in o2::framework::DataProcessingDevice::doRun (context=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:692 [19793:internal-dpl-aod-spawner]: #17 0x00007fd38581baa9 in o2::framework::run_callback (handle=handle [19793:internal-dpl-aod-spawner]: entry=0x1732120) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:139 [19793:internal-dpl-aod-spawner]: #18 0x00007fd38581be99 in o2::framework::DataProcessingDevice::ConditionalRun (this=0x175d770) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:587 [19793:internal-dpl-aod-spawner]: #19 0x00007fd3845b0f55 in FairMQDevice::RunWrapper (this=0x175d770) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/FairMQDevice.cxx:473 [19793:internal-dpl-aod-spawner]: #20 0x00007fd38402d06d in std::function::operator()(fair::mq::State) const (__args#0=, this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:622 [19793:internal-dpl-aod-spawner]: #21 boost::detail::function::void_function_obj_invoker1, void, fair::mq::State>::invoke(boost::detail::function::function_buffer&, fair::mq::State) (function_obj_ptr=..., a0=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/function/function_template.hpp:158 [19793:internal-dpl-aod-spawner]: #22 0x00007fd384035f59 in boost::function1::operator() (a0=, this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/function/function_template.hpp:763 [19793:internal-dpl-aod-spawner]: #23 boost::signals2::detail::call_with_tuple_args::m_invoke, 0u, fair::mq::State&>(boost::function&, boost::signals2::detail::unsigned_meta_array<0u>, std::tuple const&, boost::enable_if::result_type>, void>::type*) const (args=..., func=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:105 [19793:internal-dpl-aod-spawner]: #24 boost::signals2::detail::call_with_tuple_args::operator(), fair::mq::State&, 1ul>(boost::function&, std::tuple const&, mpl_::size_t<1ul>) const (args=..., func=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:90 [19793:internal-dpl-aod-spawner]: #25 boost::signals2::detail::variadic_slot_invoker::operator() >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::shared_ptr >, boost::signals2::slot >, boost::signals2::mutex> > const&) const (connectionBody=..., this=0x7ffdfcd38ce0) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:133 [19793:internal-dpl-aod-spawner]: #26 boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >::dereference() const (this=0x7ffdfcd38b10) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/slot_call_iterator.hpp:110 [19793:internal-dpl-aod-spawner]: #27 boost::iterators::iterator_core_access::dereference, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > const&) (f=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/iterator/iterator_facade.hpp:550 [19793:internal-dpl-aod-spawner]: #28 boost::iterators::detail::iterator_facade_base, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::void_type, boost::iterators::single_pass_traversal_tag, boost::signals2::detail::void_type const&, long, false, false>::operator*() const (this=0x7ffdfcd38b10) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/iterator/iterator_facade.hpp:656 [19793:internal-dpl-aod-spawner]: #29 boost::signals2::optional_last_value::operator(), std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (last=..., this=, last=..., first=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/optional_last_value.hpp:57 [19793:internal-dpl-aod-spawner]: #30 boost::signals2::detail::combiner_invoker::operator(), boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::optional_last_value&, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (last=..., first=..., combiner=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/result_type_wrapper.hpp:64 [19793:internal-dpl-aod-spawner]: #31 boost::signals2::detail::signal_impl, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) (this=, args#0=, args#0 [19793:internal-dpl-aod-spawner]: entry=fair::mq::State::Running) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/signal_template.hpp:243 [19793:internal-dpl-aod-spawner]: #32 0x00007fd3840365e0 in boost::signals2::signal, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) const (args#0=fair::mq::State::Running, this=0x175a950) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/smart_ptr/shared_ptr.hpp:720 [19793:internal-dpl-aod-spawner]: #33 fair::mq::fsm::Machine_::CallStateHandler (state=fair::mq::State::Running, this=0x175a8c0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:157 [19793:internal-dpl-aod-spawner]: #34 fair::mq::fsm::Machine_::ProcessWork (this=this [19793:internal-dpl-aod-spawner]: entry=0x175a8c0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:205 [19793:internal-dpl-aod-spawner]: #35 0x00007fd38402b939 in fair::mq::StateMachine::ProcessWork (this=0x175d830) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:373 [19793:internal-dpl-aod-spawner]: #36 0x00007fd384580967 in FairMQDevice::RunStateMachine (this=) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/FairMQDevice.h:364 [19793:internal-dpl-aod-spawner]: #37 fair::mq::DeviceRunner::Run (this=this [19793:internal-dpl-aod-spawner]: entry=0x7ffdfcd3a3f0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/DeviceRunner.cxx:184 [19793:internal-dpl-aod-spawner]: #38 0x00007fd3859357e7 in doChild (argc=-53238896, argv=0x7ffdfcd3a788, serviceRegistry=..., runningWorkflow=..., ref=..., errorPolicy=, defaultDriverClient=..., loop=) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:1065 [19793:internal-dpl-aod-spawner]: #39 0x00007fd385936716 in runStateMachine (workflow=..., workflowInfo=..., previousDataProcessorInfos=..., commandInfo=..., driverControl=..., driverInfo=..., metricsInfos=..., varmap=..., frameworkId=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:1438 [19793:internal-dpl-aod-spawner]: #40 0x00007fd38593def8 in doMain (argc=argc [19793:internal-dpl-aod-spawner]: entry=69, argv=argv [19793:internal-dpl-aod-spawner]: entry=0x7ffdfcd3eaa8, workflow=..., channelPolicies=..., completionPolicies=..., dispatchPolicies=..., resourcePolicies=..., currentWorkflowOptions=..., configContext=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:2332 [19793:internal-dpl-aod-spawner]: #41 0x0000000000423189 in main (argc=69, argv=0x7ffdfcd3eaa8) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/include/Framework/runDataProcessing.h:186 [19793:internal-dpl-aod-spawner]: =========================================================== [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: The lines below might hint at the cause of the crash. [19793:internal-dpl-aod-spawner]: You may get help by asking at the ROOT forum http://root.cern.ch/forum [19793:internal-dpl-aod-spawner]: Only if you are really convinced it is a bug in ROOT then please submit a [19793:internal-dpl-aod-spawner]: report at http://root.cern.ch/bugs Please post the ENTIRE stack trace [19793:internal-dpl-aod-spawner]: from above as an attachment in addition to anything else [19793:internal-dpl-aod-spawner]: that might help us fixing this issue. [19793:internal-dpl-aod-spawner]: =========================================================== [19793:internal-dpl-aod-spawner]: #7 0x00007fd385e8f169 in expr_0_0 () [19793:internal-dpl-aod-spawner]: #8 0x00007fd3802418ae in gandiva::LLVMGenerator::Execute(arrow::RecordBatch const&, gandiva::SelectionVector const*, std::vector, std::allocator > > const&) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #9 0x00007fd38025667b in gandiva::Projector::Evaluate(arrow::RecordBatch const&, gandiva::SelectionVector const*, arrow::MemoryPool*, std::vector, std::allocator > >*) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #10 0x00007fd380256b92 in gandiva::Projector::Evaluate(arrow::RecordBatch const&, arrow::MemoryPool*, std::vector, std::allocator > >*) () from /persist/sw/slc7_x86-64/arrow/v1.0.0-local1/lib/libgandiva.so.100 [19793:internal-dpl-aod-spawner]: #11 0x00007fd38578d694 in o2::framework::spawner (columns=..., name=, atable=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/shared_ptr_base.h:1324 [19793:internal-dpl-aod-spawner]: #12 operator() (metadata=..., __closure=) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/AODReaderHelpers.cxx:170 [19793:internal-dpl-aod-spawner]: #13 operator() (__closure=, pc=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/AODReaderHelpers.cxx:174 [19793:internal-dpl-aod-spawner]: #14 0x00007fd38581adfd in std::function::operator()(o2::framework::ProcessingContext&) const (__args#0=..., this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:248 [19793:internal-dpl-aod-spawner]: #15 o2::framework::DataProcessingDevice::tryDispatchComputation (context=..., completed=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:1160 [19793:internal-dpl-aod-spawner]: #16 0x00007fd38581b719 in o2::framework::DataProcessingDevice::doRun (context=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:692 [19793:internal-dpl-aod-spawner]: #17 0x00007fd38581baa9 in o2::framework::run_callback (handle=handle [19793:internal-dpl-aod-spawner]: entry=0x1732120) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:139 [19793:internal-dpl-aod-spawner]: #18 0x00007fd38581be99 in o2::framework::DataProcessingDevice::ConditionalRun (this=0x175d770) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/DataProcessingDevice.cxx:587 [19793:internal-dpl-aod-spawner]: #19 0x00007fd3845b0f55 in FairMQDevice::RunWrapper (this=0x175d770) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/FairMQDevice.cxx:473 [19793:internal-dpl-aod-spawner]: #20 0x00007fd38402d06d in std::function::operator()(fair::mq::State) const (__args#0=, this=) at /persist/sw/slc7_x86-64/GCC-Toolchain/v10.2.0-alice2-local1/include/c++/10.2.0/bits/std_function.h:622 [19793:internal-dpl-aod-spawner]: #21 boost::detail::function::void_function_obj_invoker1, void, fair::mq::State>::invoke(boost::detail::function::function_buffer&, fair::mq::State) (function_obj_ptr=..., a0=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/function/function_template.hpp:158 [19793:internal-dpl-aod-spawner]: #22 0x00007fd384035f59 in boost::function1::operator() (a0=, this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/function/function_template.hpp:763 [19793:internal-dpl-aod-spawner]: #23 boost::signals2::detail::call_with_tuple_args::m_invoke, 0u, fair::mq::State&>(boost::function&, boost::signals2::detail::unsigned_meta_array<0u>, std::tuple const&, boost::enable_if::result_type>, void>::type*) const (args=..., func=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:105 [19793:internal-dpl-aod-spawner]: #24 boost::signals2::detail::call_with_tuple_args::operator(), fair::mq::State&, 1ul>(boost::function&, std::tuple const&, mpl_::size_t<1ul>) const (args=..., func=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:90 [19793:internal-dpl-aod-spawner]: #25 boost::signals2::detail::variadic_slot_invoker::operator() >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::shared_ptr >, boost::signals2::slot >, boost::signals2::mutex> > const&) const (connectionBody=..., this=0x7ffdfcd38ce0) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/variadic_slot_invoker.hpp:133 [19793:internal-dpl-aod-spawner]: #26 boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >::dereference() const (this=0x7ffdfcd38b10) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/slot_call_iterator.hpp:110 [19793:internal-dpl-aod-spawner]: #27 boost::iterators::iterator_core_access::dereference, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > const&) (f=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/iterator/iterator_facade.hpp:550 [19793:internal-dpl-aod-spawner]: #28 boost::iterators::detail::iterator_facade_base, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::void_type, boost::iterators::single_pass_traversal_tag, boost::signals2::detail::void_type const&, long, false, false>::operator*() const (this=0x7ffdfcd38b10) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/iterator/iterator_facade.hpp:656 [19793:internal-dpl-aod-spawner]: #29 boost::signals2::optional_last_value::operator(), std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (last=..., this=, last=..., first=...) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/optional_last_value.hpp:57 [19793:internal-dpl-aod-spawner]: #30 boost::signals2::detail::combiner_invoker::operator(), boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::optional_last_value&, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (last=..., first=..., combiner=..., this=) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/result_type_wrapper.hpp:64 [19793:internal-dpl-aod-spawner]: #31 boost::signals2::detail::signal_impl, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) (this=, args#0=, args#0 [19793:internal-dpl-aod-spawner]: entry=fair::mq::State::Running) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/signals2/detail/signal_template.hpp:243 [19793:internal-dpl-aod-spawner]: #32 0x00007fd3840365e0 in boost::signals2::signal, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) const (args#0=fair::mq::State::Running, this=0x175a950) at /persist/sw/slc7_x86-64/boost/v1.75.0-local2/include/boost/smart_ptr/shared_ptr.hpp:720 [19793:internal-dpl-aod-spawner]: #33 fair::mq::fsm::Machine_::CallStateHandler (state=fair::mq::State::Running, this=0x175a8c0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:157 [19793:internal-dpl-aod-spawner]: #34 fair::mq::fsm::Machine_::ProcessWork (this=this [19793:internal-dpl-aod-spawner]: entry=0x175a8c0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:205 [19793:internal-dpl-aod-spawner]: #35 0x00007fd38402b939 in fair::mq::StateMachine::ProcessWork (this=0x175d830) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/StateMachine.cxx:373 [19793:internal-dpl-aod-spawner]: #36 0x00007fd384580967 in FairMQDevice::RunStateMachine (this=) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/FairMQDevice.h:364 [19793:internal-dpl-aod-spawner]: #37 fair::mq::DeviceRunner::Run (this=this [19793:internal-dpl-aod-spawner]: entry=0x7ffdfcd3a3f0) at /persist/sw/SOURCES/FairMQ/v1.4.38/v1.4.38/fairmq/DeviceRunner.cxx:184 [19793:internal-dpl-aod-spawner]: #38 0x00007fd3859357e7 in doChild (argc=-53238896, argv=0x7ffdfcd3a788, serviceRegistry=..., runningWorkflow=..., ref=..., errorPolicy=, defaultDriverClient=..., loop=) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:1065 [19793:internal-dpl-aod-spawner]: #39 0x00007fd385936716 in runStateMachine (workflow=..., workflowInfo=..., previousDataProcessorInfos=..., commandInfo=..., driverControl=..., driverInfo=..., metricsInfos=..., varmap=..., frameworkId=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:1438 [19793:internal-dpl-aod-spawner]: #40 0x00007fd38593def8 in doMain (argc=argc [19793:internal-dpl-aod-spawner]: entry=69, argv=argv [19793:internal-dpl-aod-spawner]: entry=0x7ffdfcd3eaa8, workflow=..., channelPolicies=..., completionPolicies=..., dispatchPolicies=..., resourcePolicies=..., currentWorkflowOptions=..., configContext=...) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/src/runDataProcessing.cxx:2332 [19793:internal-dpl-aod-spawner]: #41 0x0000000000423189 in main (argc=69, argv=0x7ffdfcd3eaa8) at /persist/sw/SOURCES/O2/dev/0/Framework/Core/include/Framework/runDataProcessing.h:186 [19793:internal-dpl-aod-spawner]: =========================================================== [19793:internal-dpl-aod-spawner]: [19793:internal-dpl-aod-spawner]: [INFO] QUIT_REQUESTED [19796:single-tracks]: [06:57:52][INFO] Received device shutdown request (signal 15). [19796:single-tracks]: [06:57:52][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [19792:internal-dpl-aod-reader]: [06:57:52][INFO] Received device shutdown request (signal 15). [19792:internal-dpl-aod-reader]: [06:57:52][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [19796:single-tracks]: [06:57:52][STATE] RUNNING ---> READY [19796:single-tracks]: [06:57:52][STATE] READY ---> RESETTING TASK [19796:single-tracks]: [06:57:52][STATE] RESETTING TASK ---> DEVICE READY [19796:single-tracks]: [06:57:52][STATE] DEVICE READY ---> RESETTING DEVICE [19796:single-tracks]: [06:57:52][STATE] RESETTING DEVICE ---> IDLE [19792:internal-dpl-aod-reader]: [06:57:52][STATE] RUNNING ---> READY [19796:single-tracks]: [06:57:52][STATE] IDLE ---> EXITING [19792:internal-dpl-aod-reader]: [06:57:52][STATE] READY ---> RESETTING TASK [19792:internal-dpl-aod-reader]: [06:57:52][STATE] RESETTING TASK ---> DEVICE READY [19792:internal-dpl-aod-reader]: [06:57:52][STATE] DEVICE READY ---> RESETTING DEVICE [19796:single-tracks]: [06:57:52][STATE] Exiting FairMQ state machine [19792:internal-dpl-aod-reader]: [06:57:53][STATE] RESETTING DEVICE ---> IDLE [19792:internal-dpl-aod-reader]: [06:57:53][STATE] IDLE ---> EXITING [19792:internal-dpl-aod-reader]: [06:57:53][STATE] Exiting FairMQ state machine [19791:internal-dpl-clock]: [06:57:53][INFO] Received device shutdown request (signal 15). [19791:internal-dpl-clock]: [06:57:53][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [19791:internal-dpl-clock]: [06:57:53][STATE] RUNNING ---> READY [19791:internal-dpl-clock]: [06:57:53][STATE] READY ---> RESETTING TASK [19791:internal-dpl-clock]: [06:57:53][STATE] RESETTING TASK ---> DEVICE READY [19791:internal-dpl-clock]: [06:57:53][STATE] DEVICE READY ---> RESETTING DEVICE [19791:internal-dpl-clock]: [06:57:53][STATE] RESETTING DEVICE ---> IDLE [19791:internal-dpl-clock]: [06:57:53][STATE] IDLE ---> EXITING [19791:internal-dpl-clock]: [06:57:53][STATE] Exiting FairMQ state machine [19794:all-tracks]: [06:57:53][INFO] Received device shutdown request (signal 15). [19794:all-tracks]: [06:57:53][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [19795:internal-dpl-injected-dummy-sink]: [06:57:53][INFO] Received device shutdown request (signal 15). [19795:internal-dpl-injected-dummy-sink]: [06:57:53][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] RUNNING ---> READY [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] READY ---> RESETTING TASK [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] RESETTING TASK ---> DEVICE READY [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] DEVICE READY ---> RESETTING DEVICE [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] RESETTING DEVICE ---> IDLE [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] IDLE ---> EXITING [19795:internal-dpl-injected-dummy-sink]: [06:57:53][STATE] Exiting FairMQ state machine [19794:all-tracks]: [06:57:53][STATE] RUNNING ---> READY [19794:all-tracks]: [06:57:53][STATE] READY ---> RESETTING TASK [19794:all-tracks]: [06:57:53][STATE] RESETTING TASK ---> DEVICE READY [19794:all-tracks]: [06:57:53][STATE] DEVICE READY ---> RESETTING DEVICE [19794:all-tracks]: [06:57:53][STATE] RESETTING DEVICE ---> IDLE [19794:all-tracks]: [06:57:53][STATE] IDLE ---> EXITING [19794:all-tracks]: [06:57:53][STATE] Exiting FairMQ state machine [INFO] Dumping used configuration in dpl-config.json [O2/latest] ~ $>