(...) [5041:etaphi-histogram]: [07:52:02][STATE] IDLE ---> INITIALIZING DEVICE [5041:etaphi-histogram]: 2020-07-27 07:52:02 Buffering enabled (100) [5041:etaphi-histogram]: [07:52:02][STATE] INITIALIZING DEVICE ---> INITIALIZED [5041:etaphi-histogram]: [07:52:02][STATE] INITIALIZED ---> BINDING [5041:etaphi-histogram]: [07:52:02][STATE] BINDING ---> BOUND [5041:etaphi-histogram]: [07:52:02][STATE] BOUND ---> CONNECTING [5041:etaphi-histogram]: [07:52:02][STATE] CONNECTING ---> DEVICE READY [5041:etaphi-histogram]: [07:52:02][STATE] DEVICE READY ---> INITIALIZING TASK [5041:etaphi-histogram]: [07:52:02][STATE] INITIALIZING TASK ---> READY [5041:etaphi-histogram]: [07:52:02][STATE] READY ---> RUNNING [5041:etaphi-histogram]: [07:52:02][INFO] DEVICE: Running... [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: *** Break *** bus error [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: =========================================================== [5037:internal-dpl-aod-reader]: There was a crash. [5037:internal-dpl-aod-reader]: This is the entire stack trace of all threads: [5037:internal-dpl-aod-reader]: =========================================================== [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 8 (Thread 0x7f69e084a700 (LWP 5102)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6dc53d12 in pthread_cond_timedwait [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #1 0x00007f6a6a3fa14e in __gthread_cond_timedwait (__abs_timeout=0x7f69e0843c60, __mutex=, __cond=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:871 [5037:internal-dpl-aod-reader]: #2 std::condition_variable::__wait_until_impl > > (__atime=..., __lock=..., this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:166 [5037:internal-dpl-aod-reader]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:106 [5037:internal-dpl-aod-reader]: #4 std::condition_variable::wait_until >, fair::mq::StateMachine::WaitForPendingStateFor(int) const:: > (__p=..., __atime=..., __lock=..., this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:129 [5037:internal-dpl-aod-reader]: #5 std::condition_variable::wait_for, fair::mq::StateMachine::WaitForPendingStateFor(int) const:: > (__p=..., __rtime=..., __lock=..., this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:145 [5037:internal-dpl-aod-reader]: #6 fair::mq::StateMachine::WaitForPendingStateFor (this=this [5037:internal-dpl-aod-reader]: entry=0xccb350, durationInMs=durationInMs [5037:internal-dpl-aod-reader]: entry=1000) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:366 [5037:internal-dpl-aod-reader]: #7 0x00007f6a6b34a695 in FairMQDevice::WaitFor > (duration=..., this=0xccb290) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.h:411 [5037:internal-dpl-aod-reader]: #8 FairMQDevice::LogSocketRates (this=0xccb290) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.cxx:816 [5037:internal-dpl-aod-reader]: #9 0x00007f6a6b34b99d in std::__invoke_impl (__t=, __f=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/invoke.h:73 [5037:internal-dpl-aod-reader]: #10 std::__invoke (__fn=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/invoke.h:95 [5037:internal-dpl-aod-reader]: #11 std::thread::_Invoker >::_M_invoke<0ul, 1ul> (this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:234 [5037:internal-dpl-aod-reader]: #12 std::thread::_Invoker >::operator() (this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:243 [5037:internal-dpl-aod-reader]: #13 std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void>::operator() (this=0x7f69e08446b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/future:1362 [5037:internal-dpl-aod-reader]: #14 std::_Function_handler (), std::__future_base::_Task_setter, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker >, void> >::_M_invoke(std::_Any_data const&) (__functor=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:302 [5037:internal-dpl-aod-reader]: #15 0x00007f6a6b34bdbb in std::function ()>::operator()() const (this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:706 [5037:internal-dpl-aod-reader]: #16 std::__future_base::_State_baseV2::_M_do_set(std::function ()>*, bool*) (this=0xcf15e0, __f=, __did_set=0x7f69e0844657) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/future:561 [5037:internal-dpl-aod-reader]: #17 0x00007f6a6dc54e40 in pthread_once () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #18 0x00007f6a6b34de48 in __gthread_once (__func=, __once=0xcf15f8) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:699 [5037:internal-dpl-aod-reader]: #19 std::call_once ()>*, bool*), std::__future_base::_State_baseV2*, std::function ()>*, bool*>(std::once_flag&, void (std::__future_base::_State_baseV2::*&&)(std::function ()>*, bool*), std::__future_base::_State_baseV2*&&, std::function ()>*&&, bool*&&) (__f= [5037:internal-dpl-aod-reader]: 0x7f69e0844680: (void (std::__future_base::_State_baseV2::*)(std::__future_base::_State_baseV2 * const, std::function()> *, bool *)) 0x7f6a6b34bda0 ()>*, bool*)>, __once=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/mutex:684 [5037:internal-dpl-aod-reader]: #20 std::__future_base::_State_baseV2::_M_set_result(std::function ()>, bool) (__ignore_failure=false, __res=..., this=0xcf15e0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/future:401 [5037:internal-dpl-aod-reader]: #21 std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}::operator()() const (__closure=0xccd238) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/future:1667 [5037:internal-dpl-aod-reader]: #22 std::__invoke_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}>(std::__invoke_other, std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}&&) (__f=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/invoke.h:60 [5037:internal-dpl-aod-reader]: #23 std::__invoke >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}>(std::__invoke_result&&, (std::__future_base::_Async_state_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}&&)...) (__fn=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/invoke.h:95 [5037:internal-dpl-aod-reader]: #24 std::thread::_Invoker >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> >::_M_invoke<0ul>(std::_Index_tuple<0ul>) (this=0xccd238) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:234 [5037:internal-dpl-aod-reader]: #25 std::thread::_Invoker >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> >::operator()() (this=0xccd238) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:243 [5037:internal-dpl-aod-reader]: #26 std::thread::_State_impl >, void>::_Async_state_impl(std::thread::_Invoker >&&)::{lambda()#1}> > >::_M_run() (this=0xccd230) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:186 [5037:internal-dpl-aod-reader]: #27 0x00007f6a62db8f3f in std::execute_native_thread_routine (__p=0xccd230) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:83 [5037:internal-dpl-aod-reader]: #28 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #29 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 7 (Thread 0x7f69e104b700 (LWP 5101)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6dc53965 in pthread_cond_wait [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #1 0x00007f6a6b364dff in boost::interprocess::ipcdetail::posix_condition::do_wait (mut=..., this=0x7f6a6f1dd038) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/posix/condition.hpp:174 [5037:internal-dpl-aod-reader]: #2 boost::interprocess::ipcdetail::posix_condition::wait > > (lock=..., this=0x7f6a6f1dd038) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/posix/condition.hpp:67 [5037:internal-dpl-aod-reader]: #3 boost::interprocess::interprocess_condition::wait > (lock=..., this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/interprocess_condition.hpp:107 [5037:internal-dpl-aod-reader]: #4 boost::interprocess::ipcdetail::condition_any_algorithm::do_wait > > (data=..., lock=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:126 [5037:internal-dpl-aod-reader]: #5 0x00007f6a6b37daf7 in boost::interprocess::ipcdetail::condition_any_algorithm::wait > > (abs_time=..., tout_enabled=false, lock=..., data=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:108 [5037:internal-dpl-aod-reader]: #6 boost::interprocess::ipcdetail::condition_any_wrapper::wait > > (lock=..., this=0x7f6a6f1dd010) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/detail/condition_any_algorithm.hpp:184 [5037:internal-dpl-aod-reader]: #7 boost::interprocess::ipcdetail::shm_named_condition::wait > > (lock=..., this=0xcee610) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/shm/named_condition.hpp:212 [5037:internal-dpl-aod-reader]: #8 boost::interprocess::named_condition::wait > (lock=..., this=0xcee610) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/interprocess/sync/named_condition.hpp:163 [5037:internal-dpl-aod-reader]: #9 fair::mq::shmem::Manager::RegionEventsSubscription (this=0xcee570) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/Manager.h:379 [5037:internal-dpl-aod-reader]: #10 0x00007f6a62db8f3f in std::execute_native_thread_routine (__p=0xcc9e20) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:83 [5037:internal-dpl-aod-reader]: #11 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #12 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 6 (Thread 0x7f69e184c700 (LWP 5097)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6250f483 in epoll_wait () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #1 0x00007f6a5e036b0c in zmq::epoll_t::loop() () from /home/alidock/.sw/slc7_x86-64/ZeroMQ/v4.3.2-10/lib/libzmq.so.5 [5037:internal-dpl-aod-reader]: #2 0x00007f6a5e06e0b8 in thread_routine () from /home/alidock/.sw/slc7_x86-64/ZeroMQ/v4.3.2-10/lib/libzmq.so.5 [5037:internal-dpl-aod-reader]: #3 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #4 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 5 (Thread 0x7f69e204d700 (LWP 5096)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6250f483 in epoll_wait () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #1 0x00007f6a5e036b0c in zmq::epoll_t::loop() () from /home/alidock/.sw/slc7_x86-64/ZeroMQ/v4.3.2-10/lib/libzmq.so.5 [5037:internal-dpl-aod-reader]: #2 0x00007f6a5e06e0b8 in thread_routine () from /home/alidock/.sw/slc7_x86-64/ZeroMQ/v4.3.2-10/lib/libzmq.so.5 [5037:internal-dpl-aod-reader]: #3 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #4 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 4 (Thread 0x7f69e284e700 (LWP 5095)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6dc53d12 in pthread_cond_timedwait [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #1 0x00007f6a6b362e41 in __gthread_cond_timedwait (__abs_timeout=0x7f69e2848660, __mutex=, __cond=0xcee720) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:871 [5037:internal-dpl-aod-reader]: #2 std::condition_variable::__wait_until_impl > > (__atime=..., __lock=..., this=0xcee720) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:166 [5037:internal-dpl-aod-reader]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=0xcee720) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:106 [5037:internal-dpl-aod-reader]: #4 std::condition_variable::wait_until >, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}>(std::unique_lock&, std::chrono::time_point > > const&, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}) (__p=..., __atime=..., __lock=..., this=0xcee720) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:129 [5037:internal-dpl-aod-reader]: #5 std::condition_variable::wait_for, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}>(std::unique_lock&, std::chrono::duration > const&, fair::mq::shmem::Manager::SendHeartbeats()::{lambda()#2}) (__p=..., __rtime=..., __lock=..., this=0xcee720) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:145 [5037:internal-dpl-aod-reader]: #6 fair::mq::shmem::Manager::SendHeartbeats (this=0xcee570) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/Manager.h:400 [5037:internal-dpl-aod-reader]: #7 0x00007f6a62db8f3f in std::execute_native_thread_routine (__p=0xcf4780) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:83 [5037:internal-dpl-aod-reader]: #8 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #9 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 3 (Thread 0x7f6a5a3a9700 (LWP 5094)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6dc56e3d in nanosleep () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #1 0x00007f6a6b41456f in std::this_thread::sleep_for > (__rtime=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/thread:376 [5037:internal-dpl-aod-reader]: #2 fair::mq::plugins::Control::SignalHandler (this=0xccb840) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/plugins/Control.cxx:396 [5037:internal-dpl-aod-reader]: #3 0x00007f6a62db8f3f in std::execute_native_thread_routine (__p=0xcca020) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:83 [5037:internal-dpl-aod-reader]: #4 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #5 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 2 (Thread 0x7f6a5abaa700 (LWP 5093)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a6dc53d12 in pthread_cond_timedwait [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: GLIBC_2.3.2 () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #1 0x00007f6a6b41205f in __gthread_cond_timedwait (__abs_timeout=0x7f6a5aba46b0, __mutex=, __cond=0xccb978) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/x86_64-unknown-linux-gnu/bits/gthr-default.h:871 [5037:internal-dpl-aod-reader]: #2 std::condition_variable::__wait_until_impl > > (__atime=..., __lock=..., this=0xccb978) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:166 [5037:internal-dpl-aod-reader]: #3 std::condition_variable::wait_until > > (__atime=..., __lock=..., this=0xccb978) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:106 [5037:internal-dpl-aod-reader]: #4 std::condition_variable::wait_for > (__rtime=..., __lock=..., this=0xccb978) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/condition_variable:138 [5037:internal-dpl-aod-reader]: #5 fair::mq::StateQueue::WaitForNext > (duration=..., this=0xccb900) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateQueue.h:52 [5037:internal-dpl-aod-reader]: #6 fair::mq::plugins::Control::StaticMode (this=0xccb840) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/plugins/Control.cxx:381 [5037:internal-dpl-aod-reader]: #7 0x00007f6a62db8f3f in std::execute_native_thread_routine (__p=0xcc9ca0) at ../../../../../gcc/libstdc++-v3/src/c++11/thread.cc:83 [5037:internal-dpl-aod-reader]: #8 0x00007f6a6dc4fdd5 in start_thread () from /lib64/libpthread.so.0 [5037:internal-dpl-aod-reader]: #9 0x00007f6a6250eead in clone () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: Thread 1 (Thread 0x7f6a6f19df40 (LWP 5037)): [5037:internal-dpl-aod-reader]: #0 0x00007f6a624d5a89 in waitpid () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #1 0x00007f6a62453de2 in do_system () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #2 0x00007f6a62454191 in system () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #3 0x00007f6a63341fe0 in TUnixSystem::Exec (shellcmd=, this=0xb0b6f0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/ROOT/v6-20-02-alice7/v6-20-02-alice7/core/unix/src/TUnixSystem.cxx:2107 [5037:internal-dpl-aod-reader]: #4 TUnixSystem::StackTrace (this=0xb0b6f0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/ROOT/v6-20-02-alice7/v6-20-02-alice7/core/unix/src/TUnixSystem.cxx:2397 [5037:internal-dpl-aod-reader]: #5 0x00007f6a63344674 in TUnixSystem::DispatchSignals (this=0xb0b6f0, sig=kSigBus) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/ROOT/v6-20-02-alice7/v6-20-02-alice7/core/unix/src/TUnixSystem.cxx:3628 [5037:internal-dpl-aod-reader]: #6 [5037:internal-dpl-aod-reader]: #7 0x00007f6a6255f5ef in __memcpy_ssse3 () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #8 0x00007f6a6b36f64f in fair::mq::shmem::Message::Message (factory=0xcf46d0, hint=0x2fdc990, ffn=0x7f6a6ec4b7d0 >, std::allocator > > >&)::{lambda(void*, void*)#1}::_FUN(void*, void*)>, size=298153032, data=0x7f6971a85038, manager=..., this=0x2c55240) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/Message.h:94 [5037:internal-dpl-aod-reader]: #9 fair::mq::tools::make_unique () at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/tools/CppSTL.h:27 [5037:internal-dpl-aod-reader]: #10 fair::mq::shmem::TransportFactory::CreateMessage (this=0xcf46d0, data=0x7f6971a85038, size=298153032, ffn=0x7f6a6ec4b7d0 >, std::allocator > > >&)::{lambda(void*, void*)#1}::_FUN(void*, void*)>, hint=0x2fdc990) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/TransportFactory.h:114 [5037:internal-dpl-aod-reader]: #11 0x00007f6a6ec4fb6a in FairMQChannel::NewMessage >, std::allocator > > >&)::{lambda(void*, void*)#1}, FairMQMessage*>(void*&&, unsigned long&&, FairMQChannel::CheckSendCompatibility(std::vector >, std::allocator > > >&)::{lambda(void*, void*)#1}&&, FairMQMessage*&&) (this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:323 [5037:internal-dpl-aod-reader]: #12 FairMQChannel::CheckSendCompatibility (msgVec=..., this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:411 [5037:internal-dpl-aod-reader]: #13 FairMQChannel::Send (sndTimeoutInMs=-1, msgVec=..., this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:278 [5037:internal-dpl-aod-reader]: #14 FairMQDevice::Send (sndTimeoutInMs=-1, index=0, channel=..., parts=..., this=0xccb290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQDevice.h:157 [5037:internal-dpl-aod-reader]: #15 o2::framework::DataProcessor::doSend (device=..., context=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessor.cxx:94 [5037:internal-dpl-aod-reader]: #16 0x00007f6a6ec1b8e1 in o2::framework::(anonymous namespace)::CommonMessageBackendsHelpers::::operator() (__closure=, service=0xceb660, ctx=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/CommonMessageBackends.cxx:46 [5037:internal-dpl-aod-reader]: #17 std::_Function_handler::sendCallback() [with T = o2::framework::ArrowContext; o2::framework::ServiceProcessingCallback = std::function]:: >::_M_invoke(const std::_Any_data &, o2::framework::ProcessingContext &, void *&&) (__functor=..., __args#0=..., __args#1=) at /home/alidock/.sw/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:316 [5037:internal-dpl-aod-reader]: #18 0x00007f6a6ec4a8c3 in std::function::operator()(o2::framework::ProcessingContext&, void*) const (__args#1=, __args#0=..., this=0xceb8d8) at /home/alidock/.sw/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:706 [5037:internal-dpl-aod-reader]: #19 o2::framework::DataProcessingDevice::tryDispatchComputation (context=..., completed=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:977 [5037:internal-dpl-aod-reader]: #20 0x00007f6a6ec4b058 in o2::framework::DataProcessingDevice::doRun (context=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:527 [5037:internal-dpl-aod-reader]: #21 0x00007f6a6ec4b4ef in o2::framework::DataProcessingDevice::ConditionalRun (this=0xccb290) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:454 [5037:internal-dpl-aod-reader]: #22 0x00007f6a6b349355 in FairMQDevice::RunWrapper (this=0xccb290) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.cxx:512 [5037:internal-dpl-aod-reader]: #23 0x00007f6a6b349a79 in FairMQDevice::::operator() (state=, __closure=0xcce090) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.cxx:160 [5037:internal-dpl-aod-reader]: #24 std::_Function_handler >::_M_invoke(const std::_Any_data &, fair::mq::State &&) (__functor=..., __args#0=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:316 [5037:internal-dpl-aod-reader]: #25 0x00007f6a6a3ff40d in std::function::operator()(fair::mq::State) const (__args#0=, this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:706 [5037:internal-dpl-aod-reader]: #26 boost::detail::function::void_function_obj_invoker1, void, fair::mq::State>::invoke(boost::detail::function::function_buffer&, fair::mq::State) (function_obj_ptr=..., a0=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/function/function_template.hpp:158 [5037:internal-dpl-aod-reader]: #27 0x00007f6a6a407a83 in boost::function1::operator() (a0=, this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/function/function_template.hpp:763 [5037:internal-dpl-aod-reader]: #28 boost::signals2::detail::call_with_tuple_args::m_invoke, 0u, fair::mq::State&>(boost::function&, boost::signals2::detail::unsigned_meta_array<0u>, std::tuple const&, boost::enable_if::result_type>, void>::type*) const (this=, args=..., func=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:105 [5037:internal-dpl-aod-reader]: #29 boost::signals2::detail::call_with_tuple_args::operator(), fair::mq::State&, 1ul>(boost::function&, std::tuple const&, mpl_::size_t<1ul>) const (this=, args=..., func=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:90 [5037:internal-dpl-aod-reader]: #30 boost::signals2::detail::variadic_slot_invoker::operator() >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::shared_ptr >, boost::signals2::slot >, boost::signals2::mutex> > const&) const (connectionBody=..., this=0x7ffc0cb38170) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:133 [5037:internal-dpl-aod-reader]: #31 boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >::dereference() const (this=0x7ffc0cb37f80) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/slot_call_iterator.hpp:110 [5037:internal-dpl-aod-reader]: #32 boost::iterators::iterator_core_access::dereference, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > const&) (f=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/iterator/iterator_facade.hpp:550 [5037:internal-dpl-aod-reader]: #33 boost::iterators::detail::iterator_facade_base, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::void_type, boost::iterators::single_pass_traversal_tag, boost::signals2::detail::void_type const&, long, false, false>::operator*() const (this=0x7ffc0cb37f80) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/iterator/iterator_facade.hpp:656 [5037:internal-dpl-aod-reader]: #34 boost::signals2::optional_last_value::operator(), std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (this=, first=..., last=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/optional_last_value.hpp:57 [5037:internal-dpl-aod-reader]: #35 boost::signals2::detail::combiner_invoker::operator(), boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::optional_last_value&, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (this=, combiner=..., first=..., last=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/result_type_wrapper.hpp:64 [5037:internal-dpl-aod-reader]: #36 boost::signals2::detail::signal_impl, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) (this=0xcca310, args#0=, args#0 [5037:internal-dpl-aod-reader]: entry=fair::mq::State::Running) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/signal_template.hpp:243 [5037:internal-dpl-aod-reader]: #37 0x00007f6a6a40e5c4 in boost::signals2::signal, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) const (args#0=fair::mq::State::Running, this=0xccd440) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/signal_template.hpp:726 [5037:internal-dpl-aod-reader]: #38 fair::mq::fsm::Machine_::CallStateHandler (state=fair::mq::State::Running, this=0xccd3b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:158 [5037:internal-dpl-aod-reader]: #39 fair::mq::fsm::Machine_::ProcessWork (this=this [5037:internal-dpl-aod-reader]: entry=0xccd3b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:206 [5037:internal-dpl-aod-reader]: #40 0x00007f6a6a3fdc9e in fair::mq::StateMachine::ProcessWork (this=0xccb350) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:375 [5037:internal-dpl-aod-reader]: #41 0x00007f6a6b3150ad in FairMQDevice::RunStateMachine (this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.h:402 [5037:internal-dpl-aod-reader]: #42 fair::mq::DeviceRunner::Run (this=this [5037:internal-dpl-aod-reader]: entry=0x7ffc0cb391b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/DeviceRunner.cxx:174 [5037:internal-dpl-aod-reader]: #43 0x00007f6a6ed071a8 in doChild (argc=37, argv=0x7ffc0cb3c4b8, serviceRegistry=..., spec=..., errorPolicy=, loop=, loop [5037:internal-dpl-aod-reader]: entry=0xca3820) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:723 [5037:internal-dpl-aod-reader]: #44 0x00007f6a6ed08533 in runStateMachine (workflow=..., workflowInfo=..., previousDataProcessorInfos=..., driverControl=..., driverInfo=..., metricsInfos=..., varmap=..., frameworkId=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:961 [5037:internal-dpl-aod-reader]: #45 0x00007f6a6ed0eda0 in doMain (argc=argc [5037:internal-dpl-aod-reader]: entry=37, argv=argv [5037:internal-dpl-aod-reader]: entry=0x7ffc0cb3c4b8, workflow=..., channelPolicies=..., completionPolicies=..., dispatchPolicies=..., currentWorkflowOptions=..., configContext=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:1689 [5037:internal-dpl-aod-reader]: #46 0x000000000041b4ed in main (argc=37, argv=0x7ffc0cb3c4b8) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/include/Framework/runDataProcessing.h:160 [5037:internal-dpl-aod-reader]: =========================================================== [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: The lines below might hint at the cause of the crash. [5037:internal-dpl-aod-reader]: You may get help by asking at the ROOT forum http://root.cern.ch/forum [5037:internal-dpl-aod-reader]: Only if you are really convinced it is a bug in ROOT then please submit a [5037:internal-dpl-aod-reader]: report at http://root.cern.ch/bugs Please post the ENTIRE stack trace [5037:internal-dpl-aod-reader]: from above as an attachment in addition to anything else [5037:internal-dpl-aod-reader]: that might help us fixing this issue. [5037:internal-dpl-aod-reader]: =========================================================== [5037:internal-dpl-aod-reader]: #7 0x00007f6a6255f5ef in __memcpy_ssse3 () from /lib64/libc.so.6 [5037:internal-dpl-aod-reader]: #8 0x00007f6a6b36f64f in fair::mq::shmem::Message::Message (factory=0xcf46d0, hint=0x2fdc990, ffn=0x7f6a6ec4b7d0 >, std::allocator > > >&)::{lambda(void*, void*)#1}::_FUN(void*, void*)>, size=298153032, data=0x7f6971a85038, manager=..., this=0x2c55240) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/Message.h:94 [5037:internal-dpl-aod-reader]: #9 fair::mq::tools::make_unique () at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/tools/CppSTL.h:27 [5037:internal-dpl-aod-reader]: #10 fair::mq::shmem::TransportFactory::CreateMessage (this=0xcf46d0, data=0x7f6971a85038, size=298153032, ffn=0x7f6a6ec4b7d0 >, std::allocator > > >&)::{lambda(void*, void*)#1}::_FUN(void*, void*)>, hint=0x2fdc990) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/shmem/TransportFactory.h:114 [5037:internal-dpl-aod-reader]: #11 0x00007f6a6ec4fb6a in FairMQChannel::NewMessage >, std::allocator > > >&)::{lambda(void*, void*)#1}, FairMQMessage*>(void*&&, unsigned long&&, FairMQChannel::CheckSendCompatibility(std::vector >, std::allocator > > >&)::{lambda(void*, void*)#1}&&, FairMQMessage*&&) (this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:323 [5037:internal-dpl-aod-reader]: #12 FairMQChannel::CheckSendCompatibility (msgVec=..., this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:411 [5037:internal-dpl-aod-reader]: #13 FairMQChannel::Send (sndTimeoutInMs=-1, msgVec=..., this=0xcf2290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQChannel.h:278 [5037:internal-dpl-aod-reader]: #14 FairMQDevice::Send (sndTimeoutInMs=-1, index=0, channel=..., parts=..., this=0xccb290) at /home/alidock/.sw/slc7_x86-64/FairMQ/v1.4.21-6/include/fairmq/FairMQDevice.h:157 [5037:internal-dpl-aod-reader]: #15 o2::framework::DataProcessor::doSend (device=..., context=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessor.cxx:94 [5037:internal-dpl-aod-reader]: #16 0x00007f6a6ec1b8e1 in o2::framework::(anonymous namespace)::CommonMessageBackendsHelpers::::operator() (__closure=, service=0xceb660, ctx=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/CommonMessageBackends.cxx:46 [5037:internal-dpl-aod-reader]: #17 std::_Function_handler::sendCallback() [with T = o2::framework::ArrowContext; o2::framework::ServiceProcessingCallback = std::function]:: >::_M_invoke(const std::_Any_data &, o2::framework::ProcessingContext &, void *&&) (__functor=..., __args#0=..., __args#1=) at /home/alidock/.sw/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:316 [5037:internal-dpl-aod-reader]: #18 0x00007f6a6ec4a8c3 in std::function::operator()(o2::framework::ProcessingContext&, void*) const (__args#1=, __args#0=..., this=0xceb8d8) at /home/alidock/.sw/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:706 [5037:internal-dpl-aod-reader]: #19 o2::framework::DataProcessingDevice::tryDispatchComputation (context=..., completed=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:977 [5037:internal-dpl-aod-reader]: #20 0x00007f6a6ec4b058 in o2::framework::DataProcessingDevice::doRun (context=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:527 [5037:internal-dpl-aod-reader]: #21 0x00007f6a6ec4b4ef in o2::framework::DataProcessingDevice::ConditionalRun (this=0xccb290) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/DataProcessingDevice.cxx:454 [5037:internal-dpl-aod-reader]: #22 0x00007f6a6b349355 in FairMQDevice::RunWrapper (this=0xccb290) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.cxx:512 [5037:internal-dpl-aod-reader]: #23 0x00007f6a6b349a79 in FairMQDevice::::operator() (state=, __closure=0xcce090) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.cxx:160 [5037:internal-dpl-aod-reader]: #24 std::_Function_handler >::_M_invoke(const std::_Any_data &, fair::mq::State &&) (__functor=..., __args#0=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:316 [5037:internal-dpl-aod-reader]: #25 0x00007f6a6a3ff40d in std::function::operator()(fair::mq::State) const (__args#0=, this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/GCC-Toolchain/v7.3.0-alice2-10/include/c++/7.3.0/bits/std_function.h:706 [5037:internal-dpl-aod-reader]: #26 boost::detail::function::void_function_obj_invoker1, void, fair::mq::State>::invoke(boost::detail::function::function_buffer&, fair::mq::State) (function_obj_ptr=..., a0=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/function/function_template.hpp:158 [5037:internal-dpl-aod-reader]: #27 0x00007f6a6a407a83 in boost::function1::operator() (a0=, this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/function/function_template.hpp:763 [5037:internal-dpl-aod-reader]: #28 boost::signals2::detail::call_with_tuple_args::m_invoke, 0u, fair::mq::State&>(boost::function&, boost::signals2::detail::unsigned_meta_array<0u>, std::tuple const&, boost::enable_if::result_type>, void>::type*) const (this=, args=..., func=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:105 [5037:internal-dpl-aod-reader]: #29 boost::signals2::detail::call_with_tuple_args::operator(), fair::mq::State&, 1ul>(boost::function&, std::tuple const&, mpl_::size_t<1ul>) const (this=, args=..., func=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:90 [5037:internal-dpl-aod-reader]: #30 boost::signals2::detail::variadic_slot_invoker::operator() >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::shared_ptr >, boost::signals2::slot >, boost::signals2::mutex> > const&) const (connectionBody=..., this=0x7ffc0cb38170) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/variadic_slot_invoker.hpp:133 [5037:internal-dpl-aod-reader]: #31 boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >::dereference() const (this=0x7ffc0cb37f80) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/slot_call_iterator.hpp:110 [5037:internal-dpl-aod-reader]: #32 boost::iterators::iterator_core_access::dereference, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > const&) (f=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/iterator/iterator_facade.hpp:550 [5037:internal-dpl-aod-reader]: #33 boost::iterators::detail::iterator_facade_base, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::void_type, boost::iterators::single_pass_traversal_tag, boost::signals2::detail::void_type const&, long, false, false>::operator*() const (this=0x7ffc0cb37f80) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/iterator/iterator_facade.hpp:656 [5037:internal-dpl-aod-reader]: #34 boost::signals2::optional_last_value::operator(), std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (this=, first=..., last=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/optional_last_value.hpp:57 [5037:internal-dpl-aod-reader]: #35 boost::signals2::detail::combiner_invoker::operator(), boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> > >(boost::signals2::optional_last_value&, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >, boost::signals2::detail::slot_call_iterator_t, std::_List_iterator >, boost::signals2::slot >, boost::signals2::mutex> > >, boost::signals2::detail::connection_body >, boost::signals2::slot >, boost::signals2::mutex> >) const (this=, combiner=..., first=..., last=...) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/result_type_wrapper.hpp:64 [5037:internal-dpl-aod-reader]: #36 boost::signals2::detail::signal_impl, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) (this=0xcca310, args#0=, args#0 [5037:internal-dpl-aod-reader]: entry=fair::mq::State::Running) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/signal_template.hpp:243 [5037:internal-dpl-aod-reader]: #37 0x00007f6a6a40e5c4 in boost::signals2::signal, int, std::less, boost::function, boost::function, boost::signals2::mutex>::operator()(fair::mq::State) const (args#0=fair::mq::State::Running, this=0xccd440) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/slc7_x86-64/boost/v1.72.0-alice1-41/include/boost/signals2/detail/signal_template.hpp:726 [5037:internal-dpl-aod-reader]: #38 fair::mq::fsm::Machine_::CallStateHandler (state=fair::mq::State::Running, this=0xccd3b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:158 [5037:internal-dpl-aod-reader]: #39 fair::mq::fsm::Machine_::ProcessWork (this=this [5037:internal-dpl-aod-reader]: entry=0xccd3b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:206 [5037:internal-dpl-aod-reader]: #40 0x00007f6a6a3fdc9e in fair::mq::StateMachine::ProcessWork (this=0xccb350) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/StateMachine.cxx:375 [5037:internal-dpl-aod-reader]: #41 0x00007f6a6b3150ad in FairMQDevice::RunStateMachine (this=) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/FairMQDevice.h:402 [5037:internal-dpl-aod-reader]: #42 fair::mq::DeviceRunner::Run (this=this [5037:internal-dpl-aod-reader]: entry=0x7ffc0cb391b0) at /mnt/mesos/sandbox/sandbox/jenkins/workspace/DailyBuilds/DailyO2/sw/20156155/1/SOURCES/FairMQ/v1.4.21/v1.4.21/fairmq/DeviceRunner.cxx:174 [5037:internal-dpl-aod-reader]: #43 0x00007f6a6ed071a8 in doChild (argc=37, argv=0x7ffc0cb3c4b8, serviceRegistry=..., spec=..., errorPolicy=, loop=, loop [5037:internal-dpl-aod-reader]: entry=0xca3820) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:723 [5037:internal-dpl-aod-reader]: #44 0x00007f6a6ed08533 in runStateMachine (workflow=..., workflowInfo=..., previousDataProcessorInfos=..., driverControl=..., driverInfo=..., metricsInfos=..., varmap=..., frameworkId=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:961 [5037:internal-dpl-aod-reader]: #45 0x00007f6a6ed0eda0 in doMain (argc=argc [5037:internal-dpl-aod-reader]: entry=37, argv=argv [5037:internal-dpl-aod-reader]: entry=0x7ffc0cb3c4b8, workflow=..., channelPolicies=..., completionPolicies=..., dispatchPolicies=..., currentWorkflowOptions=..., configContext=...) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/src/runDataProcessing.cxx:1689 [5037:internal-dpl-aod-reader]: #46 0x000000000041b4ed in main (argc=37, argv=0x7ffc0cb3c4b8) at /home/alidock/.sw/SOURCES/O2/v1.2.0/0/Framework/Core/include/Framework/runDataProcessing.h:160 [5037:internal-dpl-aod-reader]: =========================================================== [5037:internal-dpl-aod-reader]: [5037:internal-dpl-aod-reader]: [INFO] QUIT_REQUESTED [5041:etaphi-histogram]: [07:52:37][INFO] Received device shutdown request (signal 15). [5041:etaphi-histogram]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5042:output-wrapper]: [07:52:37][INFO] Received device shutdown request (signal 15). [5042:output-wrapper]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5043:internal-dpl-global-analysis-file-sink]: [07:52:37][INFO] Received device shutdown request (signal 15). [5043:internal-dpl-global-analysis-file-sink]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5039:eta-and-phi-histograms]: [07:52:37][INFO] Received device shutdown request (signal 15). [5039:eta-and-phi-histograms]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5038:internal-dpl-aod-spawner]: [07:52:37][INFO] Received device shutdown request (signal 15). [5036:internal-dpl-clock]: [07:52:37][INFO] Received device shutdown request (signal 15). [5036:internal-dpl-clock]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5038:internal-dpl-aod-spawner]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5040:pt-histogram]: [07:52:37][INFO] Received device shutdown request (signal 15). [5040:pt-histogram]: [07:52:37][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately. [5036:internal-dpl-clock]: [07:52:38][STATE] RUNNING ---> READY [5039:eta-and-phi-histograms]: [07:52:38][STATE] RUNNING ---> READY [5036:internal-dpl-clock]: [07:52:38][STATE] READY ---> RESETTING TASK [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] RUNNING ---> READY [5036:internal-dpl-clock]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5036:internal-dpl-clock]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5041:etaphi-histogram]: [07:52:38][STATE] RUNNING ---> READY [5040:pt-histogram]: [07:52:38][STATE] RUNNING ---> READY [5042:output-wrapper]: [07:52:38][STATE] RUNNING ---> READY [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] RUNNING ---> READY [5041:etaphi-histogram]: [07:52:38][STATE] READY ---> RESETTING TASK [5041:etaphi-histogram]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5040:pt-histogram]: [07:52:38][STATE] READY ---> RESETTING TASK [5040:pt-histogram]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5042:output-wrapper]: [07:52:38][STATE] READY ---> RESETTING TASK [5042:output-wrapper]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] READY ---> RESETTING TASK [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] READY ---> RESETTING TASK [5041:etaphi-histogram]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5036:internal-dpl-clock]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5042:output-wrapper]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5036:internal-dpl-clock]: [07:52:38][STATE] IDLE ---> EXITING [5039:eta-and-phi-histograms]: [07:52:38][STATE] READY ---> RESETTING TASK [5039:eta-and-phi-histograms]: [07:52:38][STATE] RESETTING TASK ---> DEVICE READY [5039:eta-and-phi-histograms]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5036:internal-dpl-clock]: [07:52:38][STATE] Exiting FairMQ state machine [5040:pt-histogram]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5036:internal-dpl-clock]: [07:52:38][INFO] Process 5036 is exiting. [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5042:output-wrapper]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] DEVICE READY ---> RESETTING DEVICE [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] IDLE ---> EXITING [5038:internal-dpl-aod-spawner]: [07:52:38][STATE] Exiting FairMQ state machine [5038:internal-dpl-aod-spawner]: [07:52:38][INFO] Process 5038 is exiting. [5041:etaphi-histogram]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5041:etaphi-histogram]: [07:52:38][STATE] IDLE ---> EXITING [5041:etaphi-histogram]: [07:52:38][STATE] Exiting FairMQ state machine [5041:etaphi-histogram]: [07:52:38][INFO] Process 5041 is exiting. [5039:eta-and-phi-histograms]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5040:pt-histogram]: [07:52:38][STATE] RESETTING DEVICE ---> IDLE [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] IDLE ---> EXITING [5040:pt-histogram]: [07:52:38][STATE] IDLE ---> EXITING [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][STATE] Exiting FairMQ state machine [5043:internal-dpl-global-analysis-file-sink]: [07:52:38][INFO] Process 5043 is exiting. [5042:output-wrapper]: [07:52:38][STATE] IDLE ---> EXITING [5039:eta-and-phi-histograms]: [07:52:38][STATE] IDLE ---> EXITING [5042:output-wrapper]: [07:52:38][STATE] Exiting FairMQ state machine [5040:pt-histogram]: [07:52:38][STATE] Exiting FairMQ state machine [5042:output-wrapper]: [07:52:38][INFO] Process 5042 is exiting. [5039:eta-and-phi-histograms]: [07:52:38][STATE] Exiting FairMQ state machine [5039:eta-and-phi-histograms]: [07:52:38][INFO] Process 5039 is exiting. [5040:pt-histogram]: [07:52:38][INFO] Process 5040 is exiting. [INFO] Dumping used configuration in dpl-config.json Cleanup called with session id 'dpl_5035', translating to shared memory id 'bb5d056c' Cleaning up for shared memory id 'bb5d056c'... No region counter found. No regions to cleanup. Successfully removed 'fmq_bb5d056c_mng'. Successfully removed 'fmq_bb5d056c_main'. Successfully removed 'fmq_bb5d056c_mtx'. Successfully removed 'fmq_bb5d056c_cv'. [INFO] Process 5035 is exiting.