Uploaded image for project: 'MariaDB MaxScale'
  1. MariaDB MaxScale
  2. MXS-3958

MaxScale stalls and crashes occasionally

    XMLWordPrintable

Details

    • MXS-SPRINT-150

    Description

      MaxScale stalls and crashes occasionally and then reconnecting.

      The snippet of "Thread 1 " from the 3 stack traces provided on 12/13 and 12/14 below (3 stack traces will be attaching):

      core-trace-2021-12-13:
      ...
      Thread 1 (Thread 0x7fb83c86a100 (LWP 4203)):
      #0 0x00007fb839e5b134 in futex_abstimed_wait_cancelable (private=0, abstime=0x0, clockid=0, expected=0, futex_word=0x7ffc6de202a0) at ../sysdeps/nptl/futex-internal.h:320
      #1 do_futex_wait (sem=sem@entry=0x7ffc6de202a0, abstime=0x0, clockid=0) at sem_waitcommon.c:112
      #2 0x00007fb839e5b228 in __new_sem_wait_slow (sem=sem@entry=0x7ffc6de202a0, abstime=0x0, clockid=0) at sem_waitcommon.c:184
      #3 0x00007fb839e5b299 in __new_sem_wait (sem=sem@entry=0x7ffc6de202a0) at sem_wait.c:42
      #4 0x00007fb83c248502 in maxbase::Semaphore::wait (signal_approach=<optimized out>, this=<optimized out>) at /home/****/MaxScale/maxutils/maxbase/include/maxbase/semaphore.hh:144
      #5 maxbase::Semaphore::wait_n (signal_approach=<optimized out>, n_wait=<optimized out>, this=<optimized out>) at /home/****/MaxScale/maxutils/maxbase/include/maxbase/semaphore.hh:176
      #6 maxscale::RoutingWorker::execute_concurrently(std::function<void ()> const&) (func=...) at /home/****/MaxScale/server/core/routingworker.cc:1178
      #7 0x00007fb83c25d40b in maxscale::WorkerGlobal<std::unordered_map<unsigned int, unsigned long, std::hash<unsigned int>, std::equal_to<unsigned int>, std::allocator<std::pair<unsigned int const, unsigned long> > > >::assign (this=0x1abaa38, t=...) at /home/****/MaxScale/include/maxscale/workerlocal.hh:184
      #8 0x00007fb83c2582ed in operator() (__closure=0x7fb7e800eea0) at /home/****/MaxScale/server/core/server.cc:637
      #9 std::_invoke_impl<void, Server::set_gtid_list(const std::vector<std::pair<unsigned int, long unsigned int> >&)::<lambda()>&> (_f=...) at /usr/include/c++/10/bits/invoke.h:60
      #10 std::_invoke_r<void, Server::set_gtid_list(const std::vector<std::pair<unsigned int, long unsigned int> >&)::<lambda()>&> (_fn=...) at /usr/include/c++/10/bits/invoke.h:153
      #11 std::Function_handler<void(), Server::set_gtid_list(const std::vector<std::pair<unsigned int, long unsigned int> >&)::<lambda()> >::_M_invoke(const std::_Any_data &) (_functor=...) at /usr/include/c++/10/bits/std_function.h:291
      #12 0x00007fb83c2d044a in std::function<void ()>::operator()() const (this=0x7fb7e8003198) at /usr/include/c++/10/bits/std_function.h:622
      #13 maxbase::Worker::CustomTask::execute (worker=..., this=0x7fb7e8003190) at /home/****/MaxScale/maxutils/maxbase/src/worker.cc:495
      #14 maxbase::Worker::handle_message (this=<optimized out>, queue=..., msg=...) at /home/****/MaxScale/maxutils/maxbase/src/worker.cc:657
      #15 0x00007fb83c2d33e8 in maxbase::MessageQueue::handle_poll_events (pWorker=<optimized out>, events=<optimized out>, this=0x1a7dce0) at /home/****/MaxScale/maxutils/maxbase/src/messagequeue.cc:307
      #16 maxbase::MessageQueue::handle_poll_events (this=0x1a7dce0, pWorker=<optimized out>, events=<optimized out>) at /home/****/MaxScale/maxutils/maxbase/src/messagequeue.cc:286
      #17 0x00007fb83c2d1e02 in maxbase::Worker::poll_waitevents (this=this@entry=0x7ffc6de24980) at /home/****/MaxScale/maxutils/maxbase/src/worker.cc:854
      #18 0x00007fb83c2d1fbf in maxbase::Worker::run (this=this@entry=0x7ffc6de24980, pSem=pSem@entry=0x0) at /home/****/MaxScale/maxutils/maxbase/src/worker.cc:561
      #19 0x0000000000409b80 in maxbase::Worker::run (this=0x7ffc6de24980) at /home/****/MaxScale/maxutils/maxbase/include/maxbase/worker.hh:447
      #20 main (argc=<optimized out>, argv=<optimized out>) at /home/****/MaxScale/server/core/gateway.cc:2213

      Attachments

        1. core-trace-2021-12-13.txt
          42 kB
          Yakov Kushnirsky
        2. core-trace-2021-12-14.txt
          42 kB
          Yakov Kushnirsky
        3. core-trace-2021-12-14-2.txt
          42 kB
          Yakov Kushnirsky

        Activity

          People

            nantti Niclas Antti
            YK Yakov Kushnirsky
            Votes:
            2 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.