Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4088

workernode or controllernode sporadically crash with SIGABRT in __gnu_cxx::__verbose_terminate_handler() upon Columnstore plugin package installation

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 1.5.2
    • 5.5.1
    • installation
    • None

    Description

      The crashes happen occasionally without any obvious reason, upon installation of mariadb-server mariadb-plugin-columnstore, on the same VM image where it works uneventfully most of the times.

      Stacktrace:
       #0  0x00007fc7044b4428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
               resultvar = 0
               pid = 9048
               selftid = 9048
       #1  0x00007fc7044b602a in __GI_abort () at abort.c:89
               save_stage = 2
               act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 16 times>}}, sa_flags = 0, sa_restorer = 0x564b301c2618}
               sigs = {__val = {32, 0 <repeats 15 times>}}
       #2  0x00007fc704be184d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #3  0x00007fc704bdf6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #4  0x00007fc704bdf701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #5  0x00007fc704bdf919 in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #6  0x00007fc707c116fe in idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #7  0x00007fc707c121dd in idbdatafile::IDBPolicy::configIDBPolicy() () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #8  0x0000564b2f34d062 in ?? ()
       No symbol table info available.
       #9  0x00007fc70449f830 in __libc_start_main (main=0x564b2f34cf90, argc=3, argv=0x7ffc7c18cbf8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffc7c18cbe8) at ../csu/libc-start.c:291
               result = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 4368315612961404667, 94880914529056, 140722390486000, 0, 0, 8066503001669072635, 8036402091289966331}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x7ffc7c18cc18, 0x7fc70b292168}, data = {prev = 0x0, cleanup = 0x0, canceltype = 2081999896}}}
               not_first_call = <optimized out>
       #10 0x0000564b2f34db49 in ?? ()
       No symbol table info available.
      StacktraceAddressSignature: /usr/bin/workernode:6:/lib/x86_64-linux-gnu/libc-2.23.so+35428:/lib/x86_64-linux-gnu/libc-2.23.so+3702a:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8f84d:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d6b6:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d701:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d919:/usr/lib/x86_64-linux-gnu/libidbdatafile.so+1f6fe:/usr/lib/x86_64-linux-gnu/libidbdatafile.so+201dd:/usr/bin/workernode+d062:/lib/x86_64-linux-gnu/libc-2.23.so+20830:/usr/bin/workernode+db49
      StacktraceTop:
       __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
      Tags: xenial third-party-packages
      ThreadStacktrace:
       .
       Thread 2 (Thread 0x7fc7016eb700 (LWP 9058)):
       #0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
       No locals.
       #1  0x00007fc70811b19b in threadpool::ThreadPool::pruneThread() () from /usr/lib/x86_64-linux-gnu/libthreadpool.so
       No symbol table info available.
       #2  0x00007fc7066055d5 in ?? () from /usr/lib/x86_64-linux-gnu/libboost_thread.so.1.58.0
       No symbol table info available.
       #3  0x00007fc70ae556ba in start_thread (arg=0x7fc7016eb700) at pthread_create.c:333
               __res = <optimized out>
               pd = 0x7fc7016eb700
               now = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140492699252480, -8067915554564114693, 0, 140722390485087, 140492699253184, 94880929547504, 8036395707065399035, 8036414354446448379}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
               not_first_call = <optimized out>
               pagesize_m1 = <optimized out>
               sp = <optimized out>
               freesize = <optimized out>
               __PRETTY_FUNCTION__ = "start_thread"
       #4  0x00007fc70458641d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
       No locals.
       .
       Thread 1 (Thread 0x7fc70b260740 (LWP 9048)):
       #0  0x00007fc7044b4428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
               resultvar = 0
               pid = 9048
               selftid = 9048
       #1  0x00007fc7044b602a in __GI_abort () at abort.c:89
               save_stage = 2
               act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 16 times>}}, sa_flags = 0, sa_restorer = 0x564b301c2618}
               sigs = {__val = {32, 0 <repeats 15 times>}}
       #2  0x00007fc704be184d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #3  0x00007fc704bdf6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #4  0x00007fc704bdf701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #5  0x00007fc704bdf919 in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #6  0x00007fc707c116fe in idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #7  0x00007fc707c121dd in idbdatafile::IDBPolicy::configIDBPolicy() () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #8  0x0000564b2f34d062 in ?? ()
       No symbol table info available.
       #9  0x00007fc70449f830 in __libc_start_main (main=0x564b2f34cf90, argc=3, argv=0x7ffc7c18cbf8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffc7c18cbe8) at ../csu/libc-start.c:291
               result = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 4368315612961404667, 94880914529056, 140722390486000, 0, 0, 8066503001669072635, 8036402091289966331}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x7ffc7c18cc18, 0x7fc70b292168}, data = {prev = 0x0, cleanup = 0x0, canceltype = 2081999896}}}
               not_first_call = <optimized out>
       #10 0x0000564b2f34db49 in ?? ()
       No symbol table info available.
      Title: workernode crashed with SIGABRT in __gnu_cxx::__verbose_terminate_handler()
      

       #0  0x00007f8e2f4c1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
               resultvar = 0
               pid = 9289
               selftid = 9289
       #1  0x00007f8e2f4c302a in __GI_abort () at abort.c:89
               save_stage = 2
               act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 13 times>, 140734883982640, 140248655882267, 94179417462920}}, sa_flags = 801028224, sa_restorer = 0x55a7dab91888}
               sigs = {__val = {32, 0 <repeats 15 times>}}
       #2  0x00007f8e2fbee84d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #3  0x00007f8e2fbec6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #4  0x00007f8e2fbec701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #5  0x00007f8e2fbec919 in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #6  0x00007f8e32c1e6fe in idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #7  0x00007f8e32c1f1dd in idbdatafile::IDBPolicy::configIDBPolicy() () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #8  0x000055a7d8b51378 in ?? ()
       No symbol table info available.
       #9  0x00007f8e2f4ac830 in __libc_start_main (main=0x55a7d8b51220, argc=2, argv=0x7fff64c47888, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff64c47878) at ../csu/libc-start.c:291
               result = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 7434466455411384146, 94179383652128, 140734883985536, 0, 0, 3719409514439139154, 3710799113800539986}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x7fff64c478a0, 0x7f8e3629f168}, data = {prev = 0x0, cleanup = 0x0, canceltype = 1690597536}}}
               not_first_call = <optimized out>
       #10 0x000055a7d8b52f49 in ?? ()
       No symbol table info available.
      StacktraceAddressSignature: /usr/bin/controllernode:6:/lib/x86_64-linux-gnu/libc-2.23.so+35428:/lib/x86_64-linux-gnu/libc-2.23.so+3702a:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8f84d:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d6b6:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d701:/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21+8d919:/usr/lib/x86_64-linux-gnu/libidbdatafile.so+1f6fe:/usr/lib/x86_64-linux-gnu/libidbdatafile.so+201dd:/usr/bin/controllernode+f378:/lib/x86_64-linux-gnu/libc-2.23.so+20830:/usr/bin/controllernode+10f49
      StacktraceTop:
       __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
      Tags: xenial third-party-packages
      ThreadStacktrace:
       .
       Thread 2 (Thread 0x7f8e2c6f8700 (LWP 9302)):
       #0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
       No locals.
       #1  0x00007f8e3312819b in threadpool::ThreadPool::pruneThread() () from /usr/lib/x86_64-linux-gnu/libthreadpool.so
       No symbol table info available.
       #2  0x00007f8e316125d5 in ?? () from /usr/lib/x86_64-linux-gnu/libboost_thread.so.1.58.0
       No symbol table info available.
       #3  0x00007f8e35e626ba in start_thread (arg=0x7f8e2c6f8700) at pthread_create.c:333
               __res = <optimized out>
               pd = 0x7f8e2c6f8700
               now = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140248607590144, -3719068704764698798, 0, 140734883984623, 140248607590848, 94179417322736, 3710806016627728210, 3710787404626419538}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
               not_first_call = <optimized out>
               pagesize_m1 = <optimized out>
               sp = <optimized out>
               freesize = <optimized out>
               __PRETTY_FUNCTION__ = "start_thread"
       #4  0x00007f8e2f59341d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
       No locals.
       .
       Thread 1 (Thread 0x7f8e3626d740 (LWP 9289)):
       #0  0x00007f8e2f4c1428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
               resultvar = 0
               pid = 9289
               selftid = 9289
       #1  0x00007f8e2f4c302a in __GI_abort () at abort.c:89
               save_stage = 2
               act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 13 times>, 140734883982640, 140248655882267, 94179417462920}}, sa_flags = 801028224, sa_restorer = 0x55a7dab91888}
               sigs = {__val = {32, 0 <repeats 15 times>}}
       #2  0x00007f8e2fbee84d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #3  0x00007f8e2fbec6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #4  0x00007f8e2fbec701 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #5  0x00007f8e2fbec919 in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
       No symbol table info available.
       #6  0x00007f8e32c1e6fe in idbdatafile::IDBPolicy::init(bool, bool, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, long) () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #7  0x00007f8e32c1f1dd in idbdatafile::IDBPolicy::configIDBPolicy() () from /usr/lib/x86_64-linux-gnu/libidbdatafile.so
       No symbol table info available.
       #8  0x000055a7d8b51378 in ?? ()
       No symbol table info available.
       #9  0x00007f8e2f4ac830 in __libc_start_main (main=0x55a7d8b51220, argc=2, argv=0x7fff64c47888, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff64c47878) at ../csu/libc-start.c:291
               result = <optimized out>
               unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 7434466455411384146, 94179383652128, 140734883985536, 0, 0, 3719409514439139154, 3710799113800539986}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x7fff64c478a0, 0x7f8e3629f168}, data = {prev = 0x0, cleanup = 0x0, canceltype = 1690597536}}}
               not_first_call = <optimized out>
       #10 0x000055a7d8b52f49 in ?? ()
       No symbol table info available.
      Title: controllernode crashed with SIGABRT in __gnu_cxx::__verbose_terminate_handler()
      

      The suggestion from the first report to upgrade ubuntu-keyring didn't help, the second one was produced with it already upgraded.

      The attached archive contains the Ubuntu crash report, logs from /var/log/mariadb/columnstore, files from /tmp/columnstore_tmp_files, and stdout of the installation.

      Attachments

        1. controllernode_crash.tar.gz
          576 kB
          Elena Stepanova
        2. workernode_crash.tar.gz
          577 kB
          Elena Stepanova

        Issue Links

          Activity

            People

              drrtuy Roman
              elenst Elena Stepanova
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.