Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-11208

galera_sst_xtrabackup-v2: assertion failure: global_status_var.global_memory_used == 0

Details

    • 10.2.7-1

    Description

      $ perl mtr galera_sst_xtrabackup-v2
      		 
      ...
      		 
      #5  0x00007f59c885d01a in __GI_abort () at abort.c:89
      		 
      #6  0x00007f59c8853bd7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x556ca6844940 "global_status_var.global_memory_used == 0", file=file@entry=0x556ca6844670 "/home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc", line=line@entry=2152, function=function@entry=0x556ca684c6c0 <mysqld_exit(int)::__PRETTY_FUNCTION__> "void mysqld_exit(int)") at assert.c:92
      		 
      #7  0x00007f59c8853c82 in __GI___assert_fail (assertion=0x556ca6844940 "global_status_var.global_memory_used == 0", file=0x556ca6844670 "/home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc", line=2152, function=0x556ca684c6c0 <mysqld_exit(int)::__PRETTY_FUNCTION__> "void mysqld_exit(int)") at assert.c:101
      		 
      #8  0x0000556ca5ccd450 in mysqld_exit (exit_code=1) at /home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc:2152
      		 
      #9  0x0000556ca5ccd359 in unireg_abort (exit_code=1) at /home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc:2120
      		 
      #10 0x0000556ca5f71aeb in wsrep_init_startup (first=true) at /home/nirbhay/project/git-repo/mariadb/10.2/sql/wsrep_mysqld.cc:830
      		 
      #11 0x0000556ca5cd37a2 in init_server_components () at /home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc:5226
      		 
      #12 0x0000556ca5cd4ac7 in mysqld_main (argc=151, argv=0x7f59c80720c0) at /home/nirbhay/project/git-repo/mariadb/10.2/sql/mysqld.cc:5882
      		 
      #13 0x0000556ca5cc9ae0 in main (argc=18, argv=0x7ffdc0cb6108) at /home/nirbhay/project/git-repo/mariadb/10.2/sql/main.cc:25

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-12445 Rocksdb does not shutdown worker threads and aborts in memleak check on server shutdown

          • Major - Major loss of function.
          • Open

          Activity

            Ascending order - Click to sort in descending order
            elenst Elena Stepanova added a comment -

            There is no assertion failure on the current 10.2, possibly because the test fails earlier on other reasons, but there is some still problem with memory:

            10.2 1cc1d0429 (slave)

            		 
            2018-07-17 12:23:35 140149644458880 [Note] WSREP: Waiting for SST to complete. waited 11205470 secs.
            		 
            2018-07-17 12:23:35 140149404985088 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '127.0.0.1:16007' -
            		 
            -datadir '/data/bld/10.2/mysql-test/var/mysqld.2/data/'  --defaults-file '/data/bld/10.2/mysql-test/var/my.cnf' --defaults-group-suffix '.2'  --parent
            		 
             '20786'  '' : 2 (No such file or directory)
            		 
            2018-07-17 12:23:35 140149644458880 [Note] WSREP: Waiting for SST to complete. waited 11205480 secs.
            		 
            2018-07-17 12:23:35 140149404985088 [ERROR] WSREP: Failed to read uuid:seqno and wsrep_gtid_domain_id from joiner script.
            		 
            2018-07-17 12:23:35 140149644458880 [ERROR] WSREP: SST failed: 2 (No such file or directory)
            		 
            2018-07-17 12:23:35 140149644458880 [ERROR] Aborting
            		 
             
            		 
            Error in my_thread_global_end(): 1 threads didn't exit
            		 
            Warning:   56 bytes lost at 0x7f77080171c0, allocated by T@0 at 0x564519db4581, 0x5645192f5236, 0x564519308c02, 0x5645193936e3, 0x5645192fa58a, 0x5645
            		 
            195b8158, nptl/pthread_create.c:333, x86_64/clone.S:99
            		 
            Warning: 2048 bytes lost at 0x56451c2f5b00, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:176, mysys/thr_mutex.c:318, psi/m
            		 
            ysql_thread.h:666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239
            		 
            Warning: 2048 bytes lost at 0x56451c2f5280, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:171, mysys/thr_mutex.c:318, psi/m
            		 
            ysql_thread.h:666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239
            		 
            Warning:  208 bytes lost at 0x56451c330930, allocated by T@0 at mysys/mulalloc.c:51, mysys/thr_mutex.c:158, mysys/thr_mutex.c:318, psi/mysql_thread.h:
            		 
            666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128
            		 
            Warning: 2048 bytes lost at 0x56451c2f4a00, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:176, mysys/thr_mutex.c:318, psi/m
            		 
            ysql_thread.h:666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128
            		 
            Warning: 2048 bytes lost at 0x56451c2f4180, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:171, mysys/thr_mutex.c:318, psi/m
            		 
            ysql_thread.h:666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128
            		 
            Warning:  208 bytes lost at 0x56451c2d9300, allocated by T@0 at mysys/mulalloc.c:51, mysys/thr_mutex.c:158, mysys/thr_mutex.c:318, psi/mysql_thread.h:
            		 
            666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128, sql/wsrep_mysqld.cc:840
            		 
            ...

            elenst Elena Stepanova added a comment - There is no assertion failure on the current 10.2, possibly because the test fails earlier on other reasons, but there is some still problem with memory: 10.2 1cc1d0429 (slave) 2018-07-17 12:23:35 140149644458880 [Note] WSREP: Waiting for SST to complete. waited 11205470 secs. 2018-07-17 12:23:35 140149404985088 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '127.0.0.1:16007' - -datadir '/data/bld/10.2/mysql-test/var/mysqld.2/data/' --defaults-file '/data/bld/10.2/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '20786' '' : 2 (No such file or directory) 2018-07-17 12:23:35 140149644458880 [Note] WSREP: Waiting for SST to complete. waited 11205480 secs. 2018-07-17 12:23:35 140149404985088 [ERROR] WSREP: Failed to read uuid:seqno and wsrep_gtid_domain_id from joiner script. 2018-07-17 12:23:35 140149644458880 [ERROR] WSREP: SST failed: 2 (No such file or directory) 2018-07-17 12:23:35 140149644458880 [ERROR] Aborting   Error in my_thread_global_end(): 1 threads didn't exit Warning: 56 bytes lost at 0x7f77080171c0, allocated by T@0 at 0x564519db4581, 0x5645192f5236, 0x564519308c02, 0x5645193936e3, 0x5645192fa58a, 0x5645 195b8158, nptl/pthread_create.c:333, x86_64/clone.S:99 Warning: 2048 bytes lost at 0x56451c2f5b00, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:176, mysys/thr_mutex.c:318, psi/m ysql_thread.h:666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239 Warning: 2048 bytes lost at 0x56451c2f5280, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:171, mysys/thr_mutex.c:318, psi/m ysql_thread.h:666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239 Warning: 208 bytes lost at 0x56451c330930, allocated by T@0 at mysys/mulalloc.c:51, mysys/thr_mutex.c:158, mysys/thr_mutex.c:318, psi/mysql_thread.h: 666, sql/sql_class.h:3683, sql/wsrep_mysqld.cc:2095, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128 Warning: 2048 bytes lost at 0x56451c2f4a00, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:176, mysys/thr_mutex.c:318, psi/m ysql_thread.h:666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128 Warning: 2048 bytes lost at 0x56451c2f4180, allocated by T@0 at mysys/array.c:70, mysys/hash.c:98, mysys/thr_mutex.c:171, mysys/thr_mutex.c:318, psi/m ysql_thread.h:666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128 Warning: 208 bytes lost at 0x56451c2d9300, allocated by T@0 at mysys/mulalloc.c:51, mysys/thr_mutex.c:158, mysys/thr_mutex.c:318, psi/mysql_thread.h: 666, sql/wsrep_mysqld.cc:2100, sql/wsrep_mysqld.cc:2239, sql/mysqld.cc:2128, sql/wsrep_mysqld.cc:840 ...
            stepan.patryshev Stepan Patryshev (Inactive) added a comment -

            Closing as not reproduced. Last time it failed on bb (10.2) was on 01.04.2019.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Closing as not reproduced. Last time it failed on bb (10.2) was on 01.04.2019.

            People

              stepan.patryshev Stepan Patryshev (Inactive)
              nirbhay_c Nirbhay Choubey (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.