Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-21403

mariabackup: Assertion recv_sys.mlog_checkpoint_lsn <= recv_sys.recovered_lsn failed

    XMLWordPrintable

Details

    Description

      mtr test mariabackup.mdev-14447 fails randomly in 10.5.1 tree with:

      CURRENT_TEST: mariabackup.mdev-14447
      sh: line 1: 21349 Aborted                 (core dumped) /home/my/maria-10.5/extr
      a/mariabackup/mariabackup --prepare --verbose --apply-log-only --target-dir=/hom
      e/my/maria-10.5/mysql-test/var/4/tmp/backup --incremental-dir=/home/my/maria-10.
      5/mysql-test/var/4/tmp/backup_inc1 2>&1
      mysqltest: At line 35: exec of '/home/my/maria-10.5/extra/mariabackup/mariabacku
      p --prepare --verbose --apply-log-only --target-dir=/home/my/maria-10.5/mysql-te
      st/var/4/tmp/backup --incremental-dir=/home/my/maria-10.5/mysql-test/var/4/tmp/b
      ackup_inc1  2>&1' failed, error: 34304, status: 134, errno: 2
       
      The result from queries just before the failure was:
      call mtr.add_suppression("InnoDB: New log files created");
      CREATE TABLE t(a varchar(40) PRIMARY KEY, b varchar(40), c varchar(40), d varchar(40), index(b,c,d)) ENGINE INNODB;
      # Create full backup , modify table, then create incremental/differential backup
      BEGIN;
      INSERT INTO t select uuid(), uuid(), uuid(), uuid() from seq_1_to_100000;
      COMMIT;
      SELECT count(*) FROM t;
      count(*)
      100000
      FOUND 1 /Checksum mismatch in datafile/ in backup.log
      # Prepare full backup, apply incremental one
       
      mariabackup: /my/maria-10.5/storage/innobase/log/log0recv.cc:2649: bool recv_parse_log_recs(lsn_t, store_t*, ulint, bool): Assertion `recv_sys.mlog_checkpoint_lsn <= recv_sys.recovered_lsn' failed.
      

      #3  0x00007fc00dae2160 in raise () from /lib64/libc.so.6
      #4  0x00007fc00dae3741 in abort () from /lib64/libc.so.6
      #5  0x00007fc00dada75a in __assert_fail_base () from /lib64/libc.so.6
      #6  0x00007fc00dada7d2 in __assert_fail () from /lib64/libc.so.6
      #7  0x000000000124cd9e in recv_parse_log_recs (checkpoint_lsn=34221332, store=0x7ffd40828884, available_mem=67371008, apply=true) at /my/maria-10.5/storage/innobase/log/log0recv.cc:2649
      #8  0x000000000124df2a in recv_scan_log_recs (available_mem=67371008, store_to_hash=0x7ffd40828884, log_block=0x7fc009b21000 "", checkpoint_lsn=34221332, start_lsn=34221056, end_lsn=34286592, contiguous_lsn=0x7ffd40828a98, group_scanned_lsn=0x2628c98 <log_sys+664>) at /my/maria-10.5/storage/innobase/log/log0recv.cc:3110
      #9  0x000000000124e4a5 in recv_group_scan_log_recs (checkpoint_lsn=34221332, contiguous_lsn=0x7ffd40828a98, last_phase=false) at /my/maria-10.5/storage/innobase/log/log0recv.cc:3198
      #10 0x000000000124fb89 in recv_recovery_from_checkpoint_start (flush_lsn=64240) at /my/maria-10.5/storage/innobase/log/log0recv.cc:3507
      #11 0x0000000001395450 in srv_start (create_new_db=false) at /my/maria-10.5/storage/innobase/srv/srv0start.cc:1743
      #12 0x00000000007842a2 in innodb_init () at /my/maria-10.5/extra/mariabackup/xtrabackup.cc:1975
      #13 0x000000000078e232 in xtrabackup_prepare_func (argv=0x3817150) at /my/maria-10.5/extra/mariabackup/xtrabackup.cc:5529
      #14 0x0000000000790251 in main_low (argv=0x3817150) at /my/maria-10.5/extra/mariabackup/xtrabackup.cc:6318
      #15 0x000000000078fa8e in main (argc=6, argv=0x7ffd40830208) at /my/maria-10.5/extra/mariabackup/xtrabackup.cc:6108
      

      When trying to repeat, I also found this issue during shutdown

      sql/signal_handler.cc:209(handle_fatal_signal)[0xbee896]
      /lib64/libpthread.so.0(+0x12360)[0x7f2f68a3e360]
      /lib64/libpthread.so.0(pthread_cond_wait+0x1fd)[0x7f2f68a3990d]
      /usr/lib64/libstdc++.so.6(_ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE+0xc)[0x7f2f672bfb4c]
      tpool/task.cc:63(tpool::waitable_task::wait())[0x1478852]
      srv/srv0srv.cc:2233(srv_shutdown_purge_tasks())[0x123710d]
      srv/srv0srv.cc:2304(srv_purge_shutdown())[0x123758e]
      srv/srv0start.cc:2296(innodb_preshutdown())[0x1240491]
      sql/handler.cc:886(plugin_pre_shutdown(THD*, st_plugin_int**, void*))[0xbf3000]
      sql/sql_plugin.cc:2452(plugin_foreach_with_mask(THD*, char (*)(THD*, st_plugin_int**, void*), int, unsigned int, void*))[0x8ce920]
      sql/handler.cc:895(ha_pre_shutdown())[0xbf302c]
      sql/mysqld.cc:5731(mysqld_main(int, char**))[0x774752]
      

      Attachments

        Issue Links

          Activity

            People

              marko Marko Mäkelä
              monty Michael Widenius
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.