Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-31559

btr_search_hash_table_validate() does not check if CHECK TABLE is killed

Details

    Description

      Partial server freeze observed on
      origin/bb-10.6-MDEV-31343 f410444a76b5703b803e6e43e3bbf9509b6fddb6 2023-05-25T17:22:33+03:00
       
      Scenario:
      1. Start the server + generate some initial data
      2. Several connection run a mix of DML and CHECK TABLE.
      After some time the processlist shows for all these connections the query
      CHECK TABLE <some table> EXTENDED with the state killed.
      The reason for the "killed" is most probably max_statement_time = 30.
      None of these connections got some response of the server,
       
      sdp:/data1/results/1685024678/Freeze$ _RR_TRACE_DIR=./1/rr rr replay --mark-stdio
       
      RQG
      ====
      # git clone https://github.com/mleich1/rqg --branch <pick the right branch> RQG
      #
      # GIT_SHOW: HEAD -> master, origin/master, origin/HEAD 9b710460ff8c54260b0e0649f029efa932aee22c 2023-05-23T14:33:37+02:00
      # rqg.pl  : Version 4.2.1 (2022-12)
      #
      # $RQG_HOME/rqg.pl \
      # --grammar=conf/mariadb/table_stress_innodb_dml.yy \
      # --gendata=conf/mariadb/table_stress.zz \
      # --gendata_sql=conf/mariadb/table_stress.sql \
      # --reporters=RestartConsistency \
      # --mysqld=--innodb_max_undo_log_size=10M \
      # --mysqld=--loose-innodb_lock_schedule_algorithm=fcfs \
      # --mysqld=--loose-idle_write_transaction_timeout=0 \
      # --mysqld=--loose-idle_transaction_timeout=0 \
      # --mysqld=--loose-idle_readonly_transaction_timeout=0 \
      # --mysqld=--connect_timeout=60 \
      # --mysqld=--interactive_timeout=28800 \
      # --mysqld=--slave_net_timeout=60 \
      # --mysqld=--net_read_timeout=30 \
      # --mysqld=--net_write_timeout=60 \
      # --mysqld=--loose-table_lock_wait_timeout=50 \
      # --mysqld=--wait_timeout=28800 \
      # --mysqld=--lock-wait-timeout=86400 \
      # --mysqld=--innodb-lock-wait-timeout=50 \
      # --no_mask \
      # --queries=10000000 \
      # --seed=random \
      # --reporters=None \
      # --reporters=ErrorLog \
      # --reporters=Deadlock \
      # --validators=None \
      # --mysqld=--log_output=none \
      # --mysqld=--log_bin_trust_function_creators=1 \
      # --mysqld=--loose-debug_assert_on_not_freed_memory=0 \
      # --engine=InnoDB \
      # --restart_timeout=240 \
      # --mysqld=--plugin-load-add=file_key_management.so \
      # --mysqld=--loose-file-key-management-filename=$RQG_HOME/conf/mariadb/encryption_keys.txt \
      # --mysqld=--plugin-load-add=provider_lzo.so \
      # --mysqld=--plugin-load-add=provider_bzip2.so \
      # --mysqld=--plugin-load-add=provider_lzma.so \
      # --mysqld=--plugin-load-add=provider_snappy.so \
      # --mysqld=--plugin-load-add=provider_lz4.so \
      # --mysqld=--loose-innodb_compression_level=1 \
      # --duration=900 \
      # --mysqld=--loose-innodb_fatal_semaphore_wait_threshold=300 \
      # --mysqld=--loose-innodb_read_only_compressed=OFF \
      # --mysqld=--loose-innodb-sync-debug \
      # --mysqld=--innodb_stats_persistent=on \
      # --mysqld=--innodb_adaptive_hash_index=on \
      # --mysqld=--innodb_random_read_ahead=OFF \
      # --mysqld=--log-bin \
      # --mysqld=--sync-binlog=1 \
      # --mysqld=--loose-innodb_evict_tables_on_commit_debug=on \
      # --mysqld=--loose-max-statement-time=30 \
      # --threads=129 \
      # --mysqld=--innodb-use-native-aio=0 \
      # --mysqld=--loose-gdb \
      # --mysqld=--loose-debug-gdb \
      # --rr=Extended \
      # --rr_options=--wait \
      # --mysqld=--innodb_undo_log_truncate=ON \
      # --mysqld=--innodb_undo_tablespaces=3 \
      # --mysqld=--innodb_rollback_on_timeout=OFF \
      # --mysqld=--innodb_page_size=32K \
      # --mysqld=--innodb-buffer-pool-size=32G \
      # <local settings>
      

      Attachments

        Activity

          mleich Matthias Leich created issue -
          marko Marko Mäkelä made changes -
          Field Original Value New Value
          Status Open [ 1 ] In Progress [ 3 ]
          marko Marko Mäkelä made changes -
          Status In Progress [ 3 ] In Testing [ 10301 ]
          marko Marko Mäkelä made changes -
          Assignee Marko Mäkelä [ marko ] Matthias Leich [ mleich ]
          mleich Matthias Leich added a comment - - edited

          origin/bb-10.6-MDEV-31559 3d9014385926096264e36bb3a0960660d61d0d1d 2023-06-30T17:07:21+03:00 performed well in RQG testing.
          There were some partial server freezes (maybe cause by MDEV-31393 and other reasons). But the processlists showed never
          a session with some "killed" CHECK TABLE and a runtime exceeding the wait threshold in RQG. So the current problem is fixed.
          

          mleich Matthias Leich added a comment - - edited origin/bb-10.6-MDEV-31559 3d9014385926096264e36bb3a0960660d61d0d1d 2023-06-30T17:07:21+03:00 performed well in RQG testing. There were some partial server freezes (maybe cause by MDEV-31393 and other reasons). But the processlists showed never a session with some "killed" CHECK TABLE and a runtime exceeding the wait threshold in RQG. So the current problem is fixed.
          mleich Matthias Leich made changes -
          Assignee Matthias Leich [ mleich ] Marko Mäkelä [ marko ]
          Status In Testing [ 10301 ] Stalled [ 10000 ]
          marko Marko Mäkelä made changes -
          issue.field.resolutiondate 2023-07-03 12:10:09.0 2023-07-03 12:10:09.126
          marko Marko Mäkelä made changes -
          Fix Version/s 10.6.15 [ 29013 ]
          Fix Version/s 10.9.8 [ 29015 ]
          Fix Version/s 10.10.6 [ 29017 ]
          Fix Version/s 10.11.5 [ 29019 ]
          Fix Version/s 11.0.3 [ 28920 ]
          Fix Version/s 11.1.2 [ 28921 ]
          Fix Version/s 11.2.1 [ 29034 ]
          Fix Version/s 10.6 [ 24028 ]
          Resolution Fixed [ 1 ]
          Status Stalled [ 10000 ] Closed [ 6 ]

          People

            marko Marko Mäkelä
            mleich Matthias Leich
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.