Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-35798

Assertion `purge_seqno <= last_committed()' failed in galera_parallel_autoinc_manytrx

Details

    Description

      Assertion `purge_seqno <= last_committed()' failed in galera_parallel_autoinc_manytrx:

      galera.galera_parallel_autoinc_manytrx   w4 [ fail ]
              Test ended at 2024-12-03 18:33:13
       
      CURRENT_TEST: galera.galera_parallel_autoinc_manytrx
       
       
      Server [mysqld.2 - pid: 36693, winpid: 36693, exit: 256] failed during test run
      Server log from this test:
      ----------SERVER LOG START-----------
      $ /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/4/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300
      2024-12-03 18:32:54 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 32190)
      2024-12-03 18:32:54 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)
      2024-12-03 18:32:54 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:19097' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members.
      2024-12-03 18:32:54 0 [Note] slave_connections_needed_for_purge changed to 0 because of Galera. Change it to 1 or higher if this Galera node is also Master in a normal replication setup
      2024-12-03 18:32:54 0 [Note] Starting MariaDB 11.4.4-2-MariaDB-debug-log source revision ac4964689cd52747976e1cd312d69af1e7675ce1 server_uid QQMtiQFC0raKdmr+HKZfky+6tOI= as process 36694
      2024-12-03 18:32:54 0 [Note] WSREP: Using server side SSL for provider connections
      2024-12-03 18:32:54 0 [Note] WSREP: Loading provider /home/jenkins/workspace/Source-Build-Test/libgalera_enterprise_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
      2024-12-03 18:32:54 0 [Note] WSREP: wsrep_load(): loading provider library '/home/jenkins/workspace/Source-Build-Test/libgalera_enterprise_smm.so'
      2024-12-03 18:32:54 0 [Note] WSREP: wsrep_load(): Galera 26.4.20-1(r5f861d4) by Codership Oy <info@codership.com> loaded successfully.
      2024-12-03 18:32:54 0 [Note] WSREP: Initializing thread service v1
      2024-12-03 18:32:54 0 [Note] WSREP: Initializing tls service v1
      2024-12-03 18:32:54 0 [Note] WSREP: Initializing allowlist service v1
      2024-12-03 18:32:54 0 [Note] WSREP: Initializing event service v1
      2024-12-03 18:32:54 0 [Note] WSREP: Resolved symbol 'wsrep_node_isolation_mode_set_v1'
      2024-12-03 18:32:54 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
      2024-12-03 18:32:54 0 [Warning] WSREP: Could not open state file for reading: '/dev/shm/var/4/mysqld.2/data//grastate.dat'
      2024-12-03 18:32:54 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1
      2024-12-03 18:32:54 0 [Note] WSREP: GCache DEBUG: opened preamble:
      Version: 0
      UUID: 00000000-0000-0000-0000-000000000000
      Seqno: -1 - -1
      Offset: -1
      Synced: 0
      2024-12-03 18:32:54 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID.
      2024-12-03 18:32:54 0 [Note] WSREP: Passing config to GCS: base_dir = /dev/shm/var/4/mysqld.2/data/; base_host = 127.0.0.1; base_port = 19095; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /dev/shm/var/4/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 922337203
      2024-12-03 18:32:54 0 [Note] WSREP: Start replication
      2024-12-03 18:32:54 0 [Note] WSREP: Connecting with bootstrap option: 0
      2024-12-03 18:32:54 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1
      2024-12-03 18:32:54 0 [Note] WSREP: protonet asio version 0
      2024-12-03 18:32:54 0 [Note] WSREP: Using CRC-32C for message checksums.
      2024-12-03 18:32:54 0 [Note] WSREP: backend: asio
      2024-12-03 18:32:54 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 
      2024-12-03 18:32:54 0 [Note] WSREP: access file(/dev/shm/var/4/mysqld.2/data//gvwstate.dat) failed(No such file or directory)
      2024-12-03 18:32:54 0 [Note] WSREP: restore pc from disk failed
      2024-12-03 18:32:54 0 [Note] WSREP: GMCast version 0
      2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') listening at ssl://0.0.0.0:19095
      2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') multicast: , ttl: 1
      2024-12-03 18:32:54 0 [Note] WSREP: EVS version 1
      2024-12-03 18:32:54 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:19092'
      2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') connection established to 02a327be-9b1a ssl://127.0.0.1:19092
      2024-12-03 18:32:55 0 [Note] WSREP: EVS version upgrade 0 -> 1
      2024-12-03 18:32:55 0 [Note] WSREP: declaring 02a327be-9b1a at ssl://127.0.0.1:19092 stable
      2024-12-03 18:32:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1
      2024-12-03 18:32:55 0 [Note] WSREP: Node 02a327be-9b1a state prim
      2024-12-03 18:32:55 0 [Note] WSREP: view(view_id(PRIM,02a327be-9b1a,2) memb {
      	02a327be-9b1a,0
      	02dcf2cb-b9da,0
      } joined {
      } left {
      } partitioned {
      })
      2024-12-03 18:32:55 0 [Note] WSREP: save pc into disk
      2024-12-03 18:32:55 0 [Note] WSREP: gcomm: connected
      2024-12-03 18:32:55 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
      2024-12-03 18:32:55 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
      2024-12-03 18:32:55 0 [Note] WSREP: Opened channel 'my_wsrep_cluster'
      2024-12-03 18:32:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
      2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
      2024-12-03 18:32:55 0 [Note] WSREP: Initializing config service v1
      2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0329d233-b1a5-11ef-be52-1b870d292dad
      2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0329d233-b1a5-11ef-be52-1b870d292dad from 0 (jenkins-ubuntu-2004-amd64-build-wcudpq)
      2024-12-03 18:32:55 1 [Note] WSREP: Starting rollbacker thread 1
      2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0329d233-b1a5-11ef-be52-1b870d292dad from 1 (jenkins-ubuntu-2004-amd64-build-wcudpq)
      2024-12-03 18:32:55 0 [Note] WSREP: Quorum results:
      	version    = 6,
      	component  = PRIMARY,
      	conf_id    = 1,
      	members    = 1/2 (joined/total),
      	act_id     = 1,
      	last_appl. = 0,
      	protocols  = 4/11/4 (gcs/repl/appl),
      	vote policy= 0,
      	group UUID = 02a372e9-b1a5-11ef-873b-1a43a447f2b9
      2024-12-03 18:32:55 0 [Note] WSREP: Flow-control interval: [23, 23]
      2024-12-03 18:32:55 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2)
      2024-12-03 18:32:55 2 [Note] WSREP: Starting applier thread 2
      2024-12-03 18:32:55 2 [Note] WSREP: ####### processing CC 2, local, ordered
      2024-12-03 18:32:55 2 [Note] WSREP: Process first view: 02a372e9-b1a5-11ef-873b-1a43a447f2b9 my uuid: 02dcf2cb-b1a5-11ef-b9da-16bac6199895
      2024-12-03 18:32:55 2 [Note] WSREP: Server jenkins-ubuntu-2004-amd64-build-wcudpq connected to cluster at position 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2 with ID 02dcf2cb-b1a5-11ef-b9da-16bac6199895
      2024-12-03 18:32:55 0 [Note] WSREP: Deinitializing config service v1
      2024-12-03 18:32:55 2 [Note] WSREP: Server status change disconnected -> connected
      2024-12-03 18:32:55 2 [Note] WSREP: ####### My UUID: 02dcf2cb-b1a5-11ef-b9da-16bac6199895
      2024-12-03 18:32:55 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes
      2024-12-03 18:32:55 0 [Note] WSREP: Service thread queue flushed.
      2024-12-03 18:32:55 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
      2024-12-03 18:32:55 2 [Note] WSREP: State transfer required: 
      	Group state: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      	Local state: 00000000-0000-0000-0000-000000000000:-1
      2024-12-03 18:32:55 2 [Note] WSREP: Server status change connected -> joiner
      2024-12-03 18:32:55 0 [Note] WSREP: Joiner monitor thread started to monitor
      2024-12-03 18:32:55 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:19097' --datadir '/dev/shm/var/4/mysqld.2/data/' --defaults-file '/dev/shm/var/4/my.cnf' --defaults-group-suffix '.2' --parent 36694 --progress 0 --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/4/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --co
      WSREP_SST: [INFO] rsync SST started on joiner (20241203 18:32:55.782)
      WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20241203 18:32:55.845)
      2024-12-03 18:32:55 2 [Note] WSREP: App waits SST: 1
      2024-12-03 18:32:55 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3
      2024-12-03 18:32:55 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:19096
      2024-12-03 18:32:55 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:19096
      2024-12-03 18:32:55 0 [Note] WSREP: Member 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) requested state transfer from '*any*'. Selected 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq)(SYNCED) as donor.
      2024-12-03 18:32:55 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2)
      2024-12-03 18:32:55 2 [Note] WSREP: Requesting state transfer: success, donor: 0
      2024-12-03 18:32:55 2 [Note] WSREP: Resetting GCache seqno map due to different histories.
      2024-12-03 18:32:55 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:57 0 [Note] WSREP: 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq): State transfer to 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) complete.
      2024-12-03 18:32:57 0 [Note] WSREP: Member 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) synced with group.
      WSREP_SST: [INFO] Galera co-ords from recovery: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2 0 (20241203 18:32:57.911)
      WSREP_SST: [INFO] rsync SST completed on joiner (20241203 18:32:57.913)
      WSREP_SST: [INFO] Joiner cleanup: rsync PID=36897, stunnel PID=0 (20241203 18:32:57.915)
      2024-12-03 18:32:58 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') turning message relay requesting off
      WSREP_SST: [INFO] Joiner cleanup done. (20241203 18:32:58.431)
      2024-12-03 18:32:58 0 [Note] WSREP: SST received
      2024-12-03 18:32:58 0 [Note] WSREP: Server status change joiner -> initializing
      2024-12-03 18:32:58 0 [Note] Plugin 'partition' is disabled.
      2024-12-03 18:32:58 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
      2024-12-03 18:32:58 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
      2024-12-03 18:32:58 0 [Note] InnoDB: Using transactional memory
      2024-12-03 18:32:58 0 [Note] InnoDB: Number of transaction pools: 1
      2024-12-03 18:32:58 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
      2024-12-03 18:32:58 0 [Note] InnoDB: Using Linux native AIO
      2024-12-03 18:32:58 0 [Note] InnoDB: Initializing buffer pool, total size = 8.000MiB, chunk size = 1.000MiB
      2024-12-03 18:32:58 0 [Note] InnoDB: Completed initialization of buffer pool
      2024-12-03 18:32:58 0 [Note] InnoDB: Buffered log writes (block size=512 bytes)
      2024-12-03 18:32:58 0 [Note] InnoDB: End of log at LSN=70551
      2024-12-03 18:32:58 0 [Note] InnoDB: Opened 3 undo tablespaces
      2024-12-03 18:32:58 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active.
      2024-12-03 18:32:58 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
      2024-12-03 18:32:58 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
      2024-12-03 18:32:58 0 [Note] InnoDB: log sequence number 70551; transaction id 33
      2024-12-03 18:32:58 0 [Note] InnoDB: Loading buffer pool(s) from /dev/shm/var/4/mysqld.2/data/ib_buffer_pool
      2024-12-03 18:32:58 0 [Note] Plugin 'SEQUENCE' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
      2024-12-03 18:32:58 0 [Note] InnoDB: Buffer pool(s) load completed at 241203 18:32:58
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_WAITS' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_QUEUES' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_CONNECTIONS' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'FEEDBACK' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_GROUPS' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'user_variables' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_STATS' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'unix_socket' is disabled.
      2024-12-03 18:32:58 0 [Note] Plugin 'wsrep_provider' is disabled.
      2024-12-03 18:32:58 0 [Warning] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: unknown option '--loose-pam-debug'
      2024-12-03 18:32:58 0 [Warning] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: unknown option '--loose-aria'
      2024-12-03 18:32:58 0 [Note] Server socket created on IP: '127.0.0.1'.
      2024-12-03 18:32:58 0 [Note] mariadbd: Event Scheduler: Loaded 0 events
      2024-12-03 18:32:58 0 [Note] WSREP: wsrep_init_schema_and_SR 0x0
      2024-12-03 18:32:58 0 [Note] WSREP: Server initialized
      2024-12-03 18:32:58 0 [Note] WSREP: Server status change initializing -> initialized
      2024-12-03 18:32:58 0 [Note] WSREP: Recovered position from storage: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:58 0 [Note] WSREP: Server status change initialized -> joined
      2024-12-03 18:32:58 0 [Note] WSREP: Recovered view from SST:
        id: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
        status: primary
        protocol_version: 4
        capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
        final: no
        own_index: 1
        members(2):
      	0: 02a327be-b1a5-11ef-9b1a-866161b3e031, jenkins-ubuntu-2004-amd64-build
      	1: 02dcf2cb-b1a5-11ef-b9da-16bac6199895, jenkins-ubuntu-2004-amd64-build
       
      2024-12-03 18:32:58 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2024-12-03 18:32:58 0 [Note] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: ready for connections.
      Version: '11.4.4-2-MariaDB-debug-log'  socket: '/dev/shm/var/tmp/4/mysqld.2.sock'  port: 19091  Source distribution
      2024-12-03 18:32:58 6 [Note] WSREP: Recovered cluster id 02a372e9-b1a5-11ef-873b-1a43a447f2b9
      2024-12-03 18:32:58 0 [Note] WSREP: SST received: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:58 0 [Note] WSREP: SST succeeded for position 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:58 0 [Note] WSREP: Joiner monitor thread ended with total time 3 sec
      2024-12-03 18:32:58 2 [Note] WSREP: Installed new state from SST: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:58 2 [Note] WSREP: Cert. index preload up to 2
      2024-12-03 18:32:58 0 [Note] WSREP: ####### IST applying starts with 3
      2024-12-03 18:32:58 0 [Note] WSREP: ####### IST current seqno initialized to 2
      2024-12-03 18:32:58 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete.
      2024-12-03 18:32:58 0 [Note] WSREP: IST preload starting at 2
      2024-12-03 18:32:58 0 [Note] WSREP: REPL Protocols: 11 (6)
      2024-12-03 18:32:58 0 [Note] WSREP: Service thread queue flushed.
      2024-12-03 18:32:58 0 [Note] WSREP: ####### Assign initial position for certification: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:1, protocol version: 6
      2024-12-03 18:32:58 0 [Note] WSREP: REPL Protocols: 11 (6)
      2024-12-03 18:32:58 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2
      2024-12-03 18:32:58 0 [Note] WSREP: Service thread queue flushed.
      2024-12-03 18:32:58 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 2
      2024-12-03 18:32:58 0 [Note] WSREP: Min available from gcache for CC from preload: 2
      2024-12-03 18:32:58 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete.
      2024-12-03 18:32:58 2 [Note] WSREP: IST received: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2
      2024-12-03 18:32:58 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 2
      2024-12-03 18:32:58 2 [Note] WSREP: Min available from gcache for CC from sst: 2
      2024-12-03 18:32:58 0 [Note] WSREP: 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq): State transfer from 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) complete.
      2024-12-03 18:32:58 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2)
      2024-12-03 18:32:58 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
      2024-12-03 18:32:58 0 [Note] WSREP: Member 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) synced with group.
      2024-12-03 18:32:58 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete.
      2024-12-03 18:32:58 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
      2024-12-03 18:32:58 2 [Note] WSREP: Server jenkins-ubuntu-2004-amd64-build-wcudpq synced with group
      2024-12-03 18:32:58 2 [Note] WSREP: Server status change joined -> synced
      2024-12-03 18:32:58 2 [Note] WSREP: Synchronized with group, ready for connections
      2024-12-03 18:32:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2024-12-03 18:33:02 10 [Note] WSREP: Starting applier thread 10
      2024-12-03 18:33:02 11 [Note] WSREP: Starting applier thread 11
      2024-12-03 18:33:02 12 [Note] WSREP: Starting applier thread 12
      mariadbd: /home/jenkins/workspace/Galera/Build-Galera-Package/galera-src/galera/src/replicator_smm.hpp:441: void galera::ReplicatorSMM::report_last_committed(wsrep_seqno_t): Assertion `purge_seqno <= last_committed()' failed.
      241203 18:33:03 [ERROR] mysqld got signal 6 ;
      Sorry, we probably made a mistake, and this is a bug.
       
      Your assistance in bug reporting will enable us to fix this for the next release.
      To report this bug, see https://mariadb.com/kb/en/reporting-bugs
       
      We will try our best to scrape up some info that will hopefully help
      diagnose the problem, but since we have already crashed, 
      something is definitely wrong and this may fail.
       
      Server version: 11.4.4-2-MariaDB-debug-log source revision: ac4964689cd52747976e1cd312d69af1e7675ce1
      key_buffer_size=1048576
      read_buffer_size=131072
      max_used_connections=1
      max_threads=153
      thread_count=6
      It is possible that mysqld could use up to 
      key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63995 K  bytes of memory
      Hope that's ok; if not, decrease some variables in the equation.
       
      WSREP: Suppressing further logging
      WSREP: Shutting down network communications
       
      Thread pointer: 0x7f6ca001c5a8
      Attempting backtrace. You can use the following information to find out
      where mysqld died. If you see no messages after this, something went
      terribly wrong...
      stack_bottom = 0x7f6cb005b000 thread_stack 0x49000
      mysys/stacktrace.c:215(my_print_stacktrace)[0x560316a4fe6b]
      sql/signal_handler.cc:247(handle_fatal_signal)[0x56031615e2af]
      sigaction.c:0(__restore_rt)[0x7f6ccd319420]
      addr2line: DWARF error: section .debug_info is larger than its filesize! (0x93f189 vs 0x531098)
      /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f6ccce0200b]
      /lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f6cccde1859]
      /lib/x86_64-linux-gnu/libc.so.6(+0x22729)[0x7f6cccde1729]
      /lib/x86_64-linux-gnu/libc.so.6(+0x33fd6)[0x7f6cccdf2fd6]
      src/replicator_smm.hpp:442(galera::ReplicatorSMM::report_last_committed(long))[0x7f6cc343780f]
      src/replicator_smm.cpp:563(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7f6cc341e985]
      src/replicator_smm.cpp:2155(galera::ReplicatorSMM::process_trx(void*, boost::shared_ptr<galera::TrxHandleSlave> const&))[0x7f6cc3428ba4]
      src/gcs_action_source.cpp:63(galera::GcsActionSource::process_writeset(void*, gcs_action const&, bool&))[0x7f6cc347e6ef]
      src/gcs_action_source.cpp:115(galera::GcsActionSource::dispatch(void*, gcs_action const&, bool&))[0x7f6cc347ee14]
      src/gcs_action_source.cpp:179(galera::GcsActionSource::process(void*, bool&))[0x7f6cc347f641]
      src/replicator_smm.cpp:404(galera::ReplicatorSMM::async_recv(void*))[0x7f6cc341daee]
      src/wsrep_provider.cpp:292(galera_recv)[0x7f6cc33f61f9]
      2024-12-03 18:33:03 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') turning message relay requesting on, nonlive peers: ssl://127.0.0.1:19092 
      src/wsrep_provider_v26.cpp:866(wsrep::wsrep_provider_v26::run_applier(wsrep::high_priority_service*))[0x560316b473ec]
      sql/wsrep_thd.cc:57(wsrep_replication_process(THD*, void*))[0x5603165581f4]
      sql/wsrep_mysqld.cc:4182(start_wsrep_THD(void*))[0x56031653c04d]
      perfschema/pfs.cc:2203(pfs_spawn_thread)[0x560316494261]
      nptl/pthread_create.c:478(start_thread)[0x7f6ccd30d609]
      addr2line: DWARF error: section .debug_info is larger than its filesize! (0x93f189 vs 0x531098)
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f6cccede353]
       
      Trying to get some variables.
      Some pointers may be invalid and cause the dump to abort.
      Query (0x0): (null)
      Connection ID (thread ID): 10
      Status: NOT_KILLED
       
      Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=on,cset_narrowing=off,sargable_casefold=on
       
      The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains
      information that should help you find out what is causing the crash.
       
      We think the query pointer is invalid, but we will try to print it anyway. 
      Query: 
       
      Writing a core file...
      Working directory at /dev/shm/var/4/mysqld.2/data
      Resource Limits:
      Limit                     Soft Limit           Hard Limit           Units     
      Max cpu time              unlimited            unlimited            seconds   
      Max file size             unlimited            unlimited            bytes     
      Max data size             unlimited            unlimited            bytes     
      Max stack size            8388608              unlimited            bytes     
      Max core file size        unlimited            unlimited            bytes     
      Max resident set          unlimited            unlimited            bytes     
      Max processes             128323               128323               processes 
      Max open files            1024                 1024                 files     
      Max locked memory         67108864             67108864             bytes     
      Max address space         unlimited            unlimited            bytes     
      Max file locks            unlimited            unlimited            locks     
      Max pending signals       128323               128323               signals   
      Max msgqueue size         819200               819200               bytes     
      Max nice priority         0                    0                    
      Max realtime priority     0                    0                    
      Max realtime timeout      unlimited            unlimited            us        
      Core pattern: |/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E
       
      Kernel version: Linux version 5.15.0-1066-gcp (buildd@lcy02-amd64-005) (gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #74~20.04.1-Ubuntu SMP Fri Jul 26 09:28:41 UTC 2024
       
      ----------SERVER LOG END-------------
      mysqltest failed but provided no output
      The result from queries just before the failure was:
      < snip >
      connection node_1;
      CREATE TABLE ten (f1 INTEGER) Engine=InnoDB;
      INSERT INTO ten VALUES (1),(2),(3),(4),(5),(6),(7),(8),(9),(10);
      CREATE TABLE t1 (f1 INTEGER AUTO_INCREMENT PRIMARY KEY, f2 INTEGER) Engine=InnoDB;
      connection node_2;
      set session wsrep_sync_wait=15;
      SET GLOBAL wsrep_slave_threads = 4;
      connection node_1;
      CREATE PROCEDURE p1 (repeat_count int)
      BEGIN
      DECLARE current_num int;
      SET current_num = 0;
      WHILE current_num < repeat_count do
      INSERT INTO t1 (f2) SELECT 1 FROM ten AS a1;
      COMMIT;
      SET current_num = current_num + 1;
      END WHILE;
      END|
      call p1(1000);
      connection node_1;
       
       
       
       - saving '/dev/shm/var/4/log/galera.galera_parallel_autoinc_manytrx/' to '/dev/shm/var/log/galera.galera_parallel_autoinc_manytrx/'
       
      Retrying test galera.galera_parallel_autoinc_manytrx, attempt(2/2)...
       
      worker[04] > Restart  - not started
      worker[04] > Restart  - not started
      ***Warnings generated in error logs during shutdown after running tests: galera.galera_parallel_autoinc_manytrx
       
      mariadbd: /home/jenkins/workspace/Galera/Build-Galera-Package/galera-src/galera/src/replicator_smm.hpp:441: void galera::ReplicatorSMM::report_last_committed(wsrep_seqno_t): Assertion `purge_seqno <= last_committed()' failed.
      Attempting backtrace. You can use the following information to find out

      Attachments

        Activity

          • Tested with 11.4-enterprise commit 79bfedaf1 and could not reproduce easily-
          • Also tested with 11.4 commit 9e7762e71 could not reproduce easily.

          jan@jan-ThinkPad-P1-Gen-6:~/work/mariadb/11.4-enterprise/mysql-test$ ./mtr galera.galera_parallel_autoinc_manytrx --repeat=50
          Logging: ./mtr  galera.galera_parallel_autoinc_manytrx --repeat=50
          VS config: 
          vardir: /home/jan/work/mariadb/11.4-enterprise/mysql-test/var
          Removing old var directory...
           - WARNING: Using the 'mysql-test/var' symlink
          The destination for symlink /home/jan/work/mariadb/11.4-enterprise/mysql-test/var does not exist; Removing it and creating a new var directory
          Creating var directory '/home/jan/work/mariadb/11.4-enterprise/mysql-test/var'...
          Checking supported features...
          MariaDB Version 11.4.4-2-MariaDB-debug
           - SSL connections supported
           - binaries are debug compiled
           - binaries built with wsrep patch
          Collecting tests...
          Installing system database...
           
          ==============================================================================
           
          TEST                                      RESULT   TIME (ms) or COMMENT
          --------------------------------------------------------------------------
           
          worker[01] Using MTR_BUILD_THREAD 300, with reserved ports 19000..19029
          galera.galera_parallel_autoinc_manytrx   [ pass ]   8050
          galera.galera_parallel_autoinc_manytrx   [ 2 pass ]   7872
          galera.galera_parallel_autoinc_manytrx   [ 3 pass ]   7965
          galera.galera_parallel_autoinc_manytrx   [ 4 pass ]   7828
          galera.galera_parallel_autoinc_manytrx   [ 5 pass ]   7903
          galera.galera_parallel_autoinc_manytrx   [ 6 pass ]   7828
          galera.galera_parallel_autoinc_manytrx   [ 7 pass ]   7999
          galera.galera_parallel_autoinc_manytrx   [ 8 pass ]   8099
          galera.galera_parallel_autoinc_manytrx   [ 9 pass ]   8157
          galera.galera_parallel_autoinc_manytrx   [ 10 pass ]   7983
          galera.galera_parallel_autoinc_manytrx   [ 11 pass ]   8119
          galera.galera_parallel_autoinc_manytrx   [ 12 pass ]   8175
          galera.galera_parallel_autoinc_manytrx   [ 13 pass ]   7765
          galera.galera_parallel_autoinc_manytrx   [ 14 pass ]   7957
          galera.galera_parallel_autoinc_manytrx   [ 15 pass ]   7861
          galera.galera_parallel_autoinc_manytrx   [ 16 pass ]   8035
          galera.galera_parallel_autoinc_manytrx   [ 17 pass ]   8186
          galera.galera_parallel_autoinc_manytrx   [ 18 pass ]   8255
          galera.galera_parallel_autoinc_manytrx   [ 19 pass ]   7840
          galera.galera_parallel_autoinc_manytrx   [ 20 pass ]   7975
          galera.galera_parallel_autoinc_manytrx   [ 21 pass ]   7810
          galera.galera_parallel_autoinc_manytrx   [ 22 pass ]   7950
          galera.galera_parallel_autoinc_manytrx   [ 23 pass ]   8131
          galera.galera_parallel_autoinc_manytrx   [ 24 pass ]   8016
          galera.galera_parallel_autoinc_manytrx   [ 25 pass ]   7890
          galera.galera_parallel_autoinc_manytrx   [ 26 pass ]   7911
          galera.galera_parallel_autoinc_manytrx   [ 27 pass ]   7949
          galera.galera_parallel_autoinc_manytrx   [ 28 pass ]   8135
          galera.galera_parallel_autoinc_manytrx   [ 29 pass ]   7985
          galera.galera_parallel_autoinc_manytrx   [ 30 pass ]   7892
          galera.galera_parallel_autoinc_manytrx   [ 31 pass ]   7762
          galera.galera_parallel_autoinc_manytrx   [ 32 pass ]   7730
          galera.galera_parallel_autoinc_manytrx   [ 33 pass ]   7750
          galera.galera_parallel_autoinc_manytrx   [ 34 pass ]   7956
          galera.galera_parallel_autoinc_manytrx   [ 35 pass ]   7847
          galera.galera_parallel_autoinc_manytrx   [ 36 pass ]   7902
          galera.galera_parallel_autoinc_manytrx   [ 37 pass ]   7882
          galera.galera_parallel_autoinc_manytrx   [ 38 pass ]   7805
          galera.galera_parallel_autoinc_manytrx   [ 39 pass ]   7957
          galera.galera_parallel_autoinc_manytrx   [ 40 pass ]   7835
          galera.galera_parallel_autoinc_manytrx   [ 41 pass ]   7925
          galera.galera_parallel_autoinc_manytrx   [ 42 pass ]   7931
          galera.galera_parallel_autoinc_manytrx   [ 43 pass ]   7885
          galera.galera_parallel_autoinc_manytrx   [ 44 pass ]   8100
          galera.galera_parallel_autoinc_manytrx   [ 45 pass ]   7693
          galera.galera_parallel_autoinc_manytrx   [ 46 pass ]   8063
          galera.galera_parallel_autoinc_manytrx   [ 47 pass ]   7982
          galera.galera_parallel_autoinc_manytrx   [ 48 pass ]   8112
          galera.galera_parallel_autoinc_manytrx   [ 49 pass ]   8030
          galera.galera_parallel_autoinc_manytrx   [ 50 pass ]   7890
          --------------------------------------------------------------------------
          The servers were restarted 1 times
          Spent 397.558 of 1641 seconds executing testcases
           
          Completed: All 50 tests were successful.
          

          janlindstrom Jan Lindström added a comment - Tested with 11.4-enterprise commit 79bfedaf1 and could not reproduce easily- Also tested with 11.4 commit 9e7762e71 could not reproduce easily. jan@jan-ThinkPad-P1-Gen-6:~/work/mariadb/11.4-enterprise/mysql-test$ ./mtr galera.galera_parallel_autoinc_manytrx --repeat=50 Logging: ./mtr galera.galera_parallel_autoinc_manytrx --repeat=50 VS config: vardir: /home/jan/work/mariadb/11.4-enterprise/mysql-test/var Removing old var directory... - WARNING: Using the 'mysql-test/var' symlink The destination for symlink /home/jan/work/mariadb/11.4-enterprise/mysql-test/var does not exist; Removing it and creating a new var directory Creating var directory '/home/jan/work/mariadb/11.4-enterprise/mysql-test/var'... Checking supported features... MariaDB Version 11.4.4-2-MariaDB-debug - SSL connections supported - binaries are debug compiled - binaries built with wsrep patch Collecting tests... Installing system database...   ==============================================================================   TEST RESULT TIME (ms) or COMMENT --------------------------------------------------------------------------   worker[01] Using MTR_BUILD_THREAD 300, with reserved ports 19000..19029 galera.galera_parallel_autoinc_manytrx [ pass ] 8050 galera.galera_parallel_autoinc_manytrx [ 2 pass ] 7872 galera.galera_parallel_autoinc_manytrx [ 3 pass ] 7965 galera.galera_parallel_autoinc_manytrx [ 4 pass ] 7828 galera.galera_parallel_autoinc_manytrx [ 5 pass ] 7903 galera.galera_parallel_autoinc_manytrx [ 6 pass ] 7828 galera.galera_parallel_autoinc_manytrx [ 7 pass ] 7999 galera.galera_parallel_autoinc_manytrx [ 8 pass ] 8099 galera.galera_parallel_autoinc_manytrx [ 9 pass ] 8157 galera.galera_parallel_autoinc_manytrx [ 10 pass ] 7983 galera.galera_parallel_autoinc_manytrx [ 11 pass ] 8119 galera.galera_parallel_autoinc_manytrx [ 12 pass ] 8175 galera.galera_parallel_autoinc_manytrx [ 13 pass ] 7765 galera.galera_parallel_autoinc_manytrx [ 14 pass ] 7957 galera.galera_parallel_autoinc_manytrx [ 15 pass ] 7861 galera.galera_parallel_autoinc_manytrx [ 16 pass ] 8035 galera.galera_parallel_autoinc_manytrx [ 17 pass ] 8186 galera.galera_parallel_autoinc_manytrx [ 18 pass ] 8255 galera.galera_parallel_autoinc_manytrx [ 19 pass ] 7840 galera.galera_parallel_autoinc_manytrx [ 20 pass ] 7975 galera.galera_parallel_autoinc_manytrx [ 21 pass ] 7810 galera.galera_parallel_autoinc_manytrx [ 22 pass ] 7950 galera.galera_parallel_autoinc_manytrx [ 23 pass ] 8131 galera.galera_parallel_autoinc_manytrx [ 24 pass ] 8016 galera.galera_parallel_autoinc_manytrx [ 25 pass ] 7890 galera.galera_parallel_autoinc_manytrx [ 26 pass ] 7911 galera.galera_parallel_autoinc_manytrx [ 27 pass ] 7949 galera.galera_parallel_autoinc_manytrx [ 28 pass ] 8135 galera.galera_parallel_autoinc_manytrx [ 29 pass ] 7985 galera.galera_parallel_autoinc_manytrx [ 30 pass ] 7892 galera.galera_parallel_autoinc_manytrx [ 31 pass ] 7762 galera.galera_parallel_autoinc_manytrx [ 32 pass ] 7730 galera.galera_parallel_autoinc_manytrx [ 33 pass ] 7750 galera.galera_parallel_autoinc_manytrx [ 34 pass ] 7956 galera.galera_parallel_autoinc_manytrx [ 35 pass ] 7847 galera.galera_parallel_autoinc_manytrx [ 36 pass ] 7902 galera.galera_parallel_autoinc_manytrx [ 37 pass ] 7882 galera.galera_parallel_autoinc_manytrx [ 38 pass ] 7805 galera.galera_parallel_autoinc_manytrx [ 39 pass ] 7957 galera.galera_parallel_autoinc_manytrx [ 40 pass ] 7835 galera.galera_parallel_autoinc_manytrx [ 41 pass ] 7925 galera.galera_parallel_autoinc_manytrx [ 42 pass ] 7931 galera.galera_parallel_autoinc_manytrx [ 43 pass ] 7885 galera.galera_parallel_autoinc_manytrx [ 44 pass ] 8100 galera.galera_parallel_autoinc_manytrx [ 45 pass ] 7693 galera.galera_parallel_autoinc_manytrx [ 46 pass ] 8063 galera.galera_parallel_autoinc_manytrx [ 47 pass ] 7982 galera.galera_parallel_autoinc_manytrx [ 48 pass ] 8112 galera.galera_parallel_autoinc_manytrx [ 49 pass ] 8030 galera.galera_parallel_autoinc_manytrx [ 50 pass ] 7890 -------------------------------------------------------------------------- The servers were restarted 1 times Spent 397.558 of 1641 seconds executing testcases   Completed: All 50 tests were successful.

          Tested with both 26.4.21 and 26.4.20 Galera library versions but could not reproduce.

          janlindstrom Jan Lindström added a comment - Tested with both 26.4.21 and 26.4.20 Galera library versions but could not reproduce.

          People

            sysprg Julius Goryavsky
            sysprg Julius Goryavsky
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.