Assertion `purge_seqno <= last_committed()' failed in galera_parallel_autoinc_manytrx

galera.galera_parallel_autoinc_manytrx   w4 [ fail ]

        Test ended at 2024-12-03 18:33:13

CURRENT_TEST: galera.galera_parallel_autoinc_manytrx

Server [mysqld.2 - pid: 36693, winpid: 36693, exit: 256] failed during test run

Server log from this test:

----------SERVER LOG START-----------

$ /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/4/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300

2024-12-03 18:32:54 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 32190)

2024-12-03 18:32:54 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)

2024-12-03 18:32:54 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:19097' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members.

2024-12-03 18:32:54 0 [Note] slave_connections_needed_for_purge changed to 0 because of Galera. Change it to 1 or higher if this Galera node is also Master in a normal replication setup

2024-12-03 18:32:54 0 [Note] Starting MariaDB 11.4.4-2-MariaDB-debug-log source revision ac4964689cd52747976e1cd312d69af1e7675ce1 server_uid QQMtiQFC0raKdmr+HKZfky+6tOI= as process 36694

2024-12-03 18:32:54 0 [Note] WSREP: Using server side SSL for provider connections

2024-12-03 18:32:54 0 [Note] WSREP: Loading provider /home/jenkins/workspace/Source-Build-Test/libgalera_enterprise_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1

2024-12-03 18:32:54 0 [Note] WSREP: wsrep_load(): loading provider library '/home/jenkins/workspace/Source-Build-Test/libgalera_enterprise_smm.so'

2024-12-03 18:32:54 0 [Note] WSREP: wsrep_load(): Galera 26.4.20-1(r5f861d4) by Codership Oy <info@codership.com> loaded successfully.

2024-12-03 18:32:54 0 [Note] WSREP: Initializing thread service v1

2024-12-03 18:32:54 0 [Note] WSREP: Initializing tls service v1

2024-12-03 18:32:54 0 [Note] WSREP: Initializing allowlist service v1

2024-12-03 18:32:54 0 [Note] WSREP: Initializing event service v1

2024-12-03 18:32:54 0 [Note] WSREP: Resolved symbol 'wsrep_node_isolation_mode_set_v1'

2024-12-03 18:32:54 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.

2024-12-03 18:32:54 0 [Warning] WSREP: Could not open state file for reading: '/dev/shm/var/4/mysqld.2/data//grastate.dat'

2024-12-03 18:32:54 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1

2024-12-03 18:32:54 0 [Note] WSREP: GCache DEBUG: opened preamble:

Version: 0

UUID: 00000000-0000-0000-0000-000000000000

Seqno: -1 - -1

Offset: -1

Synced: 0

2024-12-03 18:32:54 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID.

2024-12-03 18:32:54 0 [Note] WSREP: Passing config to GCS: base_dir = /dev/shm/var/4/mysqld.2/data/; base_host = 127.0.0.1; base_port = 19095; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /dev/shm/var/4/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 922337203

2024-12-03 18:32:54 0 [Note] WSREP: Start replication

2024-12-03 18:32:54 0 [Note] WSREP: Connecting with bootstrap option: 0

2024-12-03 18:32:54 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1

2024-12-03 18:32:54 0 [Note] WSREP: protonet asio version 0

2024-12-03 18:32:54 0 [Note] WSREP: Using CRC-32C for message checksums.

2024-12-03 18:32:54 0 [Note] WSREP: backend: asio

2024-12-03 18:32:54 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 

2024-12-03 18:32:54 0 [Note] WSREP: access file(/dev/shm/var/4/mysqld.2/data//gvwstate.dat) failed(No such file or directory)

2024-12-03 18:32:54 0 [Note] WSREP: restore pc from disk failed

2024-12-03 18:32:54 0 [Note] WSREP: GMCast version 0

2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') listening at ssl://0.0.0.0:19095

2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') multicast: , ttl: 1

2024-12-03 18:32:54 0 [Note] WSREP: EVS version 1

2024-12-03 18:32:54 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:19092'

2024-12-03 18:32:54 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') connection established to 02a327be-9b1a ssl://127.0.0.1:19092

2024-12-03 18:32:55 0 [Note] WSREP: EVS version upgrade 0 -> 1

2024-12-03 18:32:55 0 [Note] WSREP: declaring 02a327be-9b1a at ssl://127.0.0.1:19092 stable

2024-12-03 18:32:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1

2024-12-03 18:32:55 0 [Note] WSREP: Node 02a327be-9b1a state prim

2024-12-03 18:32:55 0 [Note] WSREP: view(view_id(PRIM,02a327be-9b1a,2) memb {

	02a327be-9b1a,0

	02dcf2cb-b9da,0

} joined {

} left {

} partitioned {

})

2024-12-03 18:32:55 0 [Note] WSREP: save pc into disk

2024-12-03 18:32:55 0 [Note] WSREP: gcomm: connected

2024-12-03 18:32:55 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636

2024-12-03 18:32:55 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)

2024-12-03 18:32:55 0 [Note] WSREP: Opened channel 'my_wsrep_cluster'

2024-12-03 18:32:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2

2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.

2024-12-03 18:32:55 0 [Note] WSREP: Initializing config service v1

2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0329d233-b1a5-11ef-be52-1b870d292dad

2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0329d233-b1a5-11ef-be52-1b870d292dad from 0 (jenkins-ubuntu-2004-amd64-build-wcudpq)

2024-12-03 18:32:55 1 [Note] WSREP: Starting rollbacker thread 1

2024-12-03 18:32:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0329d233-b1a5-11ef-be52-1b870d292dad from 1 (jenkins-ubuntu-2004-amd64-build-wcudpq)

2024-12-03 18:32:55 0 [Note] WSREP: Quorum results:

	version    = 6,

	component  = PRIMARY,

	conf_id    = 1,

	members    = 1/2 (joined/total),

	act_id     = 1,

	last_appl. = 0,

	protocols  = 4/11/4 (gcs/repl/appl),

	vote policy= 0,

	group UUID = 02a372e9-b1a5-11ef-873b-1a43a447f2b9

2024-12-03 18:32:55 0 [Note] WSREP: Flow-control interval: [23, 23]

2024-12-03 18:32:55 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2)

2024-12-03 18:32:55 2 [Note] WSREP: Starting applier thread 2

2024-12-03 18:32:55 2 [Note] WSREP: ####### processing CC 2, local, ordered

2024-12-03 18:32:55 2 [Note] WSREP: Process first view: 02a372e9-b1a5-11ef-873b-1a43a447f2b9 my uuid: 02dcf2cb-b1a5-11ef-b9da-16bac6199895

2024-12-03 18:32:55 2 [Note] WSREP: Server jenkins-ubuntu-2004-amd64-build-wcudpq connected to cluster at position 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2 with ID 02dcf2cb-b1a5-11ef-b9da-16bac6199895

2024-12-03 18:32:55 0 [Note] WSREP: Deinitializing config service v1

2024-12-03 18:32:55 2 [Note] WSREP: Server status change disconnected -> connected

2024-12-03 18:32:55 2 [Note] WSREP: ####### My UUID: 02dcf2cb-b1a5-11ef-b9da-16bac6199895

2024-12-03 18:32:55 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes

2024-12-03 18:32:55 0 [Note] WSREP: Service thread queue flushed.

2024-12-03 18:32:55 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1

2024-12-03 18:32:55 2 [Note] WSREP: State transfer required: 

	Group state: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

	Local state: 00000000-0000-0000-0000-000000000000:-1

2024-12-03 18:32:55 2 [Note] WSREP: Server status change connected -> joiner

2024-12-03 18:32:55 0 [Note] WSREP: Joiner monitor thread started to monitor

2024-12-03 18:32:55 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:19097' --datadir '/dev/shm/var/4/mysqld.2/data/' --defaults-file '/dev/shm/var/4/my.cnf' --defaults-group-suffix '.2' --parent 36694 --progress 0 --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/4/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --co

WSREP_SST: [INFO] rsync SST started on joiner (20241203 18:32:55.782)

WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20241203 18:32:55.845)

2024-12-03 18:32:55 2 [Note] WSREP: App waits SST: 1

2024-12-03 18:32:55 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3

2024-12-03 18:32:55 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:19096

2024-12-03 18:32:55 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:19096

2024-12-03 18:32:55 0 [Note] WSREP: Member 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) requested state transfer from '*any*'. Selected 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq)(SYNCED) as donor.

2024-12-03 18:32:55 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2)

2024-12-03 18:32:55 2 [Note] WSREP: Requesting state transfer: success, donor: 0

2024-12-03 18:32:55 2 [Note] WSREP: Resetting GCache seqno map due to different histories.

2024-12-03 18:32:55 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:57 0 [Note] WSREP: 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq): State transfer to 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) complete.

2024-12-03 18:32:57 0 [Note] WSREP: Member 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) synced with group.

WSREP_SST: [INFO] Galera co-ords from recovery: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2 0 (20241203 18:32:57.911)

WSREP_SST: [INFO] rsync SST completed on joiner (20241203 18:32:57.913)

WSREP_SST: [INFO] Joiner cleanup: rsync PID=36897, stunnel PID=0 (20241203 18:32:57.915)

2024-12-03 18:32:58 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') turning message relay requesting off

WSREP_SST: [INFO] Joiner cleanup done. (20241203 18:32:58.431)

2024-12-03 18:32:58 0 [Note] WSREP: SST received

2024-12-03 18:32:58 0 [Note] WSREP: Server status change joiner -> initializing

2024-12-03 18:32:58 0 [Note] Plugin 'partition' is disabled.

2024-12-03 18:32:58 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!

2024-12-03 18:32:58 0 [Note] InnoDB: Compressed tables use zlib 1.2.11

2024-12-03 18:32:58 0 [Note] InnoDB: Using transactional memory

2024-12-03 18:32:58 0 [Note] InnoDB: Number of transaction pools: 1

2024-12-03 18:32:58 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions

2024-12-03 18:32:58 0 [Note] InnoDB: Using Linux native AIO

2024-12-03 18:32:58 0 [Note] InnoDB: Initializing buffer pool, total size = 8.000MiB, chunk size = 1.000MiB

2024-12-03 18:32:58 0 [Note] InnoDB: Completed initialization of buffer pool

2024-12-03 18:32:58 0 [Note] InnoDB: Buffered log writes (block size=512 bytes)

2024-12-03 18:32:58 0 [Note] InnoDB: End of log at LSN=70551

2024-12-03 18:32:58 0 [Note] InnoDB: Opened 3 undo tablespaces

2024-12-03 18:32:58 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active.

2024-12-03 18:32:58 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...

2024-12-03 18:32:58 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.

2024-12-03 18:32:58 0 [Note] InnoDB: log sequence number 70551; transaction id 33

2024-12-03 18:32:58 0 [Note] InnoDB: Loading buffer pool(s) from /dev/shm/var/4/mysqld.2/data/ib_buffer_pool

2024-12-03 18:32:58 0 [Note] Plugin 'SEQUENCE' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.

2024-12-03 18:32:58 0 [Note] InnoDB: Buffer pool(s) load completed at 241203 18:32:58

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_WAITS' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_QUEUES' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_CONNECTIONS' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'FEEDBACK' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_GROUPS' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'user_variables' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'THREAD_POOL_STATS' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'unix_socket' is disabled.

2024-12-03 18:32:58 0 [Note] Plugin 'wsrep_provider' is disabled.

2024-12-03 18:32:58 0 [Warning] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: unknown option '--loose-pam-debug'

2024-12-03 18:32:58 0 [Warning] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: unknown option '--loose-aria'

2024-12-03 18:32:58 0 [Note] Server socket created on IP: '127.0.0.1'.

2024-12-03 18:32:58 0 [Note] mariadbd: Event Scheduler: Loaded 0 events

2024-12-03 18:32:58 0 [Note] WSREP: wsrep_init_schema_and_SR 0x0

2024-12-03 18:32:58 0 [Note] WSREP: Server initialized

2024-12-03 18:32:58 0 [Note] WSREP: Server status change initializing -> initialized

2024-12-03 18:32:58 0 [Note] WSREP: Recovered position from storage: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:58 0 [Note] WSREP: Server status change initialized -> joined

2024-12-03 18:32:58 0 [Note] WSREP: Recovered view from SST:

  id: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

  status: primary

  protocol_version: 4

  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

  final: no

  own_index: 1

  members(2):

	0: 02a327be-b1a5-11ef-9b1a-866161b3e031, jenkins-ubuntu-2004-amd64-build

	1: 02dcf2cb-b1a5-11ef-b9da-16bac6199895, jenkins-ubuntu-2004-amd64-build

2024-12-03 18:32:58 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

2024-12-03 18:32:58 0 [Note] /home/jenkins/workspace/Source-Build-Test/src/sql/mariadbd: ready for connections.

Version: '11.4.4-2-MariaDB-debug-log'  socket: '/dev/shm/var/tmp/4/mysqld.2.sock'  port: 19091  Source distribution

2024-12-03 18:32:58 6 [Note] WSREP: Recovered cluster id 02a372e9-b1a5-11ef-873b-1a43a447f2b9

2024-12-03 18:32:58 0 [Note] WSREP: SST received: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:58 0 [Note] WSREP: SST succeeded for position 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:58 0 [Note] WSREP: Joiner monitor thread ended with total time 3 sec

2024-12-03 18:32:58 2 [Note] WSREP: Installed new state from SST: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:58 2 [Note] WSREP: Cert. index preload up to 2

2024-12-03 18:32:58 0 [Note] WSREP: ####### IST applying starts with 3

2024-12-03 18:32:58 0 [Note] WSREP: ####### IST current seqno initialized to 2

2024-12-03 18:32:58 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete.

2024-12-03 18:32:58 0 [Note] WSREP: IST preload starting at 2

2024-12-03 18:32:58 0 [Note] WSREP: REPL Protocols: 11 (6)

2024-12-03 18:32:58 0 [Note] WSREP: Service thread queue flushed.

2024-12-03 18:32:58 0 [Note] WSREP: ####### Assign initial position for certification: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:1, protocol version: 6

2024-12-03 18:32:58 0 [Note] WSREP: REPL Protocols: 11 (6)

2024-12-03 18:32:58 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2

2024-12-03 18:32:58 0 [Note] WSREP: Service thread queue flushed.

2024-12-03 18:32:58 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 2

2024-12-03 18:32:58 0 [Note] WSREP: Min available from gcache for CC from preload: 2

2024-12-03 18:32:58 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete.

2024-12-03 18:32:58 2 [Note] WSREP: IST received: 02a372e9-b1a5-11ef-873b-1a43a447f2b9:2

2024-12-03 18:32:58 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 2

2024-12-03 18:32:58 2 [Note] WSREP: Min available from gcache for CC from sst: 2

2024-12-03 18:32:58 0 [Note] WSREP: 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq): State transfer from 0.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) complete.

2024-12-03 18:32:58 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2)

2024-12-03 18:32:58 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.

2024-12-03 18:32:58 0 [Note] WSREP: Member 1.0 (jenkins-ubuntu-2004-amd64-build-wcudpq) synced with group.

2024-12-03 18:32:58 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete.

2024-12-03 18:32:58 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)

2024-12-03 18:32:58 2 [Note] WSREP: Server jenkins-ubuntu-2004-amd64-build-wcudpq synced with group

2024-12-03 18:32:58 2 [Note] WSREP: Server status change joined -> synced

2024-12-03 18:32:58 2 [Note] WSREP: Synchronized with group, ready for connections

2024-12-03 18:32:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

2024-12-03 18:33:02 10 [Note] WSREP: Starting applier thread 10

2024-12-03 18:33:02 11 [Note] WSREP: Starting applier thread 11

2024-12-03 18:33:02 12 [Note] WSREP: Starting applier thread 12

mariadbd: /home/jenkins/workspace/Galera/Build-Galera-Package/galera-src/galera/src/replicator_smm.hpp:441: void galera::ReplicatorSMM::report_last_committed(wsrep_seqno_t): Assertion `purge_seqno <= last_committed()' failed.

241203 18:33:03 [ERROR] mysqld got signal 6 ;

Sorry, we probably made a mistake, and this is a bug.

Your assistance in bug reporting will enable us to fix this for the next release.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help

diagnose the problem, but since we have already crashed, 

something is definitely wrong and this may fail.

Server version: 11.4.4-2-MariaDB-debug-log source revision: ac4964689cd52747976e1cd312d69af1e7675ce1

key_buffer_size=1048576

read_buffer_size=131072

max_used_connections=1

max_threads=153

thread_count=6

It is possible that mysqld could use up to 

key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63995 K  bytes of memory

Hope that's ok; if not, decrease some variables in the equation.

WSREP: Suppressing further logging

WSREP: Shutting down network communications

Thread pointer: 0x7f6ca001c5a8

Attempting backtrace. You can use the following information to find out

where mysqld died. If you see no messages after this, something went

terribly wrong...

stack_bottom = 0x7f6cb005b000 thread_stack 0x49000

mysys/stacktrace.c:215(my_print_stacktrace)[0x560316a4fe6b]

sql/signal_handler.cc:247(handle_fatal_signal)[0x56031615e2af]

sigaction.c:0(__restore_rt)[0x7f6ccd319420]

addr2line: DWARF error: section .debug_info is larger than its filesize! (0x93f189 vs 0x531098)

/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f6ccce0200b]

/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f6cccde1859]

/lib/x86_64-linux-gnu/libc.so.6(+0x22729)[0x7f6cccde1729]

/lib/x86_64-linux-gnu/libc.so.6(+0x33fd6)[0x7f6cccdf2fd6]

src/replicator_smm.hpp:442(galera::ReplicatorSMM::report_last_committed(long))[0x7f6cc343780f]

src/replicator_smm.cpp:563(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7f6cc341e985]

src/replicator_smm.cpp:2155(galera::ReplicatorSMM::process_trx(void*, boost::shared_ptr<galera::TrxHandleSlave> const&))[0x7f6cc3428ba4]

src/gcs_action_source.cpp:63(galera::GcsActionSource::process_writeset(void*, gcs_action const&, bool&))[0x7f6cc347e6ef]

src/gcs_action_source.cpp:115(galera::GcsActionSource::dispatch(void*, gcs_action const&, bool&))[0x7f6cc347ee14]

src/gcs_action_source.cpp:179(galera::GcsActionSource::process(void*, bool&))[0x7f6cc347f641]

src/replicator_smm.cpp:404(galera::ReplicatorSMM::async_recv(void*))[0x7f6cc341daee]

src/wsrep_provider.cpp:292(galera_recv)[0x7f6cc33f61f9]

2024-12-03 18:33:03 0 [Note] WSREP: (02dcf2cb-b9da, 'ssl://0.0.0.0:19095') turning message relay requesting on, nonlive peers: ssl://127.0.0.1:19092 

src/wsrep_provider_v26.cpp:866(wsrep::wsrep_provider_v26::run_applier(wsrep::high_priority_service*))[0x560316b473ec]

sql/wsrep_thd.cc:57(wsrep_replication_process(THD*, void*))[0x5603165581f4]

sql/wsrep_mysqld.cc:4182(start_wsrep_THD(void*))[0x56031653c04d]

perfschema/pfs.cc:2203(pfs_spawn_thread)[0x560316494261]

nptl/pthread_create.c:478(start_thread)[0x7f6ccd30d609]

addr2line: DWARF error: section .debug_info is larger than its filesize! (0x93f189 vs 0x531098)

/lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f6cccede353]

Trying to get some variables.

Some pointers may be invalid and cause the dump to abort.

Query (0x0): (null)

Connection ID (thread ID): 10

Status: NOT_KILLED

Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=on,cset_narrowing=off,sargable_casefold=on

The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains

information that should help you find out what is causing the crash.

We think the query pointer is invalid, but we will try to print it anyway. 

Query: 

Writing a core file...

Working directory at /dev/shm/var/4/mysqld.2/data

Resource Limits:

Limit                     Soft Limit           Hard Limit           Units     

Max cpu time              unlimited            unlimited            seconds   

Max file size             unlimited            unlimited            bytes     

Max data size             unlimited            unlimited            bytes     

Max stack size            8388608              unlimited            bytes     

Max core file size        unlimited            unlimited            bytes     

Max resident set          unlimited            unlimited            bytes     

Max processes             128323               128323               processes 

Max open files            1024                 1024                 files     

Max locked memory         67108864             67108864             bytes     

Max address space         unlimited            unlimited            bytes     

Max file locks            unlimited            unlimited            locks     

Max pending signals       128323               128323               signals   

Max msgqueue size         819200               819200               bytes     

Max nice priority         0                    0                    

Max realtime priority     0                    0                    

Max realtime timeout      unlimited            unlimited            us        

Core pattern: |/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E

Kernel version: Linux version 5.15.0-1066-gcp (buildd@lcy02-amd64-005) (gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #74~20.04.1-Ubuntu SMP Fri Jul 26 09:28:41 UTC 2024

----------SERVER LOG END-------------

mysqltest failed but provided no output

The result from queries just before the failure was:

< snip >

connection node_1;

CREATE TABLE ten (f1 INTEGER) Engine=InnoDB;

INSERT INTO ten VALUES (1),(2),(3),(4),(5),(6),(7),(8),(9),(10);

CREATE TABLE t1 (f1 INTEGER AUTO_INCREMENT PRIMARY KEY, f2 INTEGER) Engine=InnoDB;

connection node_2;

set session wsrep_sync_wait=15;

SET GLOBAL wsrep_slave_threads = 4;

connection node_1;

CREATE PROCEDURE p1 (repeat_count int)

BEGIN

DECLARE current_num int;

SET current_num = 0;

WHILE current_num < repeat_count do

INSERT INTO t1 (f2) SELECT 1 FROM ten AS a1;

COMMIT;

SET current_num = current_num + 1;

END WHILE;

END|

call p1(1000);

connection node_1;

 - saving '/dev/shm/var/4/log/galera.galera_parallel_autoinc_manytrx/' to '/dev/shm/var/log/galera.galera_parallel_autoinc_manytrx/'

Retrying test galera.galera_parallel_autoinc_manytrx, attempt(2/2)...

worker[04] > Restart  - not started

worker[04] > Restart  - not started

***Warnings generated in error logs during shutdown after running tests: galera.galera_parallel_autoinc_manytrx

mariadbd: /home/jenkins/workspace/Galera/Build-Galera-Package/galera-src/galera/src/replicator_smm.hpp:441: void galera::ReplicatorSMM::report_last_committed(wsrep_seqno_t): Assertion `purge_seqno <= last_committed()' failed.

Attempting backtrace. You can use the following information to find out