[MDEV-23559] Galera LeakSanitizer: detected memory leaks in galera.GAL-419 Created: 2020-08-24  Updated: 2020-10-30  Resolved: 2020-10-30

Status: Closed
Project: MariaDB Server
Component/s: Galera
Affects Version/s: 10.4, 10.5
Fix Version/s: 10.4.16, 10.5.7, 10.6.0

Type: Bug Priority: Major
Reporter: Jan Lindström (Inactive) Assignee: Jan Lindström (Inactive)
Resolution: Fixed Votes: 0
Labels: None


 Description   
  • How to repeat: ./mtr galera.GAL-419
  • ./mtr --suite=galera,galera_sr,galera_3nodes
  • Other effected tests: galera_3nodes.galera_gtid_2_cluster galera_3nodes.galera_safe_to_bootstrap
  • Build: -DWITH_ASAN=Yes

    CURRENT_TEST: galera.GAL-419
    2020-08-24 16:57:44 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated
    2020-08-24 16:57:44 0 [Note] /home/jan/mysql/10.4-bugs/sql/mysqld (mysqld 10.4.15-MariaDB-debug-log)
     starting as process 2634744 ...
    2020-08-24 16:57:44 0 [Warning] Could not increase number of max_open_files to more than 1024 (reque
    st: 32190)
    2020-08-24 16:57:44 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)
      table_cache: 421 (was 2000)
    2020-08-24 16:57:44 0 [Warning] setrlimit could not change the size of core files to 'infinity';  We
     may not be able to generate a core file on signals
    2020-08-24 16:57:44 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16004' which m
    akes it impossible for another host to reach this one. Please set it to the address which this node 
    can be connected at by other cluster members.
    2020-08-24 16:57:44 0 [Note] WSREP: Loading provider /usr/lib/libgalera_4_smm.so initial position: 0
    0000000-0000-0000-0000-000000000000:-1
    2020-08-24 16:57:44 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_4_smm
    .so'
    2020-08-24 16:57:44 0 [Note] WSREP: wsrep_load(): Galera 26.4.5(rb3764ab6) by Codership Oy <info@cod
    ership.com> loaded successfully.
    2020-08-24 16:57:44 0 [Note] WSREP: CRC-32C: using hardware acceleration.
    2020-08-24 16:57:44 0 [Warning] WSREP: Could not open state file for reading: '/home/jan/mysql/10.4-
    bugs/mysql-test/var/mysqld.1/data//grastate.dat'
    2020-08-24 16:57:44 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe
    _to_bootstrap: 1
    2020-08-24 16:57:44 0 [Note] WSREP: GCache DEBUG: opened preamble:
    Version: 0
    UUID: 00000000-0000-0000-0000-000000000000
    Seqno: -1 - -1
    Offset: -1
    Synced: 0
    2020-08-24 16:57:44 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history
     UUID.
    2020-08-24 16:57:44 0 [Note] WSREP: Passing config to GCS: base_dir = /home/jan/mysql/10.4-bugs/mysq
    l-test/var/mysqld.1/data/; base_host = 127.0.0.1; base_port = 16002; cert.log_conflicts = no; cert.o
    ptimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period
     = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT
    15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_re
    port_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout =
     PT24H; gcache.dir = /home/jan/mysql/10.4-bugs/mysql-test/var/mysqld.1/data/; gcache.keep_pages_size
     = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes
    ; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16;
     gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_lim
    it = 9223372036854775807; gcs.recv_q_soft_limit = 0.
    2020-08-24 16:57:44 0 [Note] WSREP: Start replication
    2020-08-24 16:57:44 0 [Note] WSREP: Connecting with bootstrap option: 1
    2020-08-24 16:57:44 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-00000000
    0000:-1
    2020-08-24 16:57:44 0 [Note] WSREP: protonet asio version 0
    2020-08-24 16:57:44 0 [Note] WSREP: Using CRC-32C for message checksums.
    2020-08-24 16:57:44 0 [Note] WSREP: backend: asio
    2020-08-24 16:57:44 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 
    2020-08-24 16:57:44 0 [Warning] WSREP: access file(/home/jan/mysql/10.4-bugs/mysql-test/var/mysqld.1
    /data//gvwstate.dat) failed(No such file or directory)
    2020-08-24 16:57:44 0 [Note] WSREP: restore pc from disk failed
    2020-08-24 16:57:44 0 [Note] WSREP: GMCast version 0
    2020-08-24 16:57:44 0 [Note] WSREP: (c8f7e3d8-98b5, 'tcp://0.0.0.0:16002') listening at tcp://0.0.0.
    0:16002
    2020-08-24 16:57:44 0 [Note] WSREP: (c8f7e3d8-98b5, 'tcp://0.0.0.0:16002') multicast: , ttl: 1
    2020-08-24 16:57:44 0 [Note] WSREP: EVS version 1
    2020-08-24 16:57:44 0 [Note] WSREP: gcomm: bootstrapping new group 'my_wsrep_cluster'
    2020-08-24 16:57:44 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery
    2020-08-24 16:57:44 0 [Note] WSREP: EVS version upgrade 0 -> 1
    2020-08-24 16:57:44 0 [Note] WSREP: PC protocol upgrade 0 -> 1
    2020-08-24 16:57:44 0 [Note] WSREP: Node c8f7e3d8-98b5 state prim
    2020-08-24 16:57:44 0 [Note] WSREP: view(view_id(PRIM,c8f7e3d8-98b5,1) memb {
    	c8f7e3d8-98b5,0
    } joined {
    } left {
    } partitioned {
    })
    2020-08-24 16:57:44 0 [Note] WSREP: save pc into disk
    2020-08-24 16:57:44 0 [Note] WSREP: gcomm: connected
    2020-08-24 16:57:44 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
    2020-08-24 16:57:44 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
    2020-08-24 16:57:44 0 [Note] WSREP: Opened channel 'my_wsrep_cluster'
    2020-08-24 16:57:44 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_n
    um = 1
    2020-08-24 16:57:44 0 [Note] WSREP: Starting new group from scratch: c8fb09ce-e611-11ea-91ac-070069c
    ab5c8
    2020-08-24 16:57:44 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c8fb1820-e611-11ea-a445-6a653a4
    03195
    2020-08-24 16:57:44 0 [Note] WSREP: STATE EXCHANGE: sent state msg: c8fb1820-e611-11ea-a445-6a653a40
    3195
    2020-08-24 16:57:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: c8fb1820-e611-11ea-a445-6a653a403
    195 from 0 (jan-HP-ZBook-15u-G5)
    2020-08-24 16:57:44 0 [Note] WSREP: Quorum results:
    	version    = 6,
    	component  = PRIMARY,
    	conf_id    = 0,
    	members    = 1/1 (joined/total),
    	act_id     = 0,
    	last_appl. = 0,
    	protocols  = 2/10/4 (gcs/repl/appl),
    	vote policy= 0,
    	group UUID = c8fb09ce-e611-11ea-91ac-070069cab5c8
    2020-08-24 16:57:44 0 [Note] WSREP: Flow-control interval: [16, 16]
    2020-08-24 16:57:44 0 [Note] WSREP: Restored state OPEN -> JOINED (1)
    2020-08-24 16:57:44 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group.
    2020-08-24 16:57:44 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1)
    2020-08-24 16:57:44 2 [Note] WSREP: Starting applier thread 2
    2020-08-24 16:57:44 2 [Note] WSREP: ####### processing CC 1, local, ordered
    2020-08-24 16:57:44 2 [Note] WSREP: Process first view: c8fb09ce-e611-11ea-91ac-070069cab5c8 my uuid
    : c8f7e3d8-e611-11ea-98b5-5ba79fb54197
    2020-08-24 16:57:44 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 connected to cluster at position c8fb
    09ce-e611-11ea-91ac-070069cab5c8:1 with ID c8f7e3d8-e611-11ea-98b5-5ba79fb54197
    2020-08-24 16:57:44 2 [Note] WSREP: Server status change disconnected -> connected
    2020-08-24 16:57:44 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:44 2 [Note] WSREP: ####### My UUID: c8f7e3d8-e611-11ea-98b5-5ba79fb54197
    2020-08-24 16:57:44 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (pro
    to: 10), state transfer needed: no
    2020-08-24 16:57:44 0 [Note] WSREP: Service thread queue flushed.
    2020-08-24 16:57:44 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000
    -0000-0000-000000000000:-1, protocol version: -1
    2020-08-24 16:57:44 2 [Note] WSREP: REPL Protocols: 10 (5)
    2020-08-24 16:57:44 2 [Note] WSREP: ####### Adjusting cert position: -1 -> 1
    2020-08-24 16:57:44 0 [Note] WSREP: Service thread queue flushed.
    2020-08-24 16:57:44 1 [Note] WSREP: Starting rollbacker thread 1
    2020-08-24 16:57:44 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 
    c8fb09ce-e611-11ea-91ac-070069cab5c8:0
    2020-08-24 16:57:44 2 [Note] WSREP: ================================================
    View:
      id: c8fb09ce-e611-11ea-91ac-070069cab5c8:1
      status: primary
      protocol_version: 4
      capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_REA
    D, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
      final: no
      own_index: 0
      members(1):
    	0: c8f7e3d8-e611-11ea-98b5-5ba79fb54197, jan-HP-ZBook-15u-G5
    =================================================
    2020-08-24 16:57:44 2 [Note] WSREP: Server status change connected -> joiner
    2020-08-24 16:57:44 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:44 2 [Note] WSREP: Server status change joiner -> initializing
    2020-08-24 16:57:44 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:44 0 [Note] Plugin 'partition' is disabled.
    2020-08-24 16:57:44 0 [Note] Plugin 'SEQUENCE' is disabled.
    2020-08-24 16:57:45 0 [Note] InnoDB: Using Linux native AIO
    2020-08-24 16:57:45 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
    2020-08-24 16:57:45 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
    2020-08-24 16:57:45 0 [Note] InnoDB: Uses event mutexes
    2020-08-24 16:57:45 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
    2020-08-24 16:57:45 0 [Note] InnoDB: Number of pools: 1
    2020-08-24 16:57:45 0 [Note] InnoDB: Using SSE2 crc32 instructions
    2020-08-24 16:57:45 0 [Note] mysqld: O_TMPFILE is not supported on /home/jan/mysql/10.4-bugs/mysql-t
    est/var/tmp/mysqld.1 (disabling future attempts)
    2020-08-24 16:57:45 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk
     size = 8M
    2020-08-24 16:57:45 0 [Note] InnoDB: Completed initialization of buffer pool
    2020-08-24 16:57:45 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread
     priority can be changed. See the man page of setpriority().
    2020-08-24 16:57:45 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
    2020-08-24 16:57:45 0 [Note] InnoDB: Creating shared tablespace for temporary tables
    2020-08-24 16:57:45 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the f
    ile full; Please wait ...
    2020-08-24 16:57:45 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
    2020-08-24 16:57:45 0 [Note] InnoDB: 10.4.15 started; log sequence number 69037; transaction id 34
    2020-08-24 16:57:45 0 [Note] InnoDB: Loading buffer pool(s) from /home/jan/mysql/10.4-bugs/mysql-tes
    t/var/mysqld.1/data/ib_buffer_pool
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_MUTEXES' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_CMP' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'FEEDBACK' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'user_variables' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
    2020-08-24 16:57:45 0 [Note] Plugin 'unix_socket' is disabled.
    2020-08-24 16:57:45 0 [Warning] /home/jan/mysql/10.4-bugs/sql/mysqld: unknown option '--loose-pam-de
    bug'
    2020-08-24 16:57:45 0 [Warning] /home/jan/mysql/10.4-bugs/sql/mysqld: unknown option '--loose-aria'
    2020-08-24 16:57:45 0 [Note] InnoDB: Buffer pool(s) load completed at 200824 16:57:45
    2020-08-24 16:57:45 0 [Note] Server socket created on IP: '127.0.0.1'.
    2020-08-24 16:57:45 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
    2020-08-24 16:57:45 0 [Note] WSREP: Server initialized
    2020-08-24 16:57:45 0 [Note] WSREP: Server status change initializing -> initialized
    2020-08-24 16:57:45 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:45 2 [Note] WSREP: Bootstrapping a new cluster, setting initial position to 0000000
    0-0000-0000-0000-000000000000:-1
    2020-08-24 16:57:45 9 [Note] WSREP: Cluster table is empty, not recovering transactions
    2020-08-24 16:57:45 2 [Note] WSREP: Server status change initialized -> joined
    2020-08-24 16:57:45 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:45 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:45 0 [Note] Reading of all Master_info entries succeeded
    2020-08-24 16:57:45 0 [Note] Added new Master_info '' to hash table
    2020-08-24 16:57:45 0 [Note] /home/jan/mysql/10.4-bugs/sql/mysqld: ready for connections.
    Version: '10.4.15-MariaDB-debug-log'  socket: '/home/jan/mysql/10.4-bugs/mysql-test/var/tmp/mysqld.1
    .sock'  port: 16000  Source distribution
    2020-08-24 16:57:45 2 [Note] WSREP: Lowest cert index boundary for CC from group: 1
    2020-08-24 16:57:45 2 [Note] WSREP: Min available from gcache for CC from group: 1
    2020-08-24 16:57:45 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group
    2020-08-24 16:57:45 2 [Note] WSREP: Server status change joined -> synced
    2020-08-24 16:57:45 2 [Note] WSREP: Synchronized with group, ready for connections
    2020-08-24 16:57:45 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:46 0 [Note] WSREP: (c8f7e3d8-98b5, 'tcp://0.0.0.0:16002') connection established to
     c9f0edab-947c tcp://127.0.0.1:16005
    2020-08-24 16:57:46 0 [Note] WSREP: (c8f7e3d8-98b5, 'tcp://0.0.0.0:16002') turning message relay req
    uesting on, nonlive peers: 
    2020-08-24 16:57:47 0 [Note] WSREP: declaring c9f0edab-947c at tcp://127.0.0.1:16005 stable
    2020-08-24 16:57:47 0 [Note] WSREP: Node c8f7e3d8-98b5 state prim
    2020-08-24 16:57:47 0 [Note] WSREP: view(view_id(PRIM,c8f7e3d8-98b5,2) memb {
    	c8f7e3d8-98b5,0
    	c9f0edab-947c,0
    } joined {
    } left {
    } partitioned {
    })
    2020-08-24 16:57:47 0 [Note] WSREP: save pc into disk
    2020-08-24 16:57:47 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_n
    um = 2
    2020-08-24 16:57:47 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ca3f349d-e611-11ea-98e1-0a3bd59
    e52cb
    2020-08-24 16:57:47 0 [Note] WSREP: STATE EXCHANGE: sent state msg: ca3f349d-e611-11ea-98e1-0a3bd59e
    52cb
    2020-08-24 16:57:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: ca3f349d-e611-11ea-98e1-0a3bd59e5
    2cb from 0 (jan-HP-ZBook-15u-G5)
    2020-08-24 16:57:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: ca3f349d-e611-11ea-98e1-0a3bd59e5
    2cb from 1 (jan-HP-ZBook-15u-G5)
    2020-08-24 16:57:47 0 [Note] WSREP: Quorum results:
    	version    = 6,
    	component  = PRIMARY,
    	conf_id    = 1,
    	members    = 1/2 (joined/total),
    	act_id     = 1,
    	last_appl. = 0,
    	protocols  = 2/10/4 (gcs/repl/appl),
    	vote policy= 0,
    	group UUID = c8fb09ce-e611-11ea-91ac-070069cab5c8
    2020-08-24 16:57:47 0 [Note] WSREP: Flow-control interval: [23, 23]
    2020-08-24 16:57:47 2 [Note] WSREP: ####### processing CC 2, local, ordered
    2020-08-24 16:57:47 2 [Note] WSREP: ####### My UUID: c8f7e3d8-e611-11ea-98b5-5ba79fb54197
    2020-08-24 16:57:47 2 [Note] WSREP: Skipping cert index reset
    2020-08-24 16:57:47 2 [Note] WSREP: REPL Protocols: 10 (5)
    2020-08-24 16:57:47 2 [Note] WSREP: ####### Adjusting cert position: 1 -> 2
    2020-08-24 16:57:47 0 [Note] WSREP: Service thread queue flushed.
    2020-08-24 16:57:47 2 [Note] WSREP: ================================================
    View:
      id: c8fb09ce-e611-11ea-91ac-070069cab5c8:2
      status: primary
      protocol_version: 4
      capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_REA
    D, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
      final: no
      own_index: 0
      members(2):
    	0: c8f7e3d8-e611-11ea-98b5-5ba79fb54197, jan-HP-ZBook-15u-G5
    	1: c9f0edab-e611-11ea-947c-cfeebc65aff5, jan-HP-ZBook-15u-G5
    =================================================
    2020-08-24 16:57:47 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:47 2 [Note] WSREP: Lowest cert index boundary for CC from group: 2
    2020-08-24 16:57:47 2 [Note] WSREP: Min available from gcache for CC from group: 1
    2020-08-24 16:57:48 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) requested state transfer from '
    *any*'. Selected 0.0 (jan-HP-ZBook-15u-G5)(SYNCED) as donor.
    2020-08-24 16:57:48 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2)
    2020-08-24 16:57:48 2 [Note] WSREP: Detected STR version: 1, req_len: 110, req: STRv1
    2020-08-24 16:57:48 2 [Note] WSREP: Cert index preload: 2 -> 2
    2020-08-24 16:57:48 0 [Note] WSREP: async IST sender starting to serve tcp://127.0.0.1:16006 sending
     2-2, preload starts from 2
    2020-08-24 16:57:48 2 [Note] WSREP: Server status change synced -> donor
    2020-08-24 16:57:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:48 0 [Note] WSREP: IST sender 2 -> 2
    2020-08-24 16:57:48 0 [Note] WSREP: Donor monitor thread started to monitor
    2020-08-24 16:57:48 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '127.0.0.2:16
    007/rsync_sst' --socket '/home/jan/mysql/10.4-bugs/mysql-test/var/tmp/mysqld.1.sock' --datadir '/hom
    e/jan/mysql/10.4-bugs/mysql-test/var/mysqld.1/data/' --defaults-file '/home/jan/mysql/10.4-bugs/mysq
    l-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'c8fb09ce-e611-11ea-91ac-070069cab5c8:2' --gt
    id-domain-id '0' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.1 --defaul
    ts-file=/home/jan/mysql/10.4-bugs/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem -
    -innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buff
    er-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields
     --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sy
    s-virtual --core-file --loose-debug-sync-timeout=300'
    2020-08-24 16:57:48 2 [Note] WSREP: sst_donor_thread signaled with 0
    2020-08-24 16:57:48 0 [Note] WSREP: Flushing tables for SST...
    2020-08-24 16:57:48 0 [Note] WSREP: pause
    2020-08-24 16:57:48 0 [Note] WSREP: Provider paused at c8fb09ce-e611-11ea-91ac-070069cab5c8:2 (5)
    2020-08-24 16:57:48 0 [Note] WSREP: Server paused at: 2
    2020-08-24 16:57:48 0 [Note] WSREP: Tables flushed.
    2020-08-24 16:57:49 0 [Note] WSREP: resume
    2020-08-24 16:57:49 0 [Note] WSREP: resuming provider at 5
    2020-08-24 16:57:49 0 [Note] WSREP: Provider resumed.
    2020-08-24 16:57:49 0 [Note] WSREP: SST sent: c8fb09ce-e611-11ea-91ac-070069cab5c8:2
    2020-08-24 16:57:49 0 [Note] WSREP: Server status change donor -> joined
    2020-08-24 16:57:49 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:49 0 [Note] WSREP: 0.0 (jan-HP-ZBook-15u-G5): State transfer to 1.0 (jan-HP-ZBook-1
    5u-G5) complete.
    2020-08-24 16:57:49 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2)
    2020-08-24 16:57:49 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group.
    2020-08-24 16:57:49 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
    2020-08-24 16:57:49 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group
    2020-08-24 16:57:49 2 [Note] WSREP: Server status change joined -> synced
    2020-08-24 16:57:49 2 [Note] WSREP: Synchronized with group, ready for connections
    2020-08-24 16:57:49 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
    2020-08-24 16:57:49 0 [Note] WSREP: Donor monitor thread ended with total time 1 sec
    2020-08-24 16:57:49 0 [Note] WSREP: (c8f7e3d8-98b5, 'tcp://0.0.0.0:16002') turning message relay req
    uesting off
    2020-08-24 16:57:52 0 [Note] WSREP: 1.0 (jan-HP-ZBook-15u-G5): State transfer from 0.0 (jan-HP-ZBook
    -15u-G5) complete.
    2020-08-24 16:57:52 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) synced with group.
    2020-08-24 16:57:52 0 [Note] WSREP: async IST sender served
    2020-08-24 16:57:57 0 [Note] WSREP: Loading provider /usr/lib/libgalera_4_smm.so initial position: 0
    0000000-0000-0000-0000-000000000000:-1
    2020-08-24 16:57:57 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_4_smm
    .so'
    2020-08-24 16:57:57 0 [Note] WSREP: wsrep_load(): Galera 26.4.5(rb3764ab6) by Codership Oy <info@cod
    ership.com> loaded successfully.
    2020-08-24 16:57:57 0 [Note] WSREP: CRC-32C: using hardware acceleration.
    2020-08-24 16:57:57 0 [Note] WSREP: Found saved state: c8fb09ce-e611-11ea-91ac-070069cab5c8:-1, safe
    _to_bootstrap: 0
    2020-08-24 16:57:57 0 [Note] WSREP: GCache DEBUG: opened preamble:
    Version: 2
    UUID: c8fb09ce-e611-11ea-91ac-070069cab5c8
    Seqno: -1 - -1
    Offset: -1
    Synced: 0
    2020-08-24 16:57:57 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: c8fb09ce-e611-1
    1ea-91ac-070069cab5c8, offset: -1
    2020-08-24 16:57:57 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (       0/10485784 byte
    s) complete.
    2020-08-24 16:57:57 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (10485784/10485784 byte
    s) complete.
    2020-08-24 16:57:57 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 1-2
    2020-08-24 16:57:57 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (  0/432 bytes) 
    complete.
    2020-08-24 16:57:57 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (432/432 bytes) 
    complete.
    2020-08-24 16:57:57 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/2 locked buffers
    2020-08-24 16:57:57 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 10485328/104857
    60
    2020-08-24 16:57:57 0 [Note] WSREP: Passing config to GCS: base_dir = /home/jan/mysql/10.4-bugs/mysq
    l-test/var/mysqld.1/data/; base_host = 127.0.0.1; base_port = 16002; cert.log_conflicts = no; cert.o
    ptimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period
     = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT
    15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_re
    port_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout =
     PT24H; gcache.dir = /home/jan/mysql/10.4-bugs/mysql-test/var/mysqld.1/data/; gcache.keep_pages_size
     = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes
    ; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16;
     gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_lim
    it = 9223372036854775807; gcs.recv_q_soft_limit = 0.
    2020-08-24 16:57:57 0 [Note] WSREP: Start replication
    2020-08-24 16:57:57 0 [Note] WSREP: Connecting with bootstrap option: 1
    2020-08-24 16:57:57 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-00000000
    0000:-1
    2020-08-24 16:57:57 0 [ERROR] WSREP: It may not be safe to bootstrap the cluster from this node. It 
    was not the last one to leave the cluster and may not contain all the updates. To force cluster boot
    strap with this node, edit the grastate.dat file manually and set safe_to_bootstrap to 1 .
    2020-08-24 16:57:57 0 [ERROR] WSREP: wsrep::connect(gcomm://) failed: 7
    2020-08-24 16:57:57 0 [ERROR] Aborting
     
    =================================================================
    ==2635297==ERROR: LeakSanitizer: detected memory leaks
     
    Direct leak of 632 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cdc6 in calloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10ddc6)
        #1 0x7f8058c68094  (<unknown module>)
     
    Indirect leak of 1048824 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cbc8 in malloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10dbc8)
        #1 0x7f8058c501a3  (<unknown module>)
     
    Indirect leak of 155648 byte(s) in 2 object(s) allocated from:
        #0 0x7f806199cbc8 in malloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10dbc8)
        #1 0x7f8058c4fa61  (<unknown module>)
     
    Indirect leak of 131336 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cdc6 in calloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10ddc6)
        #1 0x7f8058b2612e  (<unknown module>)
     
    Indirect leak of 65536 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cbc8 in malloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10dbc8)
        #1 0x7f8058c63b97  (<unknown module>)
     
    Indirect leak of 65536 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cdc6 in calloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10ddc6)
        #1 0x7f8058c63bbd  (<unknown module>)
     
    Indirect leak of 536 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199cdc6 in calloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10ddc6)
        #1 0x7f8058c63b74  (<unknown module>)
     
    Indirect leak of 432 byte(s) in 2 object(s) allocated from:
        #0 0x7f806199cdc6 in calloc (/lib/x86_64-linux-gnu/libasan.so.5+0x10ddc6)
        #1 0x7f8058c4fa3e  (<unknown module>)
     
    Indirect leak of 56 byte(s) in 1 object(s) allocated from:
        #0 0x7f806199e947 in operator new(unsigned long) (/lib/x86_64-linux-gnu/libasan.so.5+0x10f947)
        #1 0x7f8058c5e206  (<unknown module>)
     
    Indirect leak of 20 byte(s) in 1 object(s) allocated from:
        #0 0x7f80619253dd in strdup (/lib/x86_64-linux-gnu/libasan.so.5+0x963dd)
        #1 0x7f8058c5e1b0  (<unknown module>)
     
    Indirect leak of 16 byte(s) in 1 object(s) allocated from:
        #0 0x7f80619253dd in strdup (/lib/x86_64-linux-gnu/libasan.so.5+0x963dd)
        #1 0x7f8058c5e1c3  (<unknown module>)
     
    SUMMARY: AddressSanitizer: 1468572 byte(s) leaked in 13 allocation(s).
    



 Comments   
Comment by Jan Lindström (Inactive) [ 2020-08-24 ]

Memory leak happens when provider().connect() fails but I have failed to find out exactly what allocated memory is leaked. This happens when we call unireg_abort() i.e. aborting.

Generated at Thu Feb 08 09:23:19 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.