Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-4611

connection to mysqld fails (only once) after setting wsrep_provider or wsrep_cluster_address

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Minor
    • Resolution: Fixed
    • 5.5.29-galera
    • 5.5.42-galera
    • Galera

    Description

      Hi,

      As discussed on IRC with elenst, here are the informations for my problem.

      Variables

      ************************* 1. row *************************
      Variable_name: wsrep_OSU_method
              Value: TOI
      ************************* 2. row *************************
      Variable_name: wsrep_auto_increment_control
              Value: ON
      ************************* 3. row *************************
      Variable_name: wsrep_causal_reads
              Value: OFF
      ************************* 4. row *************************
      Variable_name: wsrep_certify_nonPK
              Value: ON
      ************************* 5. row *************************
      Variable_name: wsrep_cluster_address
              Value: gcomm://10.43.0.86,10.43.0.63,10.43.0.66
      ************************* 6. row *************************
      Variable_name: wsrep_cluster_name
              Value: galera_cluster_test
      ************************* 7. row *************************
      Variable_name: wsrep_convert_LOCK_to_trx
              Value: OFF
      ************************* 8. row *************************
      Variable_name: wsrep_data_home_dir
              Value: /var/lib/mysql/
      ************************* 9. row *************************
      Variable_name: wsrep_dbug_option
              Value: 
      ************************* 10. row *************************
      Variable_name: wsrep_debug
              Value: OFF
      ************************* 11. row *************************
      Variable_name: wsrep_drupal_282555_workaround
              Value: OFF
      ************************* 12. row *************************
      Variable_name: wsrep_forced_binlog_format
              Value: NONE
      ************************* 13. row *************************
      Variable_name: wsrep_log_conflicts
              Value: OFF
      ************************* 14. row *************************
      Variable_name: wsrep_max_ws_rows
              Value: 131072
      ************************* 15. row *************************
      Variable_name: wsrep_max_ws_size
              Value: 1073741824
      ************************* 16. row *************************
      Variable_name: wsrep_mysql_replication_bundle
              Value: 0
      ************************* 17. row *************************
      Variable_name: wsrep_node_address
              Value: 
      ************************* 18. row *************************
      Variable_name: wsrep_node_incoming_address
              Value: AUTO
      ************************* 19. row *************************
      Variable_name: wsrep_node_name
              Value: galera-node
      ************************* 20. row *************************
      Variable_name: wsrep_notify_cmd
              Value: 
      ************************* 21. row *************************
      Variable_name: wsrep_on
              Value: ON
      ************************* 22. row *************************
      Variable_name: wsrep_provider
              Value: /usr/lib/galera/libgalera_smm.so
      ************************* 23. row *************************
      Variable_name: wsrep_provider_options
              Value: base_host = 10.43.0.63; base_port = 4567; cert.log_conflicts = no; evs.causal_keepalive_period = PT1S; evs.debug_log_mask = 0x1; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.info_log_mask = 0; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.keepalive_period = PT1S; evs.max_install_timeouts = 1; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.use_aggregate = true; evs.user_send_window = 2; evs.version = 0; evs.view_forget_timeout = PT5M; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; gmcast.listen_addr = tcp://0.0.0.0:4567; gmcast.mcast_addr = ; gmcast.mcast_ttl = 1; gmcast.peer_timeout = PT3S; gmcast.time_wait = PT5S; gmcast.version = 0; ist.recv_addr = 10.43.0.63; pc.checksum = true; pc.ignore_quorum = false; pc.ignore_sb = false; pc.linger = PT20S; pc.npvo = false; pc.version = 0; pc.weight = 1; protonet.backend = asio; protonet.version = 0; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
      ************************* 24. row *************************
      Variable_name: wsrep_recover
              Value: OFF
      ************************* 25. row *************************
      Variable_name: wsrep_replicate_myisam
              Value: OFF
      ************************* 26. row *************************
      Variable_name: wsrep_retry_autocommit
              Value: 1
      ************************* 27. row *************************
      Variable_name: wsrep_slave_threads
              Value: 10
      ************************* 28. row *************************
      Variable_name: wsrep_sst_auth
              Value: ********
      ************************* 29. row *************************
      Variable_name: wsrep_sst_donor
              Value: 
      ************************* 30. row *************************
      Variable_name: wsrep_sst_donor_rejects_queries
              Value: OFF
      ************************* 31. row *************************
      Variable_name: wsrep_sst_method
              Value: rsync
      ************************* 32. row *************************
      Variable_name: wsrep_sst_receive_address
              Value: AUTO
      ************************* 33. row *************************
      Variable_name: wsrep_start_position
              Value: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515

      config

      [mysqld]
      binlog_format=ROW
      innodb_autoinc_lock_mode=2
      innodb_locks_unsafe_for_binlog=1
      # No need to sync to disk when replication is synchronous
      sync_binlog=0
      innodb_flush_log_at_trx_commit=0
      wsrep_provider=/usr/lib/galera/libgalera_smm.so
      wsrep_cluster_name='galera_cluster_test'
      wsrep_slave_threads=10
      wsrep_cluster_address='gcomm://10.43.0.86,10.43.0.63,10.43.0.66'
      wsrep_sst_auth=root:XXXXXXXXXXXXXXX
      wsrep_certify_nonPK=1
      wsrep_convert_LOCK_to_trx=0
      wsrep_auto_increment_control=1
      wsrep_drupal_282555_workaround=0
      wsrep_causal_reads=0
      wsrep_sst_method=rsync
       
      [mysqld]
      bulk_insert_buffer_size=16M
      concurrent_insert=2
      connect_timeout=5
      innodb_buffer_pool_size=128M
      innodb_file_format=Barracuda
      innodb_file_format_max=Barracuda
      innodb_file_per_table=1
      innodb_flush_log_at_trx_commit=0
      innodb_flush_method=O_DIRECT
      innodb_io_capacity=200
      innodb_lock_wait_timeout=50
      innodb_log_buffer_size=16M
      innodb_log_file_size=64M
      innodb_log_files_in_group=2
      innodb_max_dirty_pages_pct=50
      innodb_open_files=65535
      innodb_thread_concurrency=2
      key_buffer_size=8M
      log_error=/var/log/mysql/error.log
      log_slow_verbosity=query_plan
      long_query_time=1
      max_allowed_packet=64M
      max_connections=100
      max_heap_table_size=16M
      myisam_recover=BACKUP
      myisam_sort_buffer_size=64M
      open-files-limit=65535
      query_cache_limit=1M
      read_buffer_size=2M
      read_rnd_buffer_size=1M
      skip-name-resolve=ON
      slow_query_log=1
      slow_query_log_file=/var/log/mysql/slow.log
      sort_buffer_size=8M
      table_definition_cache=500
      table_open_cache=500
      thread_cache_size=128
      thread_stack=128K
      tmp_table_size=16M
      tmpdir=/tmp
      wait_timeout=600

      To reproduce

      commands

      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e "SET GLOBAL  wsrep_provider='none';"
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e ""
      ERROR 2013 (HY000): Lost connection to MySQL server at 'waiting for initial communication packet', system error: 95
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e ""
      galera-node:/etc/mysql/conf.d#

      It is the same with wsrep_cluster_adress :

      commands

      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e ""; echo $?
      0
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e "set global wsrep_cluster_address='';" ; echo $?
      0
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e "" ; echo $?
      ERROR 2013 (HY000): Lost connection to MySQL server at 'waiting for initial communication packet', system error: 95
      1
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e "set global wsrep_cluster_address='gcomm://10.43.0.86';"; echo $?
      0
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e ""; echo $?
      ERROR 2013 (HY000): Lost connection to MySQL server at 'waiting for initial communication packet', system error: 95
      1
      galera-node:/etc/mysql/conf.d# mysql --connect-timeout 1 -e ""; echo $?
      0

      Here the strace of the mysql --connect-timeout 1 -e "" that fails :

      strace

      execve("/usr/bin/mysql", ["mysql", "--connect-timeout", "3", "-e", ""], [/* 28 vars */]) = 0
      brk(0)                                  = 0x7f37e7e5d000
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e6850000
      access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
      open("/etc/ld.so.cache", O_RDONLY)      = 3
      fstat(3, {st_mode=S_IFREG|0644, st_size=8569, ...}) = 0
      mmap(NULL, 8569, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f37e684d000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libpthread.so.0", O_RDONLY)  = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360Y\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0755, st_size=131258, ...}) = 0
      mmap(NULL, 2208640, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e6419000
      mprotect(0x7f37e6430000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e662f000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f37e662f000
      mmap(0x7f37e6631000, 13184, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f37e6631000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libncurses.so.5", O_RDONLY)  = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\20*\1\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=286776, ...}) = 0
      mmap(NULL, 2383488, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e61d3000
      mprotect(0x7f37e6215000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e6414000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x41000) = 0x7f37e6414000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/usr/lib/libz.so.1", O_RDONLY)    = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260\"\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=93936, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684c000
      mmap(NULL, 2188976, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e5fbc000
      mprotect(0x7f37e5fd3000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e61d2000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16000) = 0x7f37e61d2000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/librt.so.1", O_RDONLY)       = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220!\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=31744, ...}) = 0
      mmap(NULL, 2128848, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e5db4000
      mprotect(0x7f37e5dbb000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e5fba000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f37e5fba000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/usr/lib/libssl.so.0.9.8", O_RDONLY) = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300l\1\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=356608, ...}) = 0
      mmap(NULL, 2451824, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e5b5d000
      mprotect(0x7f37e5bae000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e5dad000, 28672, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x50000) = 0x7f37e5dad000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/usr/lib/libcrypto.so.0.9.8", O_RDONLY) = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0@\253\7\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=1693344, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684b000
      mmap(NULL, 3803320, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e57bc000
      mprotect(0x7f37e5931000, 2097152, PROT_NONE) = 0
      mmap(0x7f37e5b31000, 163840, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x175000) = 0x7f37e5b31000
      mmap(0x7f37e5b59000, 14520, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f37e5b59000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libdl.so.2", O_RDONLY)       = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=14696, ...}) = 0
      mmap(NULL, 2109696, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e55b8000
      mprotect(0x7f37e55ba000, 2097152, PROT_NONE) = 0
      mmap(0x7f37e57ba000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f37e57ba000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/usr/lib/libstdc++.so.6", O_RDONLY) = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\243\5\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=1043976, ...}) = 0
      mmap(NULL, 3223576, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e52a4000
      mprotect(0x7f37e539a000, 2097152, PROT_NONE) = 0
      mmap(0x7f37e559a000, 36864, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xf6000) = 0x7f37e559a000
      mmap(0x7f37e55a3000, 81944, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f37e55a3000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libm.so.6", O_RDONLY)        = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360>\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=530736, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684a000
      mmap(NULL, 2625768, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e5022000
      mprotect(0x7f37e50a2000, 2097152, PROT_NONE) = 0
      mmap(0x7f37e52a2000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x80000) = 0x7f37e52a2000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libc.so.6", O_RDONLY)        = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\355\1\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0755, st_size=1437064, ...}) = 0
      mmap(NULL, 3545160, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e4cc0000
      mprotect(0x7f37e4e19000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e5018000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x158000) = 0x7f37e5018000
      mmap(0x7f37e501d000, 18504, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f37e501d000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libgcc_s.so.1", O_RDONLY)    = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P-\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=90504, ...}) = 0
      mmap(NULL, 2186232, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e4aaa000
      mprotect(0x7f37e4ac0000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e4cbf000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) = 0x7f37e4cbf000
      close(3)                                = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e6849000
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e6848000
      mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e6846000
      arch_prctl(ARCH_SET_FS, 0x7f37e6846720) = 0
      mprotect(0x7f37e5018000, 16384, PROT_READ) = 0
      mprotect(0x7f37e52a2000, 4096, PROT_READ) = 0
      mprotect(0x7f37e559a000, 28672, PROT_READ) = 0
      mprotect(0x7f37e57ba000, 4096, PROT_READ) = 0
      mprotect(0x7f37e5fba000, 4096, PROT_READ) = 0
      mprotect(0x7f37e662f000, 4096, PROT_READ) = 0
      mprotect(0x7f37e6d83000, 40960, PROT_READ) = 0
      mprotect(0x7f37e6852000, 4096, PROT_READ) = 0
      munmap(0x7f37e684d000, 8569)            = 0
      set_tid_address(0x7f37e68469f0)         = 6227
      set_robust_list(0x7f37e6846a00, 0x18)   = 0
      futex(0x7fff179b254c, FUTEX_WAKE_PRIVATE, 1) = 0
      futex(0x7fff179b254c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7f37e6846720) = -1 EAGAIN (Resource temporarily unavailable)
      rt_sigaction(SIGRTMIN, {0x7f37e641e870, [], SA_RESTORER|SA_SIGINFO, 0x7f37e6427ff0}, NULL, 8) = 0
      rt_sigaction(SIGRT_1, {0x7f37e641e900, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f37e6427ff0}, NULL, 8) = 0
      rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
      getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0
      open("/sys/devices/system/cpu", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 3
      fcntl(3, F_GETFD)                       = 0x1 (flags FD_CLOEXEC)
      brk(0)                                  = 0x7f37e7e5d000
      brk(0x7f37e7e86000)                     = 0x7f37e7e86000
      getdents(3, /* 15 entries */, 32768)    = 456
      getdents(3, /* 0 entries */, 32768)     = 0
      brk(0x7f37e7e7e000)                     = 0x7f37e7e7e000
      close(3)                                = 0
      mmap(NULL, 8392704, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|MAP_STACK, -1, 0) = 0x7f37e42a9000
      mprotect(0x7f37e42a9000, 4096, PROT_NONE) = 0
      clone(child_stack=0x7f37e4aa8fd0, flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID, parent_tidptr=0x7f37e4aa99d0, tls=0x7f37e4aa9700, child_tidptr=0x7f37e4aa99d0) = 6228
      futex(0x7f37e4aa99d0, FUTEX_WAIT, 6228, NULL) = 0
      ioctl(0, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
      ioctl(1, SNDCTL_TMR_TIMEBASE or TCGETS, {B38400 opost isig icanon echo ...}) = 0
      dup(1)                                  = 3
      close(3)                                = 0
      stat("/etc/my.cnf", 0x7fff179aebb0)     = -1 ENOENT (No such file or directory)
      stat("/etc/mysql/my.cnf", {st_mode=S_IFREG|0644, st_size=4895, ...}) = 0
      open("/etc/mysql/my.cnf", O_RDONLY)     = 3
      fstat(3, {st_mode=S_IFREG|0644, st_size=4895, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684f000
      read(3, "# MariaDB database server config"..., 4096) = 4096
      read(3, "og_file_size\t= 50M\ninnodb_buffer"..., 4096) = 799
      open("/etc/mysql/conf.d/", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 4
      getdents(4, /* 6 entries */, 32768)     = 200
      getdents(4, /* 0 entries */, 32768)     = 0
      close(4)                                = 0
      stat("/etc/mysql/conf.d/galera_config.cnf", {st_mode=S_IFREG|0644, st_size=836, ...}) = 0
      open("/etc/mysql/conf.d/galera_config.cnf", O_RDONLY) = 4
      fstat(4, {st_mode=S_IFREG|0644, st_size=836, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684e000
      read(4, "\n## ADDED BY PUPPET\n[mysqld]\n###"..., 4096) = 836
      read(4, "", 4096)                       = 0
      close(4)                                = 0
      munmap(0x7f37e684e000, 4096)            = 0
      stat("/etc/mysql/conf.d/mariadb.cnf", {st_mode=S_IFREG|0644, st_size=435, ...}) = 0
      open("/etc/mysql/conf.d/mariadb.cnf", O_RDONLY) = 4
      fstat(4, {st_mode=S_IFREG|0644, st_size=435, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684e000
      read(4, "# MariaDB-specific config file.\n"..., 4096) = 435
      read(4, "", 4096)                       = 0
      close(4)                                = 0
      munmap(0x7f37e684e000, 4096)            = 0
      stat("/etc/mysql/conf.d/mysqld_safe_syslog.cnf", {st_mode=S_IFREG|0644, st_size=21, ...}) = 0
      open("/etc/mysql/conf.d/mysqld_safe_syslog.cnf", O_RDONLY) = 4
      fstat(4, {st_mode=S_IFREG|0644, st_size=21, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684e000
      read(4, "[mysqld_safe]\nsyslog\n", 4096) = 21
      read(4, "", 4096)                       = 0
      close(4)                                = 0
      munmap(0x7f37e684e000, 4096)            = 0
      stat("/etc/mysql/conf.d/puppet.cnf", {st_mode=S_IFREG|0644, st_size=1030, ...}) = 0
      open("/etc/mysql/conf.d/puppet.cnf", O_RDONLY) = 4
      fstat(4, {st_mode=S_IFREG|0644, st_size=1030, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684e000
      read(4, "# MANAGED BY PUPPET\n[mysqld]\nbul"..., 4096) = 1030
      read(4, "", 4096)                       = 0
      close(4)                                = 0
      munmap(0x7f37e684e000, 4096)            = 0
      read(3, "", 4096)                       = 0
      close(3)                                = 0
      munmap(0x7f37e684f000, 4096)            = 0
      stat("/root/.my.cnf", 0x7fff179aebb0)   = -1 ENOENT (No such file or directory)
      socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
      connect(3, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
      close(3)                                = 0
      socket(PF_FILE, SOCK_STREAM|SOCK_CLOEXEC|SOCK_NONBLOCK, 0) = 3
      connect(3, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
      close(3)                                = 0
      open("/etc/nsswitch.conf", O_RDONLY)    = 3
      fstat(3, {st_mode=S_IFREG|0644, st_size=475, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684f000
      read(3, "# /etc/nsswitch.conf\n#\n# Example"..., 4096) = 475
      read(3, "", 4096)                       = 0
      close(3)                                = 0
      munmap(0x7f37e684f000, 4096)            = 0
      open("/etc/ld.so.cache", O_RDONLY)      = 3
      fstat(3, {st_mode=S_IFREG|0644, st_size=8569, ...}) = 0
      mmap(NULL, 8569, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f37e684d000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/tls/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/tls/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/lib/tls/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/tls", 0x7fff179b17d0)        = -1 ENOENT (No such file or directory)
      open("/lib/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/x86_64", 0x7fff179b17d0)     = -1 ENOENT (No such file or directory)
      open("/lib/libnss_db.so.2", O_RDONLY)   = -1 ENOENT (No such file or directory)
      stat("/lib", {st_mode=S_IFDIR|0755, st_size=12288, ...}) = 0
      open("/usr/lib/tls/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/tls/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/tls/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/tls", 0x7fff179b17d0)    = -1 ENOENT (No such file or directory)
      open("/usr/lib/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
      open("/lib/x86_64-linux-gnu/tls/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/x86_64-linux-gnu/tls/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/lib/x86_64-linux-gnu/tls/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/x86_64-linux-gnu/tls", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/lib/x86_64-linux-gnu/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/x86_64-linux-gnu/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/lib/x86_64-linux-gnu/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/lib/x86_64-linux-gnu", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/x86_64-linux-gnu/tls/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/x86_64-linux-gnu/tls/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/x86_64-linux-gnu/tls/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/x86_64-linux-gnu/tls", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/x86_64-linux-gnu/x86_64/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/x86_64-linux-gnu/x86_64", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      open("/usr/lib/x86_64-linux-gnu/libnss_db.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
      stat("/usr/lib/x86_64-linux-gnu", 0x7fff179b17d0) = -1 ENOENT (No such file or directory)
      munmap(0x7f37e684d000, 8569)            = 0
      open("/etc/ld.so.cache", O_RDONLY)      = 3
      fstat(3, {st_mode=S_IFREG|0644, st_size=8569, ...}) = 0
      mmap(NULL, 8569, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f37e684d000
      close(3)                                = 0
      access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
      open("/lib/libnss_files.so.2", O_RDONLY) = 3
      read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\20\"\0\0\0\0\0\0"..., 832) = 832
      fstat(3, {st_mode=S_IFREG|0644, st_size=51728, ...}) = 0
      mmap(NULL, 2147752, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f37e409c000
      mprotect(0x7f37e40a8000, 2093056, PROT_NONE) = 0
      mmap(0x7f37e42a7000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xb000) = 0x7f37e42a7000
      close(3)                                = 0
      mprotect(0x7f37e42a7000, 4096, PROT_READ) = 0
      munmap(0x7f37e684d000, 8569)            = 0
      open("/etc/services", O_RDONLY|O_CLOEXEC) = 3
      fcntl(3, F_GETFD)                       = 0x1 (flags FD_CLOEXEC)
      fstat(3, {st_mode=S_IFREG|0644, st_size=19666, ...}) = 0
      mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f37e684f000
      read(3, "# Network services, Internet sty"..., 4096) = 4096
      read(3, "9/tcp\t\t\t\t# Quick Mail Transfer P"..., 4096) = 4096
      read(3, "4/udp\nrmiregistry\t1099/tcp\t\t\t# J"..., 4096) = 4096
      close(3)                                = 0
      munmap(0x7f37e684f000, 4096)            = 0
      rt_sigaction(SIGPIPE, {SIG_IGN, [PIPE], SA_RESTORER|SA_RESTART, 0x7f37e4cf2230}, {SIG_DFL, [], 0}, 8) = 0
      socket(PF_FILE, SOCK_STREAM, 0)         = 3
      fcntl(3, F_SETFL, O_RDONLY)             = 0
      fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
      fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
      fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
      connect(3, {sa_family=AF_FILE, path="/var/run/mysqld/mysqld.sock"}, 110) = 0
      fcntl(3, F_SETFL, O_RDWR)               = 0
      setsockopt(3, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0\0\0\0\0\0\0\0\0", 16) = 0
      setsockopt(3, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0\0\0\0\0\0\0\0\0", 16) = 0
      setsockopt(3, SOL_IP, IP_TOS, [8], 4)   = -1 EOPNOTSUPP (Operation not supported)
      setsockopt(3, SOL_SOCKET, SO_KEEPALIVE, [1], 4) = 0
      poll([{fd=3, events=POLLIN}], 1, 3000)  = 0 (Timeout)
      shutdown(3, 2 /* send and receive */)   = 0
      close(3)                                = 0
      write(2, "ERROR", 5ERROR)                    = 5
      write(2, " 2013 (HY000)", 13 2013 (HY000))           = 13
      write(2, ": Lost connection to MySQL serve"..., 98: Lost connection to MySQL server at 'waiting for initial communication packet', system error: 95
      ) = 98
      clock_gettime(CLOCK_REALTIME, {1370271522, 537280099}) = 0
      exit_group(1)                           = ?

      The connection stays forever in the processlist.
      For example, if I do :

      commands

      galera-node:/var/log/mysql# netstat -np|grep mysql
      tcp        0      0 10.43.0.63:36957        10.43.0.66:4567         ESTABLISHED 5043/mysqld
      tcp        0      0 10.43.0.63:51238        10.43.0.86:4567         ESTABLISHED 5043/mysqld
      unix  2      [ ]         STREAM     CONNECTED     129660   1821/mysql
      unix  2      [ ]         STREAM     CONNECTED     129656   1821/mysql
       
      galera-node:/etc/mysql/conf.d# while true; do mysql -e "set global wsrep_cluster_address='gcomm://10.43.0.86';"; mysql --connect-timeout 1 -e ; echo -n '.'; mysql -e "set global wsrep_cluster_address='';"; mysql --connect-timeout 1 -e ''; done
      [...]

      Then, the "show full processlist" shows a lot of 'unauthenticated user' :

      processlist

      galera-node:/etc/mysql/conf.d# mysql -e 'show full processlist;'
      +-----+----------------------+-----------------+------+---------+------+--------------------+-----------------------+----------+
      | Id  | User                 | Host            | db   | Command | Time | State              | Info                  | Progress |
      +-----+----------------------+-----------------+------+---------+------+--------------------+-----------------------+----------+
      |  18 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  39 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  53 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  57 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  70 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  84 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      |  87 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 100 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 103 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 116 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 119 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 132 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 135 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 148 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 151 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 164 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 167 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 180 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 183 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 196 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 199 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 212 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 215 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 228 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 231 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 244 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 247 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 248 | root                 | localhost       | NULL | Sleep   |   31 |                    | NULL                  |    0.000 |
      | 249 | unauthenticated user | connecting host | NULL | Connect | NULL | login              | NULL                  |    0.000 |
      | 250 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 251 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 252 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 253 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 254 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 255 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 256 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 257 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 258 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 259 | system user          |                 | NULL | Sleep   |   27 | NULL               | NULL                  |    0.000 |
      | 260 | system user          |                 | NULL | Sleep   |   27 | wsrep aborter idle | NULL                  |    0.000 |
      | 264 | root                 | localhost       | NULL | Query   |    0 | sleeping           | show full processlist |    0.000 |
      +-----+----------------------+-----------------+------+---------+------+--------------------+-----------------------+----------+

      netstat

      galera-node:/etc/mysql/conf.d# netstat -np
      Active Internet connections (w/o servers)
      Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
      tcp        0      0 10.43.0.63:36955        10.43.0.66:4567         ESTABLISHED 32636/mysqld
      tcp        0    448 10.43.0.63:22           173.231.115.58:40762    ESTABLISHED 770/0
      tcp        0      0 10.43.0.63:51234        10.43.0.86:4567         ESTABLISHED 32636/mysqld
      Active UNIX domain sockets (w/o servers)
      Proto RefCnt Flags       Type       State         I-Node   PID/Program name    Path
      unix  3      [ ]         STREAM     CONNECTED     129661   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  3      [ ]         STREAM     CONNECTED     129660   1821/mysql
      unix  3      [ ]         STREAM     CONNECTED     129657   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  3      [ ]         STREAM     CONNECTED     129656   1821/mysql
      unix  2      [ ]         STREAM     CONNECTED     129650   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129636   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129612   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129598   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129574   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129560   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129536   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129522   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129494   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129480   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129456   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129442   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129418   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129404   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129380   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129366   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129342   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129328   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129304   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129290   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129266   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129252   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129215   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129191   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129172   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     129143   32636/mysqld        /var/run/mysqld/mysqld.sock
      unix  2      [ ]         STREAM     CONNECTED     128651   32636/mysqld        /var/run/mysqld/mysqld.sock

      Here the error.log during the while; :

      error.log

      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:03 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:05 [Note] WSREP: rollbacker thread exiting
      130603 10:46:35 [Note] WSREP: Stop replication
      130603 10:46:37 [Note] WSREP: rollbacker thread exiting
      130603 10:46:37 [Note] WSREP: Start replication
      130603 10:46:37 [Note] WSREP: Setting initial position to 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515
      130603 10:46:37 [Note] WSREP: protonet asio version 0
      130603 10:46:37 [Note] WSREP: backend: asio
      130603 10:46:37 [Note] WSREP: GMCast version 0
      130603 10:46:37 [Note] WSREP: (64d68ca3-cc5c-11e2-0800-53384f13e67e, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
      130603 10:46:37 [Note] WSREP: (64d68ca3-cc5c-11e2-0800-53384f13e67e, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
      130603 10:46:37 [Note] WSREP: EVS version 0
      130603 10:46:37 [Note] WSREP: PC version 0
      130603 10:46:37 [Note] WSREP: gcomm: connecting to group 'galera_cluster_test', peer '10.43.0.86:'
      130603 10:46:37 [Note] WSREP: (64d68ca3-cc5c-11e2-0800-53384f13e67e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.43.0.66:4567 
      130603 10:46:37 [Note] WSREP: (64d68ca3-cc5c-11e2-0800-53384f13e67e, 'tcp://0.0.0.0:4567') turning message relay requesting off
      130603 10:46:38 [Note] WSREP: declaring d0b1c380-c94d-11e2-0800-ed91d1675ca4 stable
      130603 10:46:38 [Note] WSREP: declaring e7eb97b7-c8b2-11e2-0800-cecae517caf2 stable
      130603 10:46:38 [Note] WSREP: Node d0b1c380-c94d-11e2-0800-ed91d1675ca4 state prim
      130603 10:46:38 [Note] WSREP: view(view_id(PRIM,64d68ca3-cc5c-11e2-0800-53384f13e67e,201) memb {
      	64d68ca3-cc5c-11e2-0800-53384f13e67e,
      	d0b1c380-c94d-11e2-0800-ed91d1675ca4,
      	e7eb97b7-c8b2-11e2-0800-cecae517caf2,
      } joined {
      } left {
      } partitioned {
      })
      130603 10:46:38 [Note] WSREP: gcomm: connected
      130603 10:46:38 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
      130603 10:46:38 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 1515)
      130603 10:46:38 [Note] WSREP: Opened channel 'galera_cluster_test'
      130603 10:46:38 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
      130603 10:46:38 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 65702a6f-cc5c-11e2-0800-840d842eb264
      130603 10:46:38 [Note] WSREP: STATE EXCHANGE: sent state msg: 65702a6f-cc5c-11e2-0800-840d842eb264
      130603 10:46:38 [Note] WSREP: STATE EXCHANGE: got state msg: 65702a6f-cc5c-11e2-0800-840d842eb264 from 0 (galera-node)
      130603 10:46:38 [Note] WSREP: STATE EXCHANGE: got state msg: 65702a6f-cc5c-11e2-0800-840d842eb264 from 1 (galera-node)
      130603 10:46:38 [Note] WSREP: STATE EXCHANGE: got state msg: 65702a6f-cc5c-11e2-0800-840d842eb264 from 2 (galera-node)
      130603 10:46:38 [Note] WSREP: Quorum results:
      	version    = 2,
      	component  = PRIMARY,
      	conf_id    = 196,
      	members    = 3/3 (joined/total),
      	act_id     = 1515,
      	last_appl. = 0,
      	protocols  = 0/4/2 (gcs/repl/appl),
      	group UUID = 44e3084d-c4ba-11e2-0800-bb01a7d6545e
      130603 10:46:38 [Note] WSREP: Flow-control interval: [28, 28]
      130603 10:46:38 [Note] WSREP: Restored state OPEN -> SYNCED (1515)
      130603 10:46:38 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# 197: Primary, number of nodes: 3, my index: 0, protocol version 2
      130603 10:46:38 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:38 [Note] WSREP: Assign initial position for certification: 1515, protocol version: 2
      130603 10:46:38 [Note] WSREP: Synchronized with group, ready for connections
      130603 10:46:38 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:39 [Note] WSREP: Stop replication
      130603 10:46:39 [Note] WSREP: Closing send monitor...
      130603 10:46:39 [Note] WSREP: Closed send monitor.
      130603 10:46:39 [Note] WSREP: gcomm: terminating thread
      130603 10:46:39 [Note] WSREP: gcomm: joining thread
      130603 10:46:39 [Note] WSREP: gcomm: closing backend
      130603 10:46:39 [Note] WSREP: view(view_id(NON_PRIM,64d68ca3-cc5c-11e2-0800-53384f13e67e,201) memb {
      	64d68ca3-cc5c-11e2-0800-53384f13e67e,
      } joined {
      } left {
      } partitioned {
      	d0b1c380-c94d-11e2-0800-ed91d1675ca4,
      	e7eb97b7-c8b2-11e2-0800-cecae517caf2,
      })
      130603 10:46:39 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
      130603 10:46:39 [Note] WSREP: view((empty))
      130603 10:46:39 [Note] WSREP: gcomm: closed
      130603 10:46:39 [Note] WSREP: Flow-control interval: [16, 16]
      130603 10:46:39 [Note] WSREP: Received NON-PRIMARY.
      130603 10:46:39 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 1515)
      130603 10:46:39 [Note] WSREP: Received self-leave message.
      130603 10:46:39 [Note] WSREP: Flow-control interval: [0, 0]
      130603 10:46:39 [Note] WSREP: Received SELF-LEAVE. Closing connection.
      130603 10:46:39 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 1515)
      130603 10:46:39 [Note] WSREP: RECV thread exiting 0: Success
      130603 10:46:39 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2
      130603 10:46:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:39 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2
      130603 10:46:39 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:0)
      130603 10:46:39 [Note] WSREP: recv_thread() joined.
      130603 10:46:39 [Note] WSREP: Closing slave action queue.
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:39 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:41 [Note] WSREP: rollbacker thread exiting
      130603 10:46:42 [Note] WSREP: Stop replication
      130603 10:46:44 [Note] WSREP: rollbacker thread exiting
      130603 10:46:44 [Note] WSREP: Start replication
      130603 10:46:44 [Note] WSREP: Setting initial position to 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515
      130603 10:46:44 [Note] WSREP: protonet asio version 0
      130603 10:46:44 [Note] WSREP: backend: asio
      130603 10:46:44 [Note] WSREP: GMCast version 0
      130603 10:46:44 [Note] WSREP: (6907c821-cc5c-11e2-0800-337b9e48f6ae, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
      130603 10:46:44 [Note] WSREP: (6907c821-cc5c-11e2-0800-337b9e48f6ae, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
      130603 10:46:44 [Note] WSREP: EVS version 0
      130603 10:46:44 [Note] WSREP: PC version 0
      130603 10:46:44 [Note] WSREP: gcomm: connecting to group 'galera_cluster_test', peer '10.43.0.86:'
      130603 10:46:44 [Note] WSREP: (6907c821-cc5c-11e2-0800-337b9e48f6ae, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.43.0.66:4567 
      130603 10:46:45 [Note] WSREP: (6907c821-cc5c-11e2-0800-337b9e48f6ae, 'tcp://0.0.0.0:4567') turning message relay requesting off
      130603 10:46:46 [Note] WSREP: declaring d0b1c380-c94d-11e2-0800-ed91d1675ca4 stable
      130603 10:46:46 [Note] WSREP: declaring e7eb97b7-c8b2-11e2-0800-cecae517caf2 stable
      130603 10:46:46 [Note] WSREP: Node d0b1c380-c94d-11e2-0800-ed91d1675ca4 state prim
      130603 10:46:46 [Note] WSREP: view(view_id(PRIM,6907c821-cc5c-11e2-0800-337b9e48f6ae,203) memb {
      	6907c821-cc5c-11e2-0800-337b9e48f6ae,
      	d0b1c380-c94d-11e2-0800-ed91d1675ca4,
      	e7eb97b7-c8b2-11e2-0800-cecae517caf2,
      } joined {
      } left {
      } partitioned {
      })
      130603 10:46:46 [Note] WSREP: gcomm: connected
      130603 10:46:46 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
      130603 10:46:46 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 1515)
      130603 10:46:46 [Note] WSREP: Opened channel 'galera_cluster_test'
      130603 10:46:46 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
      130603 10:46:46 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 6a3b4c05-cc5c-11e2-0800-a25b8e801f11
      130603 10:46:46 [Note] WSREP: STATE EXCHANGE: sent state msg: 6a3b4c05-cc5c-11e2-0800-a25b8e801f11
      130603 10:46:46 [Note] WSREP: STATE EXCHANGE: got state msg: 6a3b4c05-cc5c-11e2-0800-a25b8e801f11 from 0 (galera-node)
      130603 10:46:46 [Note] WSREP: STATE EXCHANGE: got state msg: 6a3b4c05-cc5c-11e2-0800-a25b8e801f11 from 1 (galera-node)
      130603 10:46:46 [Note] WSREP: STATE EXCHANGE: got state msg: 6a3b4c05-cc5c-11e2-0800-a25b8e801f11 from 2 (galera-node)
      130603 10:46:46 [Note] WSREP: Quorum results:
      	version    = 2,
      	component  = PRIMARY,
      	conf_id    = 198,
      	members    = 3/3 (joined/total),
      	act_id     = 1515,
      	last_appl. = 0,
      	protocols  = 0/4/2 (gcs/repl/appl),
      	group UUID = 44e3084d-c4ba-11e2-0800-bb01a7d6545e
      130603 10:46:46 [Note] WSREP: Flow-control interval: [28, 28]
      130603 10:46:46 [Note] WSREP: Restored state OPEN -> SYNCED (1515)
      130603 10:46:46 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# 199: Primary, number of nodes: 3, my index: 0, protocol version 2
      130603 10:46:46 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:46 [Note] WSREP: Assign initial position for certification: 1515, protocol version: 2
      130603 10:46:46 [Note] WSREP: Synchronized with group, ready for connections
      130603 10:46:46 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:47 [Note] WSREP: Stop replication
      130603 10:46:47 [Note] WSREP: Closing send monitor...
      130603 10:46:47 [Note] WSREP: Closed send monitor.
      130603 10:46:47 [Note] WSREP: gcomm: terminating thread
      130603 10:46:47 [Note] WSREP: gcomm: joining thread
      130603 10:46:47 [Note] WSREP: gcomm: closing backend
      130603 10:46:47 [Note] WSREP: view(view_id(NON_PRIM,6907c821-cc5c-11e2-0800-337b9e48f6ae,203) memb {
      	6907c821-cc5c-11e2-0800-337b9e48f6ae,
      } joined {
      } left {
      } partitioned {
      	d0b1c380-c94d-11e2-0800-ed91d1675ca4,
      	e7eb97b7-c8b2-11e2-0800-cecae517caf2,
      })
      130603 10:46:47 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
      130603 10:46:47 [Note] WSREP: view((empty))
      130603 10:46:47 [Note] WSREP: gcomm: closed
      130603 10:46:47 [Note] WSREP: Flow-control interval: [16, 16]
      130603 10:46:47 [Note] WSREP: Received NON-PRIMARY.
      130603 10:46:47 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 1515)
      130603 10:46:47 [Note] WSREP: Received self-leave message.
      130603 10:46:47 [Note] WSREP: Flow-control interval: [0, 0]
      130603 10:46:47 [Note] WSREP: Received SELF-LEAVE. Closing connection.
      130603 10:46:47 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 1515)
      130603 10:46:47 [Note] WSREP: RECV thread exiting 0: Success
      130603 10:46:47 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 2
      130603 10:46:47 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:47 [Note] WSREP: New cluster view: global state: 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 2
      130603 10:46:47 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:0)
      130603 10:46:47 [Note] WSREP: recv_thread() joined.
      130603 10:46:47 [Note] WSREP: Closing slave action queue.
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:47 [Note] WSREP: applier thread exiting (code:5)
      130603 10:46:49 [Note] WSREP: rollbacker thread exiting
      130603 10:46:50 [Note] WSREP: Stop replication
      130603 10:46:52 [Note] WSREP: rollbacker thread exiting
      130603 10:46:52 [Note] WSREP: Start replication
      130603 10:46:52 [Note] WSREP: Setting initial position to 44e3084d-c4ba-11e2-0800-bb01a7d6545e:1515
      130603 10:46:52 [Note] WSREP: protonet asio version 0
      130603 10:46:52 [Note] WSREP: backend: asio
      130603 10:46:52 [Note] WSREP: GMCast version 0
      130603 10:46:52 [Note] WSREP: (6dd3f20c-cc5c-11e2-0800-6f4f08b58553, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
      130603 10:46:52 [Note] WSREP: (6dd3f20c-cc5c-11e2-0800-6f4f08b58553, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
      130603 10:46:52 [Note] WSREP: EVS version 0
      130603 10:46:52 [Note] WSREP: PC version 0
      130603 10:46:52 [Note] WSREP: gcomm: connecting to group 'galera_cluster_test', peer '10.43.0.86:'
      130603 10:46:52 [Note] WSREP: (6dd3f20c-cc5c-11e2-0800-6f4f08b58553, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.43.0.66:4567 
      130603 10:46:53 [Note] WSREP: (6dd3f20c-cc5c-11e2-0800-6f4f08b58553, 'tcp://0.0.0.0:4567') turning message relay requesting off
      130603 10:46:54 [Note] WSREP: declaring d0b1c380-c94d-11e2-0800-ed91d1675ca4 stable
      130603 10:46:54 [Note] WSREP: declaring e7eb97b7-c8b2-11e2-0800-cecae517caf2 stable
      130603 10:46:54 [Note] WSREP: Node d0b1c380-c94d-11e2-0800-ed91d1675ca4 state prim
      130603 10:46:54 [Note] WSREP: view(view_id(PRIM,6dd3f20c-cc5c-11e2-0800-6f4f08b58553,205) memb {
      	6dd3f20c-cc5c-11e2-0800-6f4f08b58553,
      	d0b1c380-c94d-11e2-0800-ed91d1675ca4,
      	e7eb97b7-c8b2-11e2-0800-cecae517caf2,
      } joined {
      } left {
      } partitioned {
      })
      130603 10:46:54 [Note] WSREP: gcomm: connected
      130603 10:46:54 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
      130603 10:46:54 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 1515)
      130603 10:46:54 [Note] WSREP: Opened channel 'galera_cluster_test'
      130603 10:46:54 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
      130603 10:46:54 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 6f0753fc-cc5c-11e2-0800-33e01a322ff3
      130603 10:46:54 [Note] WSREP: STATE EXCHANGE: sent state msg: 6f0753fc-cc5c-11e2-0800-33e01a322ff3
      130603 10:46:54 [Note] WSREP: STATE EXCHANGE: got state msg: 6f0753fc-cc5c-11e2-0800-33e01a322ff3 from 0 (galera-node)
      130603 10:46:54 [Note] WSREP: STATE EXCHANGE: got state msg: 6f0753fc-cc5c-11e2-0800-33e01a322ff3 from 1 (galera-node)
      130603 10:46:54 [Note] WSREP: STATE EXCHANGE: got state msg: 6f0753fc-cc5c-11e2-0800-33e01a322ff3 from 2 (galera-node)
      [...] always the same, no errors

      Attachments

        1. error.log
          77 kB
          Guillaume Coré

        Activity

          People

            seppo Seppo Jaakola
            fridim Guillaume Coré
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.