galera.galera_wsrep_new_cluster fails to join cluster - failed to set FD_CLOEXEC: 9 (Bad file descriptor)

galera.galera_wsrep_new_cluster          w10 [ fail ]

        Test ended at 2024-07-18 09:18:42

CURRENT_TEST: galera.galera_wsrep_new_cluster

mysqltest: In included file "./include/galera_wait_ready.inc": 

included from /data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/suite/galera/include/start_mysqld.inc at line 16:

included from /data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/suite/galera/t/galera_wsrep_new_cluster.test at line 35:

At line 28: "Server did not transition to READY state"

The result from queries just before the failure was:

connection node_2;

connection node_1;

connection node_1;

connection node_2;

connection node_2;

Shutting down server ...

connection node_1;

connection node_2;

Cleaning grastate.dat file ...

Starting server ...

 - saving '/data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/log/galera.galera_wsrep_new_cluster/' to '/data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/log/galera.galera_wsrep_new_cluster/'

Retrying test galera.galera_wsrep_new_cluster, attempt(2/3)...

***Warnings generated in error logs during shutdown after running tests: galera.galera_wsrep_new_cluster

2024-07-18  9:17:31 0 [ERROR] WSREP: exception from gcomm, backend must be restarted: failed to set FD_CLOEXEC: 9 (Bad file descriptor)

2024-07-18  9:17:31 0 [ERROR] WSREP: Failed to connect to cluster: GCommConn::get_mtu(): backend connection not open (FATAL)

2024-07-18  9:17:31 0 [ERROR] Aborting

$ /data/buildbot/workers/prod/amd64-freebsd-14/build/sql/mariadbd --defaults-group-suffix=.2 --defaults-file=/data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-new-cluster --core-file --loose-debug-sync-timeout=300

2024-07-18  9:17:31 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 32190)

2024-07-18  9:17:31 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)

2024-07-18  9:17:31 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:19187' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members.

2024-07-18  9:17:31 0 [Note] Starting MariaDB 10.5.26-MariaDB-log source revision e7c2e25ba82cafcacecac8c2927ab5d1f7d3c305 server_uid 8UW/HXh7lN/8XPCiQLxpdVmciQY= as process 22835

2024-07-18  9:17:31 0 [Note] WSREP: Loading provider /usr/local/lib/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1

2024-07-18  9:17:31 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/local/lib/libgalera_smm.so'

2024-07-18  9:17:31 0 [Note] WSREP: wsrep_load(): Galera 4.16(rXXXX) by Codership Oy <info@codership.com> loaded successfully.

2024-07-18  9:17:31 0 [Note] WSREP: Symbol 'wsrep_node_isolation_mode_set_v1' not found from provider

2024-07-18  9:17:31 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.

2024-07-18  9:17:31 0 [Warning] WSREP: Could not open state file for reading: '/data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/mysqld.2/data//grastate.dat'

2024-07-18  9:17:31 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1

2024-07-18  9:17:31 0 [Note] WSREP: GCache DEBUG: opened preamble:

Version: 2

UUID: c186dc57-44d5-11ef-afa8-7a6956a0a1a6

Seqno: 2 - 8

Offset: 1280

Synced: 1

2024-07-18  9:17:31 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: c186dc57-44d5-11ef-afa8-7a6956a0a1a6, offset: 1280

2024-07-18  9:17:31 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (       0/10485784 bytes) complete.

2024-07-18  9:17:31 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (10485784/10485784 bytes) complete.

2024-07-18  9:17:31 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2-8

2024-07-18  9:17:31 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (   0/3224 bytes) complete.

2024-07-18  9:17:31 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (3224/3224 bytes) complete.

2024-07-18  9:17:31 0 [Note] WSREP: Recovering GCache ring buffer: found 0/7 locked buffers

2024-07-18  9:17:31 0 [Note] WSREP: Recovering GCache ring buffer: free space: 10482536/10485760

2024-07-18  9:17:31 0 [Note] WSREP: Passing config to GCS: base_dir = /data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/mysqld.2/data/; base_host = 127.0.0.1; base_port = 19185; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_thro

2024-07-18  9:17:31 0 [Note] WSREP: Start replication

2024-07-18  9:17:31 0 [Note] WSREP: Connecting with bootstrap option: 1

2024-07-18  9:17:31 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1

2024-07-18  9:17:31 0 [Note] WSREP: protonet asio version 0

2024-07-18  9:17:31 0 [Note] WSREP: Using CRC-32C for message checksums.

2024-07-18  9:17:31 0 [Note] WSREP: backend: asio

2024-07-18  9:17:31 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 

2024-07-18  9:17:31 0 [Note] WSREP: access file(/data/buildbot/workers/prod/amd64-freebsd-14/build/mysql-test/var/10/mysqld.2/data//gvwstate.dat) failed(No such file or directory)

2024-07-18  9:17:31 0 [Note] WSREP: restore pc from disk failed

2024-07-18  9:17:31 0 [Note] WSREP: GMCast version 0

2024-07-18  9:17:31 0 [Note] WSREP: (cc031df5-b6b7, 'tcp://0.0.0.0:19185') listening at tcp://0.0.0.0:19185

2024-07-18  9:17:31 0 [Note] WSREP: (cc031df5-b6b7, 'tcp://0.0.0.0:19185') multicast: , ttl: 1

2024-07-18  9:17:31 0 [Note] WSREP: EVS version 1

2024-07-18  9:17:31 0 [Note] WSREP: gcomm: bootstrapping new group 'my_wsrep_cluster'

2024-07-18  9:17:31 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery

2024-07-18  9:17:31 0 [Note] WSREP: EVS version upgrade 0 -> 1

2024-07-18  9:17:31 0 [Note] WSREP: PC protocol upgrade 0 -> 1

2024-07-18  9:17:31 0 [Note] WSREP: Node cc031df5-b6b7 state prim

2024-07-18  9:17:31 0 [Note] WSREP: view(view_id(PRIM,cc031df5-b6b7,1) memb {

	cc031df5-b6b7,0

} joined {

} left {

} partitioned {

})

2024-07-18  9:17:31 0 [Note] WSREP: save pc into disk

2024-07-18  9:17:31 0 [Note] WSREP: discarding pending addr without UUID: tcp://127.0.0.1:19182

2024-07-18  9:17:31 0 [Note] WSREP: discarding pending addr proto entry 0x44cfe8def2a0

2024-07-18  9:17:31 0 [Note] WSREP: gcomm: connected

2024-07-18  9:17:31 0 [ERROR] WSREP: exception from gcomm, backend must be restarted: failed to set FD_CLOEXEC: 9 (Bad file descriptor)

	 at /wrkdirs/usr/ports/databases/galera26/work/galera-release_26.4.16/galerautils/src/gu_asio_socket_util.hpp:set_fd_options():41