[MDEV-23517] Invalid pointer on free() on gu_datetime.hpp:243 Created: 2020-08-20  Updated: 2020-09-09  Resolved: 2020-09-09

Status: Closed
Project: MariaDB Server
Component/s: Galera
Affects Version/s: 10.2
Fix Version/s: N/A

Type: Bug Priority: Critical
Reporter: Jan Lindström (Inactive) Assignee: Alexey
Resolution: Won't Fix Votes: 0
Labels: galera_library


 Description    

*** glibc detected *** /usr/sbin/mysqld: free(): invalid pointer: 0xb27ffb58 ***
 
======= Backtrace: =========
 
/lib/libc.so.6(+0x6ec71)[0x6ddc71]
 
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x387e32]
 
/usr/sbin/mysqld(_ZNSs4_Rep10_M_destroyERKSaIcE+0x1b)[0xb8025f0b]
 
/usr/sbin/mysqld(+0x271b98)[0xb776bb98]
 
/usr/sbin/mysqld(_ZNSs7reserveEj+0x70)[0xb8026f50]
 
/usr/sbin/mysqld(_ZNSs6appendEPKcj+0x4d)[0xb802718d]
 
/usr/lib/libstdc++.so.6(_ZStrsIcSt11char_traitsIcESaIcEERSt13basic_istreamIT_T0_ES7_RSbIS4_S5_T1_E+0x165)[0x344e25]
 
/usr/lib/galera/libgalera_smm.so(+0xfb05f)[0xb266905f]
 
/usr/lib/galera/libgalera_smm.so(+0xfe36d)[0xb266c36d]
 
/usr/lib/galera/libgalera_smm.so(+0x1188cd)[0xb26868cd]
 
/usr/lib/galera/libgalera_smm.so(+0x168860)[0xb26d6860]
 
/usr/lib/galera/libgalera_smm.so(+0x163508)[0xb26d1508]
 
/usr/lib/galera/libgalera_smm.so(+0x157af4)[0xb26c5af4]
 
/usr/lib/galera/libgalera_smm.so(+0x15cc55)[0xb26cac55]
 
/usr/lib/galera/libgalera_smm.so(+0x1c84b1)[0xb27364b1]
 
/usr/lib/galera/libgalera_smm.so(+0x1da224)[0xb2748224]
 
/usr/sbin/mysqld(_Z23wsrep_start_replicationv+0xd1)[0xb797f2c1]
 
/usr/sbin/mysqld(_Z18wsrep_init_startupb+0x9f)[0xb797f43f]
 
/usr/sbin/mysqld(+0x293566)[0xb778d566]
 
/usr/sbin/mysqld(_Z11mysqld_mainiPPc+0x518)[0xb77938d8]
 
/usr/sbin/mysqld(main+0x27)[0xb776bc27]
 
/lib/libc.so.6(__libc_start_main+0xe6)[0x685ce6]
 
/usr/sbin/mysqld(+0x28bff5)[0xb7785ff5]
 
======= Memory map: ========
 
00110000-002c1000 r-xp 00000000 08:02 140988     /usr/lib/libcrypto.so.1.0.1e
 
002c1000-002d1000 r--p 001b0000 08:02 140988     /usr/lib/libcrypto.so.1.0.1e
 
002d1000-002d8000 rw-p 001c0000 08:02 140988     /usr/lib/libcrypto.so.1.0.1e
 
002d8000-002db000 rw-p 00000000 00:00 0 
002db000-003ba000 r-xp 00000000 08:02 132650     /usr/lib/libstdc++.so.6.0.13
 
003ba000-003be000 r--p 000de000 08:02 132650     /usr/lib/libstdc++.so.6.0.13
 
003be000-003bf000 rw-p 000e2000 08:02 132650     /usr/lib/libstdc++.so.6.0.13
 
003bf000-003c6000 rw-p 00000000 00:00 0 
003c6000-003ee000 r-xp 00000000 08:02 1284       /lib/libm-2.12.so
 
003ee000-003ef000 r--p 00027000 08:02 1284       /lib/libm-2.12.so
 
003ef000-003f0000 rw-p 00028000 08:02 1284       /lib/libm-2.12.so
 
003f0000-003f3000 r-xp 00000000 08:02 1352       /lib/libcom_err.so.2.1
 
003f3000-003f4000 r--p 00002000 08:02 1352       /lib/libcom_err.so.2.1
 
003f4000-003f5000 rw-p 00003000 08:02 1352       /lib/libcom_err.so.2.1
 
003f8000-0040a000 r-xp 00000000 08:02 1336       /lib/libz.so.1.2.3
 
0040a000-0040b000 r--p 00011000 08:02 1336       /lib/libz.so.1.2.3
 
0040b000-0040c000 rw-p 00012000 08:02 1336       /lib/libz.so.1.2.3
 
0040c000-00435000 r-xp 00000000 08:02 1957       /lib/libk5crypto.so.3.1
 
00435000-00436000 ---p 00029000 08:02 1957       /lib/libk5crypto.so.3.1
 
00436000-00437000 r--p 00029000 08:02 1957       /lib/libk5crypto.so.3.1
 
00437000-00438000 rw-p 0002a000 08:02 1957       /lib/libk5crypto.so.3.1
 
00438000-00455000 r-xp 00000000 08:02 1254       /lib/libgcc_s-4.4.6-20110824.so.1
 
00455000-00456000 rw-p 0001d000 08:02 1254       /lib/libgcc_s-4.4.6-20110824.so.1
 
00456000-00457000 r-xp 00000000 08:02 4465       /lib/libaio.so.1.0.1
 
00457000-00458000 rw-p 00000000 08:02 4465       /lib/libaio.so.1.0.1
 
00458000-00527000 r-xp 00000000 08:02 1959       /lib/libkrb5.so.3.3
 
00527000-0052d000 r--p 000ce000 08:02 1959       /lib/libkrb5.so.3.3
 
0052d000-0052e000 rw-p 000d4000 08:02 1959       /lib/libkrb5.so.3.3
 
00541000-00544000 r-xp 00000000 08:02 1282       /lib/libdl-2.12.so
 
00544000-00545000 r--p 00002000 08:02 1282       /lib/libdl-2.12.so
 
00545000-00546000 rw-p 00003000 08:02 1282       /lib/libdl-2.12.so
 
0057e000-00585000 r-xp 00000000 08:02 1304       /lib/librt-2.12.so
 
00585000-00586000 r--p 00006000 08:02 1304       /lib/librt-2.12.so
 
00586000-00587000 rw-p 00007000 08:02 1304       /lib/librt-2.12.so
 
00595000-005aa000 r-xp 00000000 08:02 1302       /lib/libresolv-2.12.so
 
005aa000-005ab000 ---p 00015000 08:02 1302       /lib/libresolv-2.12.so
 
005ab000-005ac000 r--p 00015000 08:02 1302       /lib/libresolv-2.12.so
 
005ac000-005ad000 rw-p 00016000 08:02 1302       /lib/libresolv-2.12.so
 
005ad000-005af000 rw-p 00000000 00:00 0 
005d2000-0060e000 r-xp 00000000 08:02 1774       /lib/libgssapi_krb5.so.2.2
 
0060e000-0060f000 ---p 0003c000 08:02 1774       /lib/libgssapi_krb5.so.2.2
 
0060f000-00610000 r--p 0003c000 08:02 1774       /lib/libgssapi_krb5.so.2.2
 
00610000-00611000 rw-p 0003d000 08:02 1774       /lib/libgssapi_krb5.so.2.2
 
00615000-00617000 r-xp 00000000 08:02 1952       /lib/libkeyutils.so.1.3
 
00617000-00618000 r--p 00001000 08:02 1952       /lib/libkeyutils.so.1.3
 
00618000-00619000 rw-p 00002000 08:02 1952       /lib/libkeyutils.so.1.3
 
0064f000-0066d000 r-xp 00000000 08:02 1269       /lib/ld-2.12.so
 
0066d000-0066e000 r--p 0001d000 08:02 1269       /lib/ld-2.12.so
 
0066e000-0066f000 rw-p 0001e000 08:02 1269       /lib/ld-2.12.so
 
0066f000-007f8000 r-xp 00000000 08:02 1276       /lib/libc-2.12.so
 
007f8000-007f9000 ---p 00189000 08:02 1276       /lib/libc-2.12.so
 
007f9000-007fb000 r--p 00189000 08:02 1276       /lib/libc-2.12.so
 
007fb000-007fc000 rw-p 0018b000 08:02 1276       /lib/libc-2.12.so
 
007fc000-007ff000 rw-p 00000000 00:00 0 
00843000-0084a000 r-xp 00000000 08:02 1280       /lib/libcrypt-2.12.so
 
0084a000-0084b000 r--p 00007000 08:02 1280       /lib/libcrypt-2.12.so
 
0084b000-0084c000 rw-p 00008000 08:02 1280       /lib/libcrypt-2.12.so
 
0084c000-00873000 rw-p 00000000 00:00 0 
0097f000-0099c000 r-xp 00000000 08:02 1359       /lib/libselinux.so.1
 
0099c000-0099d000 r--p 0001c000 08:02 1359       /lib/libselinux.so.1
 
0099d000-0099e000 rw-p 0001d000 08:02 1359       /lib/libselinux.so.1
 
00b29000-00b40000 r-xp 00000000 08:02 1300       /lib/libpthread-2.12.so
 
00b40000-00b41000 r--p 00016000 08:02 1300       /lib/libpthread-2.12.so
 
00b41000-00b42000 rw-p 00017000 08:02 1300       /lib/libpthread-2.12.so
 
00b42000-00b44000 rw-p 00000000 00:00 0 
00bc3000-00bcc000 r-xp 00000000 08:02 1961       /lib/libkrb5support.so.0.1
 
00bcc000-00bcd000 r--p 00008000 08:02 1961       /lib/libkrb5support.so.0.1
 
00bcd000-00bce000 rw-p 00009000 08:02 1961       /lib/libkrb5support.so.0.1
 
00c24000-00c25000 r-xp 00000000 00:00 0          [vdso]
 
00ca9000-00d0b000 r-xp 00000000 08:02 140989     /usr/lib/libssl.so.1.0.1e
 
00d0b000-00d0e000 r--p 00061000 08:02 140989     /usr/lib/libssl.so.1.0.1e
 
00d0e000-00d12000 rw-p 00064000 08:02 140989     /usr/lib/libssl.so.1.0.1e
 
00e34000-00e36000 r-xp 00000000 08:02 1256       /lib/libfreebl3.so
 
00e36000-00e37000 r--p 00001000 08:02 1256       /lib/libfreebl3.so
 
00e37000-00e38000 rw-p 00002000 08:02 1256       /lib/libfreebl3.so
 
af267000-af268000 rw-p 00000000 00:00 0 
af268000-af269000 ---p 00000000 00:00 0 
af269000-b116c000 rw-p 00000000 00:00 0 
b116c000-b116d000 ---p 00000000 00:00 0 
b116d000-b1b6d000 rw-p 00000000 00:00 0 
b1b6d000-b256e000 rw-s 00000000 00:0f 21029      /dev/shm/var/2/mysqld.1/data/galera.cache
 
b256e000-b257b000 r--p 00000000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b257b000-b2787000 r-xp 0000d000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b2787000-b27f3000 r--p 00219000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b27f3000-b27f4000 ---p 00285000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b27f4000-b27f9000 r--p 00285000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b27f9000-b27fa000 rw-p 0028a000 08:02 141285     /usr/lib/galera/libgalera_smm.so
 
b27fa000-b2800000 rw-p 00000000 00:00 0 
b2800000-b2821000 rw-p 00000000 00:00 0 
b2821000-b2900000 ---p 00000000 00:00 0 
b295a000-b29dc000 rw-p 00000000 00:00 0 
b29dc000-b29dd000 ---p 00000000 00:00 0 
b29dd000-b74f3000 rw-p 00000000 00:00 0 
b74f8000-b74fa000 rw-p 00000000 00:00 0 
b74fa000-b774e000 r--p 00000000 08:02 141363     /usr/sbin/mysqld
 
b774e000-b8032000 r-xp 00254000 08:02 141363     /usr/sbin/mysqld
 
b8032000-b8538000 r--p 00b38000 08:02 141363     /usr/sbin/mysqld
 
b8539000-b85ad000 r--p 0103e000 08:02 141363     /usr/sbin/mysqld
 
b85ad000-b8635000 rw-p 010b2000 08:02 141363     /usr/sbin/mysqldworker[2] mysql-test-run: WARNING: Process [mysqld.1 - pid: 2066, winpid: 2066, exit: 256] died after mysql-test-run waited 1.3 seconds for /dev/shm/var/2/run/mysqld.1.pid to be created.
 
worker[2] mysql-test-run: WARNING: Process [mysqld.1 - pid: 2066, winpid: 2066, exit: 256] died after mysql-test-run waited 0.1 seconds for /dev/shm/var/2/run/mysqld.1.pid to be created.
 
Output from gdb follows. The first stack trace is from the failing thread.
 
The following stack traces are from all threads (so the failing one is
 
duplicated).
 
--------------------------
 
[New Thread 1763]
 
[New Thread 1766]
 
[New Thread 1767]
 
[New Thread 1769]
 
[Thread debugging using libthread_db enabled]
 
Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/1/my.c'.
 
Program terminated with signal 6, Aborted.
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#1  0x00330403 in pthread_kill () from /lib/libpthread.so.0
 
#2  0xb7f69e27 in my_write_core ()
 
#3  0xb79b289e in handle_fatal_signal ()
 
#4  <signal handler called>
 
#5  0x00b0e424 in __kernel_vsyscall ()
 
#6  0x00535af1 in raise () from /lib/libc.so.6
 
#7  0x005373ca in abort () from /lib/libc.so.6
 
#8  0x00573815 in __libc_message () from /lib/libc.so.6
 
#9  0x00579c71 in malloc_printerr () from /lib/libc.so.6
 
#10 0x00de1e32 in operator delete(void*) () from /usr/lib/libstdc++.so.6
 
#11 0xb7fe8f0b in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_M_destroy(std::allocator<char> const&) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/ext/new_allocator.h:110
 
#12 0xb772eb98 in std::string::_Rep::_M_dispose () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.h:249
 
#13 0xb7fe9f50 in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::reserve(unsigned int) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.tcc:504
 
#14 0xb7fea18d in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::append(char const*, unsigned int) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.tcc:308
 
#15 0x00d9ee25 in std::basic_istream<char, std::char_traits<char> >& std::operator>><char, std::char_traits<char>, std::allocator<char> >(std::basic_istream<char, std::char_traits<char> >&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >&) () from /usr/lib/libstdc++.so.6
 
#16 0xb266805f in gcomm::param<gu::datetime::Period> () at galerautils/src/gu_datetime.hpp:243
 
#17 0xb266b36d in gcomm::PC::PC(gcomm::Protonet&, gu::URI const&) () at gcomm/src/pc.cpp:245
 
#18 0xb26858cd in gcomm::Transport::create(gcomm::Protonet&, gu::URI const&) () at gcomm/src/transport.cpp:72
 
#19 0xb26d5860 in GCommConn::connect(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool) () at gcs/src/gcs_gcomm.cpp:214
 
#20 0xb26d0508 in gcomm_open(gcs_backend*, char const*, bool) () at gcs/src/gcs_gcomm.cpp:723
 
#21 0xb26c4af4 in gcs_core_open(gcs_core*, char const*, char const*, bool) () at gcs/src/gcs_core.cpp:203
 
#22 0xb26c9c55 in gcs_open(gcs_conn*, char const*, char const*, bool) () at gcs/src/gcs.cpp:1453
 
#23 0xb27354b1 in galera::ReplicatorSMM::connect(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool) () at galera/src/galera_gcs.hpp:103
 
#24 0xb2747224 in galera_connect () at galera/src/wsrep_provider.cpp:183
 
#25 0xb79422c1 in wsrep_start_replication() () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/wsrep_mysqld.cc:993
 
#26 0xb794243f in wsrep_init_startup(bool) () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/wsrep_mysqld.cc:867
 
#27 0xb7750566 in init_server_components() () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/mysqld.cc:5278
 
#28 0xb77568d8 in mysqld_main(int, char**) () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/mysqld.cc:5941
 
#29 0xb772ec27 in main () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/main.cc:25
 
 
 
Thread 4 (Thread 0xafc67b70 (LWP 1769)):
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#1  0x0032ffbc in pthread_barrier_wait () from /lib/libpthread.so.0
 
#2  0xb26d2ac5 in GCommConn::run() () at galerautils/src/gu_barrier.hpp:41
 
#3  0xb26d7e1b in GCommConn::run_fn(void*) () at gcs/src/gcs_gcomm.cpp:174
 
#4  0x0032ba09 in start_thread () from /lib/libpthread.so.0
 
#5  0x005e843e in clone () from /lib/libc.so.6
 
 
 
Thread 3 (Thread 0xb1b6bb70 (LWP 1767)):
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#1  0x0032f27c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
 
#2  0xb2702af9 in galera::ServiceThd::thd_func(void*) () at galerautils/src/gu_lock.hpp:59
 
#3  0x0032ba09 in start_thread () from /lib/libpthread.so.0
 
#4  0x005e843e in clone () from /lib/libc.so.6
 
 
 
Thread 2 (Thread 0xb339fb70 (LWP 1766)):
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#1  0x0032f624 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
 
#2  0xb7f6e8ee in timer_handler ()
 
#3  0xb7f1ac9d in pfs_spawn_thread () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/storage/perfschema/pfs.cc:1869
 
#4  0x0032ba09 in start_thread () from /lib/libpthread.so.0
 
#5  0x005e843e in clone () from /lib/libc.so.6
 
 
 
Thread 1 (Thread 0xb74b0740 (LWP 1763)):
 
#0  0x00b0e424 in __kernel_vsyscall ()
 
#1  0x00330403 in pthread_kill () from /lib/libpthread.so.0
 
#2  0xb7f69e27 in my_write_core ()
 
#3  0xb79b289e in handle_fatal_signal ()
 
#4  <signal handler called>
 
#5  0x00b0e424 in __kernel_vsyscall ()
 
#6  0x00535af1 in raise () from /lib/libc.so.6
 
#7  0x005373ca in abort () from /lib/libc.so.6
 
#8  0x00573815 in __libc_message () from /lib/libc.so.6
 
#9  0x00579c71 in malloc_printerr () from /lib/libc.so.6
 
#10 0x00de1e32 in operator delete(void*) () from /usr/lib/libstdc++.so.6
 
#11 0xb7fe8f0b in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_M_destroy(std::allocator<char> const&) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/ext/new_allocator.h:110
 
#12 0xb772eb98 in std::string::_Rep::_M_dispose () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.h:249
 
#13 0xb7fe9f50 in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::reserve(unsigned int) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.tcc:504
 
#14 0xb7fea18d in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::append(char const*, unsigned int) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/bits/basic_string.tcc:308
 
#15 0x00d9ee25 in std::basic_istream<char, std::char_traits<char> >& std::operator>><char, std::char_traits<char>, std::allocator<char> >(std::basic_istream<char, std::char_traits<char> >&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >&) () from /usr/lib/libstdc++.so.6
 
#16 0xb266805f in gcomm::param<gu::datetime::Period> () at galerautils/src/gu_datetime.hpp:243
 
#17 0xb266b36d in gcomm::PC::PC(gcomm::Protonet&, gu::URI const&) () at gcomm/src/pc.cpp:245
 
#18 0xb26858cd in gcomm::Transport::create(gcomm::Protonet&, gu::URI const&) () at gcomm/src/transport.cpp:72
 
#19 0xb26d5860 in GCommConn::connect(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool) () at gcs/src/gcs_gcomm.cpp:214
 
#20 0xb26d0508 in gcomm_open(gcs_backend*, char const*, bool) () at gcs/src/gcs_gcomm.cpp:723
 
#21 0xb26c4af4 in gcs_core_open(gcs_core*, char const*, char const*, bool) () at gcs/src/gcs_core.cpp:203
 
#22 0xb26c9c55 in gcs_open(gcs_conn*, char const*, char const*, bool) () at gcs/src/gcs.cpp:1453
 
#23 0xb27354b1 in galera::ReplicatorSMM::connect(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, bool) () at galera/src/galera_gcs.hpp:103
 
#24 0xb2747224 in galera_connect () at galera/src/wsrep_provider.cpp:183
 
#25 0xb79422c1 in wsrep_start_replication() () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/wsrep_mysqld.cc:993
 
#26 0xb794243f in wsrep_init_startup(bool) () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/wsrep_mysqld.cc:867
 
#27 0xb7750566 in init_server_components() () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/mysqld.cc:5278
 
#28 0xb77568d8 in mysqld_main(int, char**) () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/mysqld.cc:5941
 
#29 0xb772ec27 in main () at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.34/sql/main.cc:25



 Comments   
Comment by Jan Lindström (Inactive) [ 2020-08-20 ]
Comment by Alexey [ 2020-08-20 ]

jplindst are you sure that this is a Galera issue? I.e. it does not happen with the previous release?

The reasons I'm questioning Galera involvement here is:
1. that Galera code is from 2009-2014
2. the actual crash is not in Galera but deep in stdlibc++

So I would suggest that it is some binary compatibility, e.g. Galera was built with GCC-4.8.5

#11 0xb807cf0b in std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_M_destroy(std::allocator<char> const&) () at /home/buildbot/gcc-4.8.5/i686-pc-linux-gnu/libstdc++-v3/include/ext/new_allocator.h:110

while host system has GCC-4.4.6

007b7000-007d4000 r-xp 00000000 08:02 1254       /lib/libgcc_s-4.4.6-20110824.so.1
 
007d4000-007d5000 rw-p 0001d000 08:02 1254       /lib/libgcc_s-4.4.6-20110824.so.1

also it seems like a 64-bit emulator (--cpu=qemu64) is used to run a 32-bit binary (MariaDB-server-10.2.34-1.el6.i686)

So could you confirm that using Galera 3.29 with all other things equal solves the issue?

Comment by Jan Lindström (Inactive) [ 2020-08-20 ]

See all the red http://buildbot.askmonty.org/buildbot/grid?category=main&branch=10.2 as soon as we installed 25.3.30 to test machines.

Comment by Daniel Bartholomew [ 2020-08-20 ]

On CentOS 6 we use a custom-built gcc-4.8.5 to build MariaDB because the gcc that comes with CentOS 6 is too old.

Most other galera package builders use whatever gcc comes with the system. For example:

So yes, there is an issue on centos6-x86 but not on centos6-amd64 (which also uses a custom-built gcc-4.8.5) and the issues on centos6-x86 are unrelated to the Galera test failures we're currently seeing on 10.2 and 10.3.

The test failures we're currently seeing didn't start when I updated the galera test repository to 25.3.30 and were not resolved after I reverted the test repo back to 25.3.29. If you look at
https://buildbot.askmonty.org/buildbot/grid?category=main&branch=10.2&width=15

...the 182e2d4a6ce5 builds used galera-25.3.29, and the 3e617b8bef50 builds used galera-25.3.30. There were galera failures, notably with centos6-x86 , that were resolved when I reverted the galera test repo back to 25.3.29. But the mass Ubuntu/Debian galera test failures that started with the bfba2bce6a35 build (which used galera-25.3.30) continued after I reverted the galera test repo back to 25.3.29 (with the 22c4a7512f8d build).

Comment by Alexey [ 2020-08-20 ]

dbart So is it safe to assume that Galera 3.29 binaries used here were also built with GCC 4.8 or could it be that they were built some time ago and now are just reused?

Comment by Daniel Bartholomew [ 2020-08-20 ]

Yurchenko The Galera 3.29 binaries were built in late January 2020 and while I don't have the actual build logs, they were built with GCC 4.8 afaik. We have been using gcc 4.8 on our CentOS 6 builders since before that time.

Comment by Jan Lindström (Inactive) [ 2020-08-21 ]

Failures caused by bfba2bce6a35 is clear and it is not in Galera library, that leaves us with centos6-x86, not sure what we can do about that.

Comment by Alexey [ 2020-08-21 ]

What if you update centos6-x86 image to the latest CentOS 6 update? They seem to have upgraded to libstdc++-4.4.7-23.el6.i686.

Generated at Thu Feb 08 09:22:59 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.