[MDEV-29573] Node crashes with Error: Certification exception: Attempt to reuse the same seqno Created: 2022-09-20  Updated: 2023-03-07

Status: Open
Project: MariaDB Server
Component/s: Galera
Affects Version/s: 10.4.12
Fix Version/s: 10.4

Type: Bug Priority: Major
Reporter: chenmabu Assignee: Seppo Jaakola
Resolution: Unresolved Votes: 0
Labels: None
Environment:

OS Version: Debian GNU/Linux 10
MariaDB Version: 10.4.12-MariaDB


Issue Links:
Duplicate
duplicates MDEV-30706 Different results of selects from vie... Closed

 Description   

SET timestamp=1663644698;
SET STATEMENT max_statement_time=30 FOR SELECT * FROM demo_projects WHERE deleted_at = '1970-01-01 00:00:00' AND project_id IN (722923,723022,722947,723169,722944,723175,723301,722965,722917,722980);
2022-09-20  3:31:38 6201947 [ERROR] WSREP: Certification exception: Attempt to reuse the same seqno: 30555455. New ptr = 0x7efef724ef08, previous ptr = 0x7f045d4a3dc8 (FATAL)
         at gcache/src/GCache_seqno.cpp:seqno_assign():83
2022-09-20  3:31:38 6201947 [Note] WSREP: ReplicatorSMM::abort()
2022-09-20  3:31:38 6201947 [Note] WSREP: Closing send monitor...
2022-09-20  3:31:38 6201947 [Note] WSREP: Closed send monitor.
2022-09-20  3:31:38 6201947 [Note] WSREP: gcomm: terminating thread
2022-09-20  3:31:38 6201947 [Note] WSREP: gcomm: joining thread
2022-09-20  3:31:38 6201947 [Note] WSREP: gcomm: closing backend
2022-09-20  3:31:38 6201947 [Note] WSREP: PC protocol downgrade 1 -> 0
2022-09-20  3:31:38 6201947 [Note] WSREP: view((empty))
2022-09-20  3:31:38 6201947 [Note] WSREP: gcomm: closed
2022-09-20  3:31:38 0 [Note] WSREP: New SELF-LEAVE.
2022-09-20  3:31:38 0 [Note] WSREP: Flow-control interval: [0, 0]
2022-09-20  3:31:38 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2022-09-20  3:31:38 0 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 30555455)
2022-09-20  3:31:38 0 [Note] WSREP: RECV thread exiting 0: Success
2022-09-20  3:31:38 13 [Note] WSREP: ####### processing CC -1, local, ordered
2022-09-20  3:31:38 6201947 [Note] WSREP: recv_thread() joined.
2022-09-20  3:31:38 6201947 [Note] WSREP: Closing replication queue.
2022-09-20  3:31:38 6201947 [Note] WSREP: Closing slave action queue.
2022-09-20  3:31:38 6201947 [Note] WSREP: /opt/bitnami/mariadb/sbin/mysqld: Terminated.
220920  3:31:38 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
 
# User@Host: coding[coding] @  [10.42.7.2]
# Thread_id: 6193604  Schema: coding  QC_hit: No
# Query_time: 0.000136  Lock_time: 0.000031  Rows_sent: 0  Rows_examined: 0
# Rows_affected: 0  Bytes_sent: 564
SET timestamp=1663644698;
SELECT * FROM black_lists WHERE deleted_at = '1970-01-01 00:00:00' AND  status = 1 ORDER BY created_at DESC;
Server version: 10.4.12-MariaDB-log
key_buffer_size=838860800
read_buffer_size=1048576
max_used_connections=1740
max_threads=3002
thread_count=1091
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 10115501 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x7f010c26b318
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x7f00a00b8e78 thread_stack 0x49000
*** buffer overflow detected ***: /opt/bitnami/mariadb/sbin/mysqld terminated



 Comments   
Comment by Jan Lindström (Inactive) [ 2022-09-30 ]

chanmabu Can you provide full error log, cluster configuration and some instructions how to reproduce.

Comment by Igor Babaev [ 2023-03-07 ]

The reported test case has been added in the patch for MDEV-30706

Generated at Thu Feb 08 10:09:39 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.