[MDEV-14019] Spider + binlog_format = ROW => CRASH Created: 2017-10-06  Updated: 2018-05-03  Resolved: 2018-03-13

Status: Closed
Project: MariaDB Server
Component/s: Replication, Storage Engine - Spider
Affects Version/s: 10.2
Fix Version/s: 10.2.14, 10.3.6

Type: Bug Priority: Critical
Reporter: Aurélien LEQUOY Assignee: Jacob Mathew (Inactive)
Resolution: Fixed Votes: 1
Labels: None

Issue Links:
Duplicate
is duplicated by MDEV-15699 CREATE TABLE for Spider table causes ... Closed
Relates
relates to MDEV-14018 problem of lock on concurent insert (... Confirmed
Sprint: 10.2.12, 10.2.14

 Description   

When we create a table spider with binlog format = ROW (in local)

MySQL server has gone away

create many :

CREATE TABLE IF NOT EXISTS `master_value_double__62` (
 
  `id` int(20) NOT NULL AUTO_INCREMENT,
 
  `id_mysql_server` int(11) NOT NULL,
 
  `id_master_name` int(11) NOT NULL,
 
  `date` datetime NOT NULL,
 
  `value` double NOT NULL,
 
  PRIMARY KEY (`id`),
 
  UNIQUE KEY `id_mysql_server_62` (`id_mysql_server`,`id_master_name`,`date`),
 
  KEY `id_mysql_server__62` (`id_mysql_server`,`id_master_name`),
 
  KEY `date_62` (`date`,`id_mysql_server`,`id_master_name`),
 
  KEY `id_master_name__62` (`id_master_name`)
 
) ENGINE=ROCKSDB AUTO_INCREMENT=0 DEFAULT CHARSET=latin1;

create table spider :

CREATE TABLE IF NOT EXISTS `slave_value_int` ( 
`id_mysql_replication_thread` int(11) NOT NULL,
 
`id_slave_name` int(11) NOT NULL,
 
`date` datetime NOT NULL,
 
`value` bigint(20) unsigned NOT NULL,
 
PRIMARY KEY `id_mysql_replication_thread_slave_int` (`id_mysql_replication_thread`,`id_slave_name`,`date`),
 
KEY `id_mysql_replication_thread_slave__int` (`id_mysql_replication_thread`,`id_slave_name`),
 
KEY `date_int_slave` (`date`,`id_mysql_replication_thread`,`id_slave_name`),
 
KEY `id_slave_name_slave_int` (`id_slave_name`) )   DEFAULT CHARSET=latin1  ENGINE=SPIDER COMMENT='wrapper "mysql"'  PARTITION BY LIST (`id_mysql_replication_thread`)
 
(
 
     PARTITION pt1 VALUES IN (1) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__1"' ENGINE = SPIDER,
 
     PARTITION pt2 VALUES IN (2) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__2"' ENGINE = SPIDER,
 
     PARTITION pt3 VALUES IN (3) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__3"' ENGINE = SPIDER,
 
     PARTITION pt4 VALUES IN (4) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__4"' ENGINE = SPIDER,
 
     PARTITION pt5 VALUES IN (5) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__5"' ENGINE = SPIDER,
 
     PARTITION pt6 VALUES IN (6) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__6"' ENGINE = SPIDER,
 
     PARTITION pt7 VALUES IN (7) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__7"' ENGINE = SPIDER,
 
     PARTITION pt8 VALUES IN (8) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__8"' ENGINE = SPIDER,
 
     PARTITION pt9 VALUES IN (9) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__9"' ENGINE = SPIDER,
 
     PARTITION pt10 VALUES IN (10) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__10"' ENGINE = SPIDER,
 
     PARTITION pt11 VALUES IN (11) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__11"' ENGINE = SPIDER,
 
     PARTITION pt12 VALUES IN (12) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__12"' ENGINE = SPIDER,
 
     PARTITION pt13 VALUES IN (13) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__13"' ENGINE = SPIDER,
 
     PARTITION pt14 VALUES IN (14) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__14"' ENGINE = SPIDER,
 
     PARTITION pt15 VALUES IN (15) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__15"' ENGINE = SPIDER,
 
     PARTITION pt16 VALUES IN (16) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__16"' ENGINE = SPIDER,
 
     PARTITION pt17 VALUES IN (17) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__17"' ENGINE = SPIDER,
 
     PARTITION pt18 VALUES IN (18) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__18"' ENGINE = SPIDER,
 
     PARTITION pt19 VALUES IN (19) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__19"' ENGINE = SPIDER,
 
     PARTITION pt20 VALUES IN (20) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__20"' ENGINE = SPIDER,
 
     PARTITION pt21 VALUES IN (21) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__21"' ENGINE = SPIDER,
 
     PARTITION pt22 VALUES IN (22) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__22"' ENGINE = SPIDER,
 
     PARTITION pt23 VALUES IN (23) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__23"' ENGINE = SPIDER,
 
     PARTITION pt24 VALUES IN (24) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__24"' ENGINE = SPIDER,
 
     PARTITION pt25 VALUES IN (25) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__25"' ENGINE = SPIDER,
 
     PARTITION pt26 VALUES IN (26) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__26"' ENGINE = SPIDER,
 
     PARTITION pt27 VALUES IN (27) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__27"' ENGINE = SPIDER,
 
     PARTITION pt28 VALUES IN (28) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__28"' ENGINE = SPIDER,
 
     PARTITION pt29 VALUES IN (29) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__29"' ENGINE = SPIDER,
 
     PARTITION pt30 VALUES IN (30) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__30"' ENGINE = SPIDER,
 
     PARTITION pt31 VALUES IN (31) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__31"' ENGINE = SPIDER,
 
     PARTITION pt32 VALUES IN (32) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__32"' ENGINE = SPIDER,
 
     PARTITION pt33 VALUES IN (33) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__33"' ENGINE = SPIDER,
 
     PARTITION pt34 VALUES IN (34) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__34"' ENGINE = SPIDER,
 
     PARTITION pt35 VALUES IN (35) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__35"' ENGINE = SPIDER,
 
     PARTITION pt36 VALUES IN (36) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__36"' ENGINE = SPIDER,
 
     PARTITION pt37 VALUES IN (37) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__37"' ENGINE = SPIDER,
 
     PARTITION pt38 VALUES IN (38) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__38"' ENGINE = SPIDER,
 
     PARTITION pt39 VALUES IN (39) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__39"' ENGINE = SPIDER,
 
     PARTITION pt40 VALUES IN (40) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__40"' ENGINE = SPIDER,
 
     PARTITION pt41 VALUES IN (41) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__41"' ENGINE = SPIDER,
 
     PARTITION pt42 VALUES IN (42) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__42"' ENGINE = SPIDER,
 
     PARTITION pt43 VALUES IN (43) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__43"' ENGINE = SPIDER,
 
     PARTITION pt44 VALUES IN (44) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__44"' ENGINE = SPIDER,
 
     PARTITION pt45 VALUES IN (45) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__45"' ENGINE = SPIDER,
 
     PARTITION pt46 VALUES IN (46) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__46"' ENGINE = SPIDER,
 
     PARTITION pt47 VALUES IN (47) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__47"' ENGINE = SPIDER,
 
     PARTITION pt48 VALUES IN (48) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__48"' ENGINE = SPIDER,
 
     PARTITION pt49 VALUES IN (49) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__49"' ENGINE = SPIDER,
 
     PARTITION pt50 VALUES IN (50) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__50"' ENGINE = SPIDER,
 
     PARTITION pt51 VALUES IN (51) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__51"' ENGINE = SPIDER,
 
     PARTITION pt52 VALUES IN (52) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__52"' ENGINE = SPIDER,
 
     PARTITION pt53 VALUES IN (53) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__53"' ENGINE = SPIDER,
 
     PARTITION pt54 VALUES IN (54) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__54"' ENGINE = SPIDER,
 
     PARTITION pt55 VALUES IN (55) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__55"' ENGINE = SPIDER,
 
     PARTITION pt56 VALUES IN (56) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__56"' ENGINE = SPIDER,
 
     PARTITION pt57 VALUES IN (57) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__57"' ENGINE = SPIDER,
 
     PARTITION pt58 VALUES IN (58) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__58"' ENGINE = SPIDER,
 
     PARTITION pt59 VALUES IN (59) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__59"' ENGINE = SPIDER,
 
     PARTITION pt60 VALUES IN (60) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__60"' ENGINE = SPIDER,
 
     PARTITION pt61 VALUES IN (61) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__61"' ENGINE = SPIDER,
 
     PARTITION pt62 VALUES IN (62) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__62"' ENGINE = SPIDER
 
);

result : MySQL server has gone away

(was working perfectly in MariDB 10.1.*)

log :

Version: '10.2.9-MariaDB-10.2.9+maria~stretch-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  mariadb.org binary distribution
 
2017-10-06  9:27:29 140398522464000 [ERROR] mysqld: Table './mysql/spider_tables' is marked as crashed and should be repaired
 
2017-10-06  9:27:29 140398522464000 [ERROR] mysqld: Table 'spider_tables' is marked as crashed and should be repaired
 
2017-10-06  9:27:29 140398522464000 [Warning] Checking table:   './mysql/spider_tables'
 
2017-10-06  9:27:29 140398522464000 [ERROR] Got an error from unknown thread, /home/buildbot/buildbot/build/mariadb-10.2.9/storage/myisam/ha_myisam.cc:1017
 
2017-10-06  9:27:29 140398522464000 [Warning] Recovering table: './mysql/spider_tables'
 
2017-10-06  9:27:29 140398522464000 [Note] Found 1 of 0 rows when repairing './mysql/spider_tables'
 
171006  9:28:27 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.2.9-MariaDB-10.2.9+maria~stretch-log
 
key_buffer_size=134217728
 
read_buffer_size=2097152
 
max_used_connections=1
 
max_threads=102
 
thread_count=9
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 759897 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7faef80008c8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7fb1140eecc8 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55b80748a14e]
 
/usr/sbin/mysqld(handle_fatal_signal+0x3cd)[0x55b806f281ed]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110c0)[0x7fb1d69870c0]
 
/usr/sbin/mysqld(bitmap_bits_set+0x0)[0x55b80747f340]
 
/usr/sbin/mysqld(_Z8pack_rowP5TABLEPK9st_bitmapPhPKh+0x32)[0x55b807015f32]
 
/usr/sbin/mysqld(_ZN3THD16binlog_write_rowEP5TABLEbPKh+0x61)[0x55b806d63b51]
 
/usr/sbin/mysqld(_ZN20Write_rows_log_event27binlog_row_logging_functionEP3THDP5TABLEbPKhS5_+0xf)[0x55b806f32fef]
 
/usr/sbin/mysqld(+0x65c97f)[0x55b806f3197f]
 
/usr/sbin/mysqld(_ZN7handler12ha_write_rowEPh+0x12c)[0x55b806f31f8c]
 
/usr/lib/mysql/plugin/ha_spider.so(_Z20spider_insert_tablesP5TABLEP15st_spider_share+0x109)[0x7fb1c0c3ac09]
 
/usr/lib/mysql/plugin/ha_spider.so(_ZN9ha_spider6createEPKcP5TABLEP14HA_CREATE_INFO+0x6fd)[0x7fb1c0c8c1cd]
 
/usr/sbin/mysqld(_ZN7handler9ha_createEPKcP5TABLEP14HA_CREATE_INFO+0x38)[0x55b806f2fa08]
 
/usr/sbin/mysqld(+0xb84a18)[0x55b807459a18]
 
/usr/sbin/mysqld(_ZN7handler9ha_createEPKcP5TABLEP14HA_CREATE_INFO+0x38)[0x55b806f2fa08]
 
/usr/sbin/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P14HA_CREATE_INFOP34st_mysql_const_unsigned_lex_string+0x1d1)[0x55b806f302c1]
 
/usr/sbin/mysqld(_Z16rea_create_tableP3THDP34st_mysql_const_unsigned_lex_stringPKcS4_S4_P14HA_CREATE_INFOP7handlerb+0x9c)[0x55b806e4635c]
 
/usr/sbin/mysqld(+0x540ee1)[0x55b806e15ee1]
 
/usr/sbin/mysqld(_Z26mysql_create_table_no_lockP3THDPKcS2_P22Table_specification_stP10Alter_infoPbi+0xef)[0x55b806e1652f]
 
/usr/sbin/mysqld(_Z18mysql_create_tableP3THDP10TABLE_LISTP22Table_specification_stP10Alter_info+0x102)[0x55b806e166d2]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x88b4)[0x55b806d96784]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x28a)[0x55b806d96f2a]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x1fb6)[0x55b806d99d86]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x167)[0x55b806d9a6c7]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x25a)[0x55b806e60cea]
 
/usr/sbin/mysqld(handle_one_connection+0x3d)[0x55b806e60e5d]
 
/usr/sbin/mysqld(+0xb69331)[0x55b80743e331]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494)[0x7fb1d697d494]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fb1d4c64aff]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7faef86d7200): CREATE TABLE IF NOT EXISTS `slave_value_int` (  `id_mysql_replication_thread` int(11) NOT NULL, `id_slave_name` int(11) NOT NULL, `date` datetime NOT NULL, `value` bigint(20) unsigned NOT NULL, PRIMARY KEY `id_mysql_replication_thread_slave_int` (`id_mysql_replication_thread`,`id_slave_name`,`date`), KEY `id_mysql_replication_thread_slave__int` (`id_mysql_replication_thread`,`id_slave_name`), KEY `date_int_slave` (`date`,`id_mysql_replication_thread`,`id_slave_name`), KEY `id_slave_name_slave_int` (`id_slave_name`) )   DEFAULT CHARSET=latin1  ENGINE=SPIDER COMMENT='wrapper "mysql"'  PARTITION BY LIST (`id_mysql_replication_thread`) (      PARTITION pt1 VALUES IN (1) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__1"' ENGINE = SPIDER,      PARTITION pt2 VALUES IN (2) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__2"' ENGINE = SPIDER,      PARTITION pt3 VALUES IN (3) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__3"' ENGINE = SPIDER,      PARTITION pt4 VALUES IN (4) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__4"' ENGINE = SPIDER,      PARTITION pt5 VALUES IN (5) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__5"' ENGINE = SPIDER,      PARTITION pt6 VALUES IN (6) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__6"' ENGINE = SPIDER,      PARTITION pt7 VALUES IN (7) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__7"' ENGINE = SPIDER,      PARTITION pt8 VALUES IN (8) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__8"' ENGINE = SPIDER,      PARTITION pt9 VALUES IN (9) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__9"' ENGINE = SPIDER,      PARTITION pt10 VALUES IN (10) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__10"' ENGINE = SPIDER,      PARTITION pt11 VALUES IN (11) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__11"' ENGINE = SPIDER,      PARTITION pt12 VALUES IN (12) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__12"' ENGINE = SPIDER,      PARTITION pt13 VALUES IN (13) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__13"' ENGINE = SPIDER,      PARTITION pt14 VALUES IN (14) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__14"' ENGINE = SPIDER,      PARTITION pt15 VALUES IN (15) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__15"' ENGINE = SPIDER,      PARTITION pt16 VALUES IN (16) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__16"' ENGINE = SPIDER,      PARTITION pt17 VALUES IN (17) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__17"' ENGINE = SPIDER,      PARTITION pt18 VALUES IN (18) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__18"' ENGINE = SPIDER,      PARTITION pt19 VALUES IN (19) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__19"' ENGINE = SPIDER,      PARTITION pt20 VALUES IN (20) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__20"' ENGINE = SPIDER,      PARTITION pt21 VALUES IN (21) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__21"' ENGINE = SPIDER,      PARTITION pt22 VALUES IN (22) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__22"' ENGINE = SPIDER,      PARTITION pt23 VALUES IN (23) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__23"' ENGINE = SPIDER,      PARTITION pt24 VALUES IN (24) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__24"' ENGINE = SPIDER,      PARTITION pt25 VALUES IN (25) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__25"' ENGINE = SPIDER,      PARTITION pt26 VALUES IN (26) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__26"' ENGINE = SPIDER,      PARTITION pt27 VALUES IN (27) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__27"' ENGINE = SPIDER,      PARTITION pt28 VALUES IN (28) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__28"' ENGINE = SPIDER,      PARTITION pt29 VALUES IN (29) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__29"' ENGINE = SPIDER,      PARTITION pt30 VALUES IN (30) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__30"' ENGINE = SPIDER,      PARTITION pt31 VALUES IN (31) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__31"' ENGINE = SPIDER,      PARTITION pt32 VALUES IN (32) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__32"' ENGINE = SPIDER,      PARTITION pt33 VALUES IN (33) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__33"' ENGINE = SPIDER,      PARTITION pt34 VALUES IN (34) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__34"' ENGINE = SPIDER,      PARTITION pt35 VALUES IN (35) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__35"' ENGINE = SPIDER,      PARTITION pt36 VALUES IN (36) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__36"' ENGINE = SPIDER,      PARTITION pt37 VALUES IN (37) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__37"' ENGINE = SPIDER,      PARTITION pt38 VALUES IN (38) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__38"' ENGINE = SPIDER,      PARTITION pt39 VALUES IN (39) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__39"' ENGINE = SPIDER,      PARTITION pt40 VALUES IN (40) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__40"' ENGINE = SPIDER,      PARTITION pt41 VALUES IN (41) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__41"' ENGINE = SPIDER,      PARTITION pt42 VALUES IN (42) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__42"' ENGINE = SPIDER,      PARTITION pt43 VALUES IN (43) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__43"' ENGINE = SPIDER,      PARTITION pt44 VALUES IN (44) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__44"' ENGINE = SPIDER,      PARTITION pt45 VALUES IN (45) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__45"' ENGINE = SPIDER,      PARTITION pt46 VALUES IN (46) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__46"' ENGINE = SPIDER,      PARTITION pt47 VALUES IN (47) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__47"' ENGINE = SPIDER,      PARTITION pt48 VALUES IN (48) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__48"' ENGINE = SPIDER,      PARTITION pt49 VALUES IN (49) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__49"' ENGINE = SPIDER,      PARTITION pt50 VALUES IN (50) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__50"' ENGINE = SPIDER,      PARTITION pt51 VALUES IN (51) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__51"' ENGINE = SPIDER,      PARTITION pt52 VALUES IN (52) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__52"' ENGINE = SPIDER,      PARTITION pt53 VALUES IN (53) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__53"' ENGINE = SPIDER,      PARTITION pt54 VALUES IN (54) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__54"' ENGINE = SPIDER,      PARTITION pt55 VALUES IN (55) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__55"' ENGINE = SPIDER,      PARTITION pt56 VALUES IN (56) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__56"' ENGINE = SPIDER,      PARTITION pt57 VALUES IN (57) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__57"' ENGINE = SPIDER,      PARTITION pt58 VALUES IN (58) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__58"' ENGINE = SPIDER,      PARTITION pt59 VALUES IN (59) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__59"' ENGINE = SPIDER,      PARTITION pt60 VALUES IN (60) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__60"' ENGINE = SPIDER,      PARTITION pt61 VALUES IN (61) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__61"' ENGINE = SPIDER,      PARTITION pt62 VALUES IN (62) COMMENT = 'host "127.0.0.1", database "pmacontrol", user "root", password "*****", table "slave_value_int__62"' ENGINE = SPIDER )
 
Connection ID (thread ID): 14
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery starting in env /data/mysql/data/
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery scanning backward from 2512231
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery bw_end_checkpoint at 2512231 timestamp 1507274884645524 xid 2512227 (bw_newer)
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery bw_begin_checkpoint at 2512227 timestamp 1507274884582796 (bw_between)
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery turning around at begin checkpoint 2512227 time 62728
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery starts scanning forward to 2512231 from 2512227 left 4 (fw_between)
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery closing 2 dictionaries
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery making a checkpoint
 
Fri Oct  6 09:28:34 2017 PerconaFT recovery done
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Uses event mutexes
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Using Linux native AIO
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Number of pools: 1
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Using SSE2 crc32 instructions
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Initializing buffer pool, total size = 6G, instances = 8, chunk size = 128M
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Completed initialization of buffer pool
 
2017-10-06  9:28:34 140383512991488 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Starting crash recovery from checkpoint LSN=117506347
 
2017-10-06  9:28:34 140391535687872 [Note] InnoDB: Last binlog file '/data/mysql/binlog/mariadb-bin.000003', position 193439986
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: 128 out of 128 rollback segments are active.
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: Creating shared tablespace for temporary tables
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: Waiting for purge to start
 
2017-10-06  9:28:35 140391535687872 [Note] InnoDB: 5.7.19 started; log sequence number 117506356
 
2017-10-06  9:28:35 140383671211776 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/data/ib_buffer_pool
 
2017-10-06  9:28:35 140391535687872 [Note] RocksDB: 2 column families found
 
2017-10-06  9:28:35 140391535687872 [Note] RocksDB: Column Families at start:
 
2017-10-06  9:28:35 140391535687872 [Note]   cf=default
 
2017-10-06  9:28:35 140391535687872 [Note]     write_buffer_size=67108864
 
2017-10-06  9:28:35 140391535687872 [Note]     target_file_size_base=67108864
 
2017-10-06  9:28:35 140391535687872 [Note]   cf=__system__
 
2017-10-06  9:28:35 140391535687872 [Note]     write_buffer_size=67108864
 
2017-10-06  9:28:35 140391535687872 [Note]     target_file_size_base=67108864
 
2017-10-06  9:28:35 140383671211776 [Note] InnoDB: Buffer pool(s) load completed at 171006  9:28:35
 
2017-10-06  9:28:35 140391535687872 [Note] RocksDB: Table_store: loaded DDL data for 744 tables
 
2017-10-06  9:28:35 140391535687872 [Note] RocksDB: global statistics using get_sched_indexer_t indexer
 
2017-10-06  9:28:35 140391535687872 [Note] MyRocks storage engine plugin has been successfully initialized.
 
2017-10-06  9:28:35 140391535687872 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-10-06  9:28:35 140391535687872 [Note] Recovering after a crash using /data/mysql/binlog/mariadb-bin
 
2017-10-06  9:28:35 140391535687872 [Note] Starting crash recovery...
 
2017-10-06  9:28:35 140391535687872 [Note] Crash recovery finished.



 Comments   
Comment by Aurélien LEQUOY [ 2017-10-06 ]

[NEWS]

in fact it's conflict with 

 
 
wsrep_on=OFF
 
wsrep_cluster_name='pmacontrol'
 
wsrep_provider=/usr/lib/galera/libgalera_smm.so
 
wsrep_cluster_address=gcomm://
 
wsrep_node_address=10.243.4.5
 
wsrep_node_name=hb03-pmacontrol01
 
wsrep_gtid_mode=ON
 
 
 
wsrep_sst_method = xtrabackup-v2
 
wsrep_sst_auth = 'sst:****'
 
 
 
binlog_format=ROW
 
default_storage_engine=InnoDB
 
innodb_autoinc_lock_mode=2

if we comment these lines we can still these in GLOBAL VARIABLES, it's should be not crash !

considering spider as not supported and crash, i should we could let this option if we don't use Galera, sound like not.

should restrict on startup of mysql, not crash when we try to create table with spider

Comment by Andrii Nikitin (Inactive) [ 2017-10-18 ]

I get this crash in 10.2 with log_bin and binlog_format=row with simple command (without children tables) on empty spider-installed datadir:

CREATE TABLE `mytable` ( 
`id` int(11) NOT NULL,
 
PRIMARY KEY (`id`))
 
ENGINE=Spider
 
PARTITION BY LIST (`id`) (
 
PARTITION pt1 VALUES IN (1) comment 'host "127.0.0.1", port "3307", user "root" , table "mytable_1"  ',
 
PARTITION pt2 VALUES IN (2) comment 'host "127.0.0.1", port "3307", user "root" , table "mytable_2"  '
 
);


2017-10-18 10:36:00 139760377931584 [Note] /home/a/e1/m3-10.2/bld/sql//mysqld: ready for connections.
 
Version: '10.2.10-MariaDB-log'  socket: '/home/a/e1/m3-10.2/dt/my.sock'  port: 3309  Source distribution
 
171018 10:38:50 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.2.10-MariaDB-log
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=8
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467216 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7f1c100009a8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f1c7c098e98 thread_stack 0x49000
 
/home/a/e1/m3-10.2/bld/sql//mysqld(my_print_stacktrace+0x29)[0x55e04085cea9]
 
/home/a/e1/m3-10.2/bld/sql//mysqld(handle_fatal_signal+0x305)[0x55e040398345]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f1c7e56a390]
 
/home/a/e1/m3-10.2/bld/sql//mysqld(bitmap_bits_set+0x0)[0x55e0408530d0]
 
mysys/stacktrace.c:268(my_print_stacktrace)[0x55e040473a90]
 
sql/sql_class.cc:6408(THD::binlog_write_row(TABLE*, bool, unsigned char const*))[0x55e0401eea2a]
 
sql/log_event.h:4717(Write_rows_log_event::binlog_row_logging_function(THD*, TABLE*, bool, unsigned char const*, unsigned char const*))[0x55e0403a2e0f]
 
sql/handler.cc:5838(binlog_log_row_internal(TABLE*, unsigned char const*, unsigned char const*, bool (*)(THD*, TABLE*, bool, unsigned char const*, unsigned char const*)))[0x55e0403a17c8]
 
sql/handler.cc:5851(binlog_log_row)[0x55e0403a1db4]
 
/home/a/e1/m3-10.2/plugin/ha_spider.so(_Z20spider_insert_tablesP5TABLEP15st_spider_share+0xfd)[0x7f1c6427a7cd]
 
/home/a/e1/m3-10.2/plugin/ha_spider.so(_ZN9ha_spider6createEPKcP5TABLEP14HA_CREATE_INFO+0x679)[0x7f1c642c91a9]
 
sql/handler.cc:4370(handler::ha_create(char const*, TABLE*, HA_CREATE_INFO*))[0x55e04039f783]
 
sql/ha_partition.cc:741(ha_partition::create(char const*, TABLE*, HA_CREATE_INFO*))[0x55e04083b0b9]
 
sql/handler.cc:4370(handler::ha_create(char const*, TABLE*, HA_CREATE_INFO*))[0x55e04039f783]
 
sql/handler.cc:4742(ha_create_table(THD*, char const*, char const*, char const*, HA_CREATE_INFO*, st_mysql_const_unsigned_lex_string*))[0x55e0403a0002]
 
sql/unireg.cc:419(rea_create_table(THD*, st_mysql_const_unsigned_lex_string*, char const*, char const*, char const*, HA_CREATE_INFO*, handler*, bool))[0x55e0402c3a3c]
 
sql/sql_table.cc:4899(create_table_impl(THD*, char const*, char const*, char const*, char const*, char const*, DDL_options_st, HA_CREATE_INFO*, Alter_info*, int, bool*, st_key**, unsigned int*, st_mysql_const_unsigned_lex_string*) [clone .constprop.197])[0x55e0402958e4]
 
sql/sql_table.cc:5012(mysql_create_table_no_lock(THD*, char const*, char const*, Table_specification_st*, Alter_info*, bool*, int))[0x55e040299eac]
 
sql/sql_table.cc:5073(mysql_create_table(THD*, TABLE_LIST*, Table_specification_st*, Alter_info*))[0x55e04029a031]
 
sql/sql_parse.cc:3966(mysql_execute_command(THD*))[0x55e04021d53e]
 
sql/sql_parse.cc:7868(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x55e04021e21d]
 
sql/sql_parse.cc:1812(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55e040220dc6]
 
sql/sql_parse.cc:1362(do_command(THD*))[0x55e04022165f]
 
sql/sql_connect.cc:1354(do_handle_one_connection(CONNECT*))[0x55e0402dcee4]
 
sql/sql_connect.cc:1262(handle_one_connection)[0x55e0402dd054]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7f1c7e5606ba]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f1c7d9f53dd]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f1c1000efd0): CREATE TABLE `mytable` (  `id` int(11) NOT NULL, PRIMARY KEY (`id`)) ENGINE=Spider PARTITION BY LIST (`id`) ( PARTITION pt1 VALUES IN (1) comment 'host "127.0.0.1", port "3307", user "root" , table "mytable_1"  ', PARTITION pt2 VALUES IN (2) comment 'host "127.0.0.1", port "3307", user "root" , table "mytable_2"  ' )
 
Connection ID (thread ID): 10

Comment by Aurélien LEQUOY [ 2017-10-18 ]

this bug simple to reproduce =), about other one more hardly !

Comment by Jacob Mathew (Inactive) [ 2018-03-10 ]

Kentoku, please review my fix for this problem in commit 9024765 on my branch.

Comment by Kentoku Shiba (Inactive) [ 2018-03-13 ]

Jacob, LGTM. Please push this. Thank you for fixing.

Comment by Jacob Mathew (Inactive) [ 2018-03-13 ]

Fix is pushed to 10.2.14.

Generated at Thu Feb 08 08:10:16 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.