Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-13325

InnoDB assert dict_sys->size > 0 during ALTER TABLE

Details

    Description

      During repeated runs of a migration script in a single connection on an otherwise idle server, InnoDB crashes on an assert:

      2017-07-14 10:17:09 0x700004690000  InnoDB: Assertion failure in file /tmp/mariadb-20170712-4418-z03ns4/mariadb-10.2.7/storage/innobase/dict/dict0dict.cc line 1760
      InnoDB: Failing assertion: dict_sys->size > 0
      InnoDB: We intentionally generate a memory trap.
      InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
      InnoDB: If you get repeated assertion failures or crashes, even
      InnoDB: immediately after the mysqld startup, there may be
      InnoDB: corruption in the InnoDB tablespace. Please refer to
      InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
      InnoDB: about forcing recovery.
      170714 10:17:09 [ERROR] mysqld got signal 6 ;
      This could be because you hit a bug. It is also possible that this binary
      or one of the libraries it was linked against is corrupt, improperly built,
      or misconfigured. This error can also be caused by malfunctioning hardware.
       
      To report this bug, see https://mariadb.com/kb/en/reporting-bugs
       
      We will try our best to scrape up some info that will hopefully help
      diagnose the problem, but since we have already crashed,
      something is definitely wrong and this may fail.
       
      Server version: 10.2.7-MariaDB
      key_buffer_size=134217728
      read_buffer_size=131072
      max_used_connections=1
      max_threads=153
      thread_count=7
      It is possible that mysqld could use up to
      key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467207 K  bytes of memory
      Hope that's ok; if not, decrease some variables in the equation.
       
      Thread pointer: 0x7fe90f10c408
      Attempting backtrace. You can use the following information to find out
      where mysqld died. If you see no messages after this, something went
      terribly wrong...
      ...skipping...
      0   mysqld                              0x000000010e450c33 _Z11mysql_parseP3THDPcjP12Parser_statebb + 649
      0   mysqld                              0x000000010e44e862 _Z16dispatch_command19enum_server_commandP3THDPcjbb + 5485
      0   mysqld                              0x000000010e44fd64 _Z10do_commandP3THD + 892
      0   mysqld                              0x000000010e51f6de _Z24do_handle_one_connectionP7CONNECT + 547
      0   mysqld                              0x000000010e51f4ae handle_one_connection + 56
      0   libsystem_pthread.dylib             0x00007fffbd98393b _pthread_body + 180
      0   libsystem_pthread.dylib             0x00007fffbd983887 _pthread_body + 0
      0   libsystem_pthread.dylib             0x00007fffbd98308d thread_start + 13
       
      Trying to get some variables.
      Some pointers may be invalid and cause the dump to abort.
      Query (0x7fe910064e20): is an invalid pointer
      Connection ID (thread ID): 35
      Status: NOT_KILLED
       
      Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on
       
      The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
      information that should help you find out what is causing the crash.
       
      We think the query pointer is invalid, but we will try to print it anyway.
      Query: ALTER TABLE `instances` ADD COLUMN `resurrection_paused` tinyint(1)
      
      

      This was brought to my attention due to a similar crash on RDS on a MySQL 5.7.17 instances. AWS support pointed to this MySQL bug:

      https://bugs.mysql.com/bug.php?id=84672

      That was not reproducible apparently and hand-waved away as hardware troubles.

      This crash similarly occurs on Percona Server 5.7. This has been encountered in multiple environments, and this sample is from my local workstation.

      To reproduce I use the attached sql script and run:

      #!/bin/bash
       
      set -e
       
      while true; do
      mysql < migration_crasher.sql
      done
      

      This fails after approximately 15 seconds on my local environment.

      I additionally inspected data dictionary memory concurrently and found strange output:

      while true;do mysql -sse 'SHOW ENGINE INNODB STATUS\G' | egrep '^Dictionary memory allocated';sleep 0.1;done
      ...
      Dictionary memory allocated 14342
      Dictionary memory allocated 9811
      Dictionary memory allocated 211
      Dictionary memory allocated 20302
      Dictionary memory allocated 18446744073709551123
      Dictionary memory allocated 3955
      Dictionary memory allocated 3334
      Dictionary memory allocated 9997
      Dictionary memory allocated 18446744073709540819
      ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql.sock' (61)
      

      I was not able to reproduce this under MariaDB 10.1. Additionally, after enabling old_alter_table I could not reproduce the problem.

      Attachments

        Issue Links

          Activity

            Are there any errors, warnings or even notes from InnoDB in the error log prior to the assertion failure?
            Do you have cnf file(s) or show global variables output from the instance where the 10.2.7 crash occurred?

            elenst Elena Stepanova added a comment - Are there any errors, warnings or even notes from InnoDB in the error log prior to the assertion failure? Do you have cnf file(s) or show global variables output from the instance where the 10.2.7 crash occurred?
            andrew.garner Andrew Garner added a comment -

            Full output of the log from the initial mysql_install_db until crash:

            170714 12:24:21 mysqld_safe mysqld from pid file /usr/local/var/mysql/agarner-MacBook-Pro.local.pid ended
            170714 12:24:21 mysqld_safe Starting mysqld daemon with databases from /usr/local/var/mysql
            2017-07-14 12:24:21 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26055 ...
            2017-07-14 12:24:21 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Uses event mutexes
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Number of pools: 1
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Completed initialization of buffer pool
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: The first innodb_system data file 'ibdata1' did not exist. A new tablespace will be created!
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting file './ibdata1' size to 12 MB. Physically writing the file full; Please wait ...
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: File './ibdata1' size is now 12 MB.
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting log file ./ib_logfile101 size to 50331648 bytes
            2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting log file ./ib_logfile1 size to 50331648 bytes
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: New log files created, LSN=45892
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Doublewrite buffer not found: creating new
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Doublewrite buffer created
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active.
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating foreign key constraint system tables.
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating tablespace and datafile system tables.
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating sys_virtual system tables.
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Waiting for purge to start
            2017-07-14 12:24:22 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 0
            2017-07-14 12:24:22 140736522109888 [Note] Plugin 'FEEDBACK' is disabled.
            2017-07-14 12:24:22 140736522109888 [ERROR] Could not open mysql.plugin table. Some plugins may be not loaded
            2017-07-14 12:24:22 140736522109888 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist
            2017-07-14 12:24:22 140736522109888 [Note] Server socket created on IP: '::'.
            2017-07-14 12:24:22 140736522109888 [ERROR] Fatal error: Can't open and lock privilege tables: Table 'mysql.user' doesn't exist
            170714 12:24:22 mysqld_safe mysqld from pid file /usr/local/var/mysql/agarner-MacBook-Pro.local.pid ended
            170714 12:24:32 mysqld_safe Starting mysqld daemon with databases from /usr/local/var/mysql
            2017-07-14 12:24:32 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26152 ...
            2017-07-14 12:24:32 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Uses event mutexes
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Number of pools: 1
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Completed initialization of buffer pool
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Highest supported file format is Barracuda.
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active.
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Waiting for purge to start
            2017-07-14 12:24:32 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 1619378
            2017-07-14 12:24:32 123145500360704 [Note] InnoDB: Loading buffer pool(s) from /usr/local/var/mysql/ib_buffer_pool
            2017-07-14 12:24:32 123145500360704 [Note] InnoDB: Buffer pool(s) load completed at 170714 12:24:32
            2017-07-14 12:24:32 140736522109888 [Note] Plugin 'FEEDBACK' is disabled.
            2017-07-14 12:24:32 140736522109888 [Note] Server socket created on IP: '::'.
            2017-07-14 12:24:32 140736522109888 [Note] Reading of all Master_info entries succeded
            2017-07-14 12:24:32 140736522109888 [Note] Added new Master_info '' to hash table
            2017-07-14 12:24:32 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld: ready for connections.
            Version: '10.2.7-MariaDB'  socket: '/tmp/mysql.sock'  port: 3306  Homebrew
            2017-07-14 12:25:28 0x70000bfd3000  InnoDB: Assertion failure in file /tmp/mariadb-20170712-4418-z03ns4/mariadb-10.2.7/storage/innobase/dict/dict0dict.cc line 1760
            InnoDB: Failing assertion: dict_sys->size > 0
            InnoDB: We intentionally generate a memory trap.
            InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
            InnoDB: If you get repeated assertion failures or crashes, even
            InnoDB: immediately after the mysqld startup, there may be
            InnoDB: corruption in the InnoDB tablespace. Please refer to
            InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
            InnoDB: about forcing recovery.
            170714 12:25:28 [ERROR] mysqld got signal 6 ;
            This could be because you hit a bug. It is also possible that this binary
            or one of the libraries it was linked against is corrupt, improperly built,
            or misconfigured. This error can also be caused by malfunctioning hardware.
             
            To report this bug, see https://mariadb.com/kb/en/reporting-bugs
             
            We will try our best to scrape up some info that will hopefully help
            diagnose the problem, but since we have already crashed,
            something is definitely wrong and this may fail.
             
            Server version: 10.2.7-MariaDB
            key_buffer_size=134217728
            read_buffer_size=131072
            max_used_connections=1
            max_threads=153
            thread_count=7
            It is possible that mysqld could use up to
            key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467207 K  bytes of memory
            Hope that's ok; if not, decrease some variables in the equation.
             
            Thread pointer: 0x7fa90a82b208
            Attempting backtrace. You can use the following information to find out
            where mysqld died. If you see no messages after this, something went
            terribly wrong...
            stack_bottom = 0x70000bfd2e90 thread_stack 0x49000
            0   mysqld                              0x000000010b7a7638 my_print_stacktrace + 60
            0   mysqld                              0x000000010b1f0d2b handle_fatal_signal + 695
            0   libsystem_platform.dylib            0x00007fffbd979b3a _sigtramp + 26
            0   mysqld                              0x000000010bb744bf _ZZN15Query_log_event11dummy_eventEP6Stringm24enum_binlog_checksum_algE8var_name + 229944
            0   libsystem_c.dylib                   0x00007fffbd7fe420 abort + 129
            0   mysqld                              0x000000010b6a9979 _Z14ib_list_createv + 0
            0   mysqld                              0x000000010b53ff6b _Z26dict_table_rename_in_cacheP12dict_table_tPKcm + 4246
            0   mysqld                              0x000000010b5d100d _ZN11ha_innobase26commit_inplace_alter_tableEP5TABLEP18Alter_inplace_infob + 2561
            0   mysqld                              0x000000010b3fab80 _Z17mysql_alter_tableP3THDPcS1_P14HA_CREATE_INFOP10TABLE_LISTP10Alter_infojP8st_orderb + 15914
            0   mysqld                              0x000000010b449a1b _ZN19Sql_cmd_alter_table7executeEP3THD + 939
            0   mysqld                              0x000000010b3789ed _Z21mysql_execute_commandP3THD + 3809
            0   mysqld                              0x000000010b376c33 _Z11mysql_parseP3THDPcjP12Parser_statebb + 649
            0   mysqld                              0x000000010b374862 _Z16dispatch_command19enum_server_commandP3THDPcjbb + 5485
            0   mysqld                              0x000000010b375d64 _Z10do_commandP3THD + 892
            0   mysqld                              0x000000010b4456de _Z24do_handle_one_connectionP7CONNECT + 547
            0   mysqld                              0x000000010b4454ae handle_one_connection + 56
            0   libsystem_pthread.dylib             0x00007fffbd98393b _pthread_body + 180
            0   libsystem_pthread.dylib             0x00007fffbd983887 _pthread_body + 0
            0   libsystem_pthread.dylib             0x00007fffbd98308d thread_start + 13
             
            Trying to get some variables.
            Some pointers may be invalid and cause the dump to abort.
            Query (0x7fa90b05c420): is an invalid pointer
            Connection ID (thread ID): 34
            Status: NOT_KILLED
             
            Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on
             
            The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
            information that should help you find out what is causing the crash.
             
            We think the query pointer is invalid, but we will try to print it anyway.
            Query: ALTER TABLE `instances` ADD COLUMN `resurrection_paused` tinyint(1)
             
            170714 12:25:28 mysqld_safe mysqld restarted
            2017-07-14 12:25:28 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26349 ...
            2017-07-14 12:25:28 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Uses event mutexes
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Number of pools: 1
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Completed initialization of buffer pool
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Highest supported file format is Barracuda.
            2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14432741
            2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 607. Another data file called ./crash_mysqld/#sql-ib621-184483611.ibd exists with the same space ID.
            2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 606. Another data file called ./crash_mysqld/#sql-ib622-184483612.ibd exists with the same space ID.
            2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 607. Another data file called ./crash_mysqld/#sql-ib621-184483611.ibd exists with the same space ID.
            2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Starting final batch to recover 4160 pages from redo log.
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active.
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Waiting for purge to start
            2017-07-14 12:25:30 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 14492240
            2017-07-14 12:25:30 123145314869248 [Note] InnoDB: Loading buffer pool(s) from /usr/local/var/mysql/ib_buffer_pool
            2017-07-14 12:25:30 123145314869248 [Note] InnoDB: Buffer pool(s) load completed at 170714 12:25:30
            2017-07-14 12:25:30 140736522109888 [Note] Plugin 'FEEDBACK' is disabled.
            2017-07-14 12:25:30 140736522109888 [Note] Recovering after a crash using tc.log
            2017-07-14 12:25:30 140736522109888 [Note] Starting crash recovery...
            2017-07-14 12:25:30 140736522109888 [Note] Crash recovery finished.
            2017-07-14 12:25:30 140736522109888 [Note] Server socket created on IP: '::'.
            2017-07-14 12:25:30 140736522109888 [Note] Reading of all Master_info entries succeded
            2017-07-14 12:25:30 140736522109888 [Note] Added new Master_info '' to hash table
            2017-07-14 12:25:30 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld: ready for connections.
            Version: '10.2.7-MariaDB'  socket: '/tmp/mysql.sock'  port: 3306  Homebrew
            

            Using a default (empty) my.cnf with a precompiled (homebrew) MariaDB 10.2.7 for this test. Here's the running global variables:

            $ mysql -sse 'SHOW GLOBAL VARIABLES'
            aria_block_size	8192
            aria_checkpoint_interval	30
            aria_checkpoint_log_activity	1048576
            aria_encrypt_tables	OFF
            aria_force_start_after_recovery_failures	0
            aria_group_commit	none
            aria_group_commit_interval	0
            aria_log_file_size	1073741824
            aria_log_purge_type	immediate
            aria_max_sort_file_size	9223372036853727232
            aria_page_checksum	ON
            aria_pagecache_age_threshold	300
            aria_pagecache_buffer_size	134217728
            aria_pagecache_division_limit	100
            aria_pagecache_file_hash_size	512
            aria_recover_options	BACKUP,QUICK
            aria_repair_threads	1
            aria_sort_buffer_size	268434432
            aria_stats_method	nulls_unequal
            aria_sync_log_dir	NEWFILE
            aria_used_for_temp_tables	ON
            auto_increment_increment	1
            auto_increment_offset	1
            autocommit	ON
            automatic_sp_privileges	ON
            back_log	80
            basedir	/usr/local/opt/mariadb
            big_tables	OFF
            binlog_annotate_row_events	ON
            binlog_cache_size	32768
            binlog_checksum	CRC32
            binlog_commit_wait_count	0
            binlog_commit_wait_usec	100000
            binlog_direct_non_transactional_updates	OFF
            binlog_format	MIXED
            binlog_optimize_thread_scheduling	ON
            binlog_row_image	FULL
            binlog_stmt_cache_size	32768
            bulk_insert_buffer_size	8388608
            character_set_client	utf8
            character_set_connection	utf8
            character_set_database	utf8
            character_set_filesystem	binary
            character_set_results	utf8
            character_set_server	utf8
            character_set_system	utf8
            character_sets_dir	/usr/local/Cellar/mariadb/10.2.7/share/mysql/charsets/
            check_constraint_checks	ON
            collation_connection	utf8_general_ci
            collation_database	utf8_general_ci
            collation_server	utf8_general_ci
            completion_type	NO_CHAIN
            concurrent_insert	AUTO
            connect_timeout	10
            datadir	/usr/local/var/mysql/
            date_format	%Y-%m-%d
            datetime_format	%Y-%m-%d %H:%i:%s
            deadlock_search_depth_long	15
            deadlock_search_depth_short	4
            deadlock_timeout_long	50000000
            deadlock_timeout_short	10000
            debug_no_thread_alarm	OFF
            default_regex_flags
            default_storage_engine	InnoDB
            default_tmp_storage_engine
            default_week_format	0
            delay_key_write	ON
            delayed_insert_limit	100
            delayed_insert_timeout	300
            delayed_queue_size	1000
            div_precision_increment	4
            encrypt_binlog	OFF
            encrypt_tmp_disk_tables	OFF
            encrypt_tmp_files	OFF
            enforce_storage_engine
            event_scheduler	OFF
            expensive_subquery_limit	100
            expire_logs_days	0
            explicit_defaults_for_timestamp	OFF
            extra_max_connections	1
            extra_port	0
            flush	OFF
            flush_time	0
            foreign_key_checks	ON
            ft_boolean_syntax	+ -><()~*:""&|
            ft_max_word_len	84
            ft_min_word_len	4
            ft_query_expansion_limit	20
            ft_stopword_file	(built-in)
            general_log	OFF
            general_log_file	agarner-MacBook-Pro.log
            group_concat_max_len	1048576
            gtid_binlog_pos
            gtid_binlog_state
            gtid_current_pos
            gtid_domain_id	0
            gtid_ignore_duplicates	OFF
            gtid_slave_pos
            gtid_strict_mode	OFF
            have_compress	YES
            have_crypt	YES
            have_dynamic_loading	YES
            have_geometry	YES
            have_openssl	YES
            have_profiling	YES
            have_query_cache	YES
            have_rtree_keys	YES
            have_ssl	DISABLED
            have_symlink	YES
            histogram_size	0
            histogram_type	SINGLE_PREC_HB
            host_cache_size	279
            hostname	agarner-MacBook-Pro.local
            ignore_builtin_innodb	OFF
            ignore_db_dirs
            init_connect
            init_file
            init_slave
            innodb_adaptive_flushing	ON
            innodb_adaptive_flushing_lwm	10.000000
            innodb_adaptive_hash_index	ON
            innodb_adaptive_hash_index_partitions	8
            innodb_adaptive_hash_index_parts	8
            innodb_adaptive_max_sleep_delay	150000
            innodb_autoextend_increment	64
            innodb_autoinc_lock_mode	1
            innodb_background_scrub_data_check_interval	3600
            innodb_background_scrub_data_compressed	OFF
            innodb_background_scrub_data_interval	604800
            innodb_background_scrub_data_uncompressed	OFF
            innodb_buf_dump_status_frequency	0
            innodb_buffer_pool_chunk_size	134217728
            innodb_buffer_pool_dump_at_shutdown	ON
            innodb_buffer_pool_dump_now	OFF
            innodb_buffer_pool_dump_pct	25
            innodb_buffer_pool_filename	ib_buffer_pool
            innodb_buffer_pool_instances	1
            innodb_buffer_pool_load_abort	OFF
            innodb_buffer_pool_load_at_startup	ON
            innodb_buffer_pool_load_now	OFF
            innodb_buffer_pool_populate	OFF
            innodb_buffer_pool_size	134217728
            innodb_change_buffer_max_size	25
            innodb_change_buffering	all
            innodb_checksum_algorithm	crc32
            innodb_checksums	ON
            innodb_cleaner_lsn_age_factor	DEPRECATED
            innodb_cmp_per_index_enabled	OFF
            innodb_commit_concurrency	0
            innodb_compression_algorithm	zlib
            innodb_compression_default	OFF
            innodb_compression_failure_threshold_pct	5
            innodb_compression_level	6
            innodb_compression_pad_pct_max	50
            innodb_concurrency_tickets	5000
            innodb_corrupt_table_action	deprecated
            innodb_data_file_path	ibdata1:12M:autoextend
            innodb_data_home_dir
            innodb_deadlock_detect	ON
            innodb_default_encryption_key_id	1
            innodb_default_row_format	dynamic
            innodb_defragment	OFF
            innodb_defragment_fill_factor	0.900000
            innodb_defragment_fill_factor_n_recs	20
            innodb_defragment_frequency	40
            innodb_defragment_n_pages	7
            innodb_defragment_stats_accuracy	0
            innodb_disable_sort_file_cache	OFF
            innodb_disallow_writes	OFF
            innodb_doublewrite	ON
            innodb_empty_free_list_algorithm	DEPRECATED
            innodb_encrypt_log	OFF
            innodb_encrypt_tables	OFF
            innodb_encryption_rotate_key_age	1
            innodb_encryption_rotation_iops	100
            innodb_encryption_threads	0
            innodb_fake_changes	OFF
            innodb_fast_shutdown	1
            innodb_fatal_semaphore_wait_threshold	600
            innodb_file_format	Barracuda
            innodb_file_format_check	ON
            innodb_file_format_max	Barracuda
            innodb_file_per_table	ON
            innodb_fill_factor	100
            innodb_flush_log_at_timeout	1
            innodb_flush_log_at_trx_commit	1
            innodb_flush_method
            innodb_flush_neighbors	1
            innodb_flush_sync	ON
            innodb_flushing_avg_loops	30
            innodb_force_load_corrupted	OFF
            innodb_force_primary_key	OFF
            innodb_force_recovery	0
            innodb_foreground_preflush	DEPRECATED
            innodb_ft_aux_table
            innodb_ft_cache_size	8000000
            innodb_ft_enable_diag_print	OFF
            innodb_ft_enable_stopword	ON
            innodb_ft_max_token_size	84
            innodb_ft_min_token_size	3
            innodb_ft_num_word_optimize	2000
            innodb_ft_result_cache_limit	2000000000
            innodb_ft_server_stopword_table
            innodb_ft_sort_pll_degree	2
            innodb_ft_total_cache_size	640000000
            innodb_ft_user_stopword_table
            innodb_idle_flush_pct	100
            innodb_immediate_scrub_data_uncompressed	OFF
            innodb_instrument_semaphores	OFF
            innodb_io_capacity	200
            innodb_io_capacity_max	2000
            innodb_kill_idle_transaction	0
            innodb_large_prefix	ON
            innodb_lock_schedule_algorithm	vats
            innodb_lock_wait_timeout	50
            innodb_locking_fake_changes	OFF
            innodb_locks_unsafe_for_binlog	OFF
            innodb_log_arch_dir
            innodb_log_arch_expire_sec	0
            innodb_log_archive	OFF
            innodb_log_block_size	0
            innodb_log_buffer_size	16777216
            innodb_log_checksum_algorithm	DEPRECATED
            innodb_log_checksums	ON
            innodb_log_compressed_pages	ON
            innodb_log_file_size	50331648
            innodb_log_files_in_group	2
            innodb_log_group_home_dir	./
            innodb_log_write_ahead_size	8192
            innodb_lru_scan_depth	1024
            innodb_max_bitmap_file_size	0
            innodb_max_changed_pages	0
            innodb_max_dirty_pages_pct	75.000000
            innodb_max_dirty_pages_pct_lwm	0.000000
            innodb_max_purge_lag	0
            innodb_max_purge_lag_delay	0
            innodb_max_undo_log_size	10485760
            innodb_mirrored_log_groups	0
            innodb_monitor_disable
            innodb_monitor_enable
            innodb_monitor_reset
            innodb_monitor_reset_all
            innodb_mtflush_threads	8
            innodb_old_blocks_pct	37
            innodb_old_blocks_time	1000
            innodb_online_alter_log_max_size	134217728
            innodb_open_files	2000
            innodb_optimize_fulltext_only	OFF
            innodb_page_cleaners	1
            innodb_page_size	16384
            innodb_prefix_index_cluster_optimization	OFF
            innodb_print_all_deadlocks	OFF
            innodb_purge_batch_size	300
            innodb_purge_rseg_truncate_frequency	128
            innodb_purge_threads	4
            innodb_random_read_ahead	OFF
            innodb_read_ahead_threshold	56
            innodb_read_io_threads	4
            innodb_read_only	OFF
            innodb_replication_delay	0
            innodb_rollback_on_timeout	OFF
            innodb_rollback_segments	128
            innodb_scrub_log	OFF
            innodb_scrub_log_speed	256
            innodb_show_locks_held	0
            innodb_show_verbose_locks	0
            innodb_sort_buffer_size	1048576
            innodb_spin_wait_delay	6
            innodb_stats_auto_recalc	ON
            innodb_stats_include_delete_marked	OFF
            innodb_stats_method	nulls_equal
            innodb_stats_modified_counter	0
            innodb_stats_on_metadata	OFF
            innodb_stats_persistent	ON
            innodb_stats_persistent_sample_pages	20
            innodb_stats_sample_pages	8
            innodb_stats_traditional	ON
            innodb_stats_transient_sample_pages	8
            innodb_status_output	OFF
            innodb_status_output_locks	OFF
            innodb_strict_mode	ON
            innodb_support_xa	ON
            innodb_sync_array_size	1
            innodb_sync_spin_loops	30
            innodb_table_locks	ON
            innodb_temp_data_file_path	ibtmp1:12M:autoextend
            innodb_thread_concurrency	0
            innodb_thread_sleep_delay	10000
            innodb_tmpdir
            innodb_track_changed_pages	OFF
            innodb_track_redo_log_now	OFF
            innodb_undo_directory	./
            innodb_undo_log_truncate	OFF
            innodb_undo_logs	128
            innodb_undo_tablespaces	0
            innodb_use_atomic_writes	ON
            innodb_use_fallocate	OFF
            innodb_use_global_flush_log_at_trx_commit	OFF
            innodb_use_mtflush	OFF
            innodb_use_native_aio	OFF
            innodb_use_stacktrace	OFF
            innodb_use_trim	ON
            innodb_version	5.7.18
            innodb_write_io_threads	4
            interactive_timeout	28800
            join_buffer_size	262144
            join_buffer_space_limit	2097152
            join_cache_level	2
            keep_files_on_create	OFF
            key_buffer_size	134217728
            key_cache_age_threshold	300
            key_cache_block_size	1024
            key_cache_division_limit	100
            key_cache_file_hash_size	512
            key_cache_segments	0
            large_files_support	ON
            large_page_size	0
            large_pages	OFF
            lc_messages	en_US
            lc_messages_dir
            lc_time_names	en_US
            license	GPL
            local_infile	ON
            lock_wait_timeout	86400
            locked_in_memory	OFF
            log_bin	OFF
            log_bin_basename
            log_bin_compress	OFF
            log_bin_compress_min_len	256
            log_bin_index
            log_bin_trust_function_creators	OFF
            log_error	/usr/local/var/mysql/agarner-MacBook-Pro.local.err
            log_output	FILE
            log_queries_not_using_indexes	OFF
            log_slave_updates	OFF
            log_slow_admin_statements	ON
            log_slow_filter	admin,filesort,filesort_on_disk,full_join,full_scan,query_cache,query_cache_miss,tmp_table,tmp_table_on_disk
            log_slow_rate_limit	1
            log_slow_slave_statements	ON
            log_slow_verbosity
            log_tc_size	24576
            log_warnings	2
            long_query_time	10.000000
            low_priority_updates	OFF
            lower_case_file_system	ON
            lower_case_table_names	2
            master_verify_checksum	OFF
            max_allowed_packet	16777216
            max_binlog_cache_size	18446744073709547520
            max_binlog_size	1073741824
            max_binlog_stmt_cache_size	18446744073709547520
            max_connect_errors	100
            max_connections	151
            max_delayed_threads	20
            max_digest_length	1024
            max_error_count	64
            max_heap_table_size	16777216
            max_insert_delayed_threads	20
            max_join_size	18446744073709551615
            max_length_for_sort_data	1024
            max_long_data_size	16777216
            max_prepared_stmt_count	16382
            max_recursive_iterations	4294967295
            max_relay_log_size	1073741824
            max_seeks_for_key	4294967295
            max_session_mem_used	9223372036854775807
            max_sort_length	1024
            max_sp_recursion_depth	0
            max_statement_time	0.000000
            max_tmp_tables	32
            max_user_connections	0
            max_write_lock_count	4294967295
            metadata_locks_cache_size	1024
            metadata_locks_hash_instances	8
            min_examined_row_limit	0
            mrr_buffer_size	262144
            multi_range_count	256
            myisam_block_size	1024
            myisam_data_pointer_size	6
            myisam_max_sort_file_size	9223372036853727232
            myisam_mmap_size	18446744073709551615
            myisam_recover_options	BACKUP,QUICK
            myisam_repair_threads	1
            myisam_sort_buffer_size	134216704
            myisam_stats_method	NULLS_UNEQUAL
            myisam_use_mmap	OFF
            mysql56_temporal_format	ON
            net_buffer_length	16384
            net_read_timeout	30
            net_retry_count	10
            net_write_timeout	60
            old	OFF
            old_alter_table	OFF
            old_mode
            old_passwords	OFF
            open_files_limit	4162
            optimizer_prune_level	1
            optimizer_search_depth	62
            optimizer_selectivity_sampling_limit	100
            optimizer_switch	index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on
            optimizer_use_condition_selectivity	1
            performance_schema	OFF
            performance_schema_accounts_size	-1
            performance_schema_digests_size	-1
            performance_schema_events_stages_history_long_size	-1
            performance_schema_events_stages_history_size	-1
            performance_schema_events_statements_history_long_size	-1
            performance_schema_events_statements_history_size	-1
            performance_schema_events_waits_history_long_size	-1
            performance_schema_events_waits_history_size	-1
            performance_schema_hosts_size	-1
            performance_schema_max_cond_classes	80
            performance_schema_max_cond_instances	-1
            performance_schema_max_digest_length	1024
            performance_schema_max_file_classes	50
            performance_schema_max_file_handles	32768
            performance_schema_max_file_instances	-1
            performance_schema_max_mutex_classes	200
            performance_schema_max_mutex_instances	-1
            performance_schema_max_rwlock_classes	40
            performance_schema_max_rwlock_instances	-1
            performance_schema_max_socket_classes	10
            performance_schema_max_socket_instances	-1
            performance_schema_max_stage_classes	150
            performance_schema_max_statement_classes	188
            performance_schema_max_table_handles	-1
            performance_schema_max_table_instances	-1
            performance_schema_max_thread_classes	50
            performance_schema_max_thread_instances	-1
            performance_schema_session_connect_attrs_size	-1
            performance_schema_setup_actors_size	100
            performance_schema_setup_objects_size	100
            performance_schema_users_size	-1
            pid_file	/usr/local/var/mysql/agarner-MacBook-Pro.local.pid
            plugin_dir	/usr/local/opt/mariadb/lib/plugin/
            plugin_maturity	unknown
            port	3306
            preload_buffer_size	32768
            profiling	OFF
            profiling_history_size	15
            progress_report_time	5
            protocol_version	10
            query_alloc_block_size	16384
            query_cache_limit	1048576
            query_cache_min_res_unit	4096
            query_cache_size	1048576
            query_cache_strip_comments	OFF
            query_cache_type	OFF
            query_cache_wlock_invalidate	OFF
            query_prealloc_size	24576
            range_alloc_block_size	4096
            read_binlog_speed_limit	0
            read_buffer_size	131072
            read_only	OFF
            read_rnd_buffer_size	262144
            relay_log
            relay_log_basename
            relay_log_index
            relay_log_info_file	relay-log.info
            relay_log_purge	ON
            relay_log_recovery	OFF
            relay_log_space_limit	0
            replicate_annotate_row_events	ON
            replicate_do_db
            replicate_do_table
            replicate_events_marked_for_skip	REPLICATE
            replicate_ignore_db
            replicate_ignore_table
            replicate_wild_do_table
            replicate_wild_ignore_table
            report_host
            report_password
            report_port	3306
            report_user
            rowid_merge_buff_size	8388608
            secure_auth	ON
            secure_file_priv
            server_id	1
            session_track_schema	ON
            session_track_state_change	OFF
            session_track_system_variables
            session_track_transaction_info	OFF
            skip_external_locking	ON
            skip_name_resolve	OFF
            skip_networking	OFF
            skip_show_database	OFF
            slave_compressed_protocol	OFF
            slave_ddl_exec_mode	IDEMPOTENT
            slave_domain_parallel_threads	0
            slave_exec_mode	STRICT
            slave_load_tmpdir	/var/folders/wg/_x14700s5hv329slgbcc88780000gn/T/
            slave_max_allowed_packet	1073741824
            slave_net_timeout	60
            slave_parallel_max_queued	131072
            slave_parallel_mode	conservative
            slave_parallel_threads	0
            slave_parallel_workers	0
            slave_run_triggers_for_rbr	NO
            slave_skip_errors	OFF
            slave_sql_verify_checksum	ON
            slave_transaction_retries	10
            slave_type_conversions
            slow_launch_time	2
            slow_query_log	OFF
            slow_query_log_file	agarner-MacBook-Pro-slow.log
            socket	/tmp/mysql.sock
            sort_buffer_size	2097152
            sql_auto_is_null	OFF
            sql_big_selects	ON
            sql_buffer_result	OFF
            sql_log_bin	ON
            sql_log_off	OFF
            sql_mode	STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
            sql_notes	ON
            sql_quote_show_create	ON
            sql_safe_updates	OFF
            sql_select_limit	18446744073709551615
            sql_slave_skip_counter	0
            sql_warnings	OFF
            ssl_ca
            ssl_capath
            ssl_cert
            ssl_cipher
            ssl_crl
            ssl_crlpath
            ssl_key
            standard_compliant_cte	ON
            storage_engine	InnoDB
            stored_program_cache	256
            strict_password_validation	ON
            sync_binlog	0
            sync_frm	ON
            sync_master_info	10000
            sync_relay_log	10000
            sync_relay_log_info	10000
            system_time_zone	CDT
            table_definition_cache	400
            table_open_cache	2000
            table_open_cache_instances	8
            thread_cache_size	151
            thread_concurrency	10
            thread_handling	one-thread-per-connection
            thread_pool_idle_timeout	60
            thread_pool_max_threads	65536
            thread_pool_oversubscribe	3
            thread_pool_prio_kickup_timer	1000
            thread_pool_priority	auto
            thread_pool_size	8
            thread_pool_stall_limit	500
            thread_stack	299008
            time_format	%H:%i:%s
            time_zone	SYSTEM
            timed_mutexes	OFF
            tmp_disk_table_size	18446744073709551615
            tmp_memory_table_size	16777216
            tmp_table_size	16777216
            tmpdir	/var/folders/wg/_x14700s5hv329slgbcc88780000gn/T/
            transaction_alloc_block_size	8192
            transaction_prealloc_size	4096
            tx_isolation	REPEATABLE-READ
            tx_read_only	OFF
            unique_checks	ON
            updatable_views_with_limit	YES
            use_stat_tables	NEVER
            userstat	OFF
            version	10.2.7-MariaDB
            version_comment	Homebrew
            version_compile_machine	x86_64
            version_compile_os	osx10.12
            version_malloc_library	system
            version_ssl_library	OpenSSL 1.0.2l  25 May 2017
            wait_timeout	28800
            wsrep_osu_method	TOI
            wsrep_auto_increment_control	ON
            wsrep_causal_reads	OFF
            wsrep_certify_nonpk	ON
            wsrep_cluster_address
            wsrep_cluster_name	my_wsrep_cluster
            wsrep_convert_lock_to_trx	OFF
            wsrep_data_home_dir	/usr/local/var/mysql/
            wsrep_dbug_option
            wsrep_debug	OFF
            wsrep_desync	OFF
            wsrep_dirty_reads	OFF
            wsrep_drupal_282555_workaround	OFF
            wsrep_forced_binlog_format	NONE
            wsrep_gtid_domain_id	0
            wsrep_gtid_mode	OFF
            wsrep_load_data_splitting	ON
            wsrep_log_conflicts	OFF
            wsrep_max_ws_rows	0
            wsrep_max_ws_size	2147483647
            wsrep_mysql_replication_bundle	0
            wsrep_node_address
            wsrep_node_incoming_address	AUTO
            wsrep_node_name	agarner-MacBook-Pro.local
            wsrep_notify_cmd
            wsrep_on	OFF
            wsrep_patch_version	wsrep_25.19
            wsrep_provider	none
            wsrep_provider_options
            wsrep_recover	OFF
            wsrep_replicate_myisam	OFF
            wsrep_restart_slave	OFF
            wsrep_retry_autocommit	1
            wsrep_slave_fk_checks	ON
            wsrep_slave_uk_checks	OFF
            wsrep_slave_threads	1
            wsrep_sst_auth
            wsrep_sst_donor
            wsrep_sst_donor_rejects_queries	OFF
            wsrep_sst_method	rsync
            wsrep_sst_receive_address	AUTO
            wsrep_start_position	00000000-0000-0000-0000-000000000000:-1
            wsrep_sync_wait	0
            

            andrew.garner Andrew Garner added a comment - Full output of the log from the initial mysql_install_db until crash: 170714 12:24:21 mysqld_safe mysqld from pid file /usr/local/var/mysql/agarner-MacBook-Pro.local.pid ended 170714 12:24:21 mysqld_safe Starting mysqld daemon with databases from /usr/local/var/mysql 2017-07-14 12:24:21 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26055 ... 2017-07-14 12:24:21 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Uses event mutexes 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Number of pools: 1 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Completed initialization of buffer pool 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: The first innodb_system data file 'ibdata1' did not exist. A new tablespace will be created! 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting file './ibdata1' size to 12 MB. Physically writing the file full; Please wait ... 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: File './ibdata1' size is now 12 MB. 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting log file ./ib_logfile101 size to 50331648 bytes 2017-07-14 12:24:21 140736522109888 [Note] InnoDB: Setting log file ./ib_logfile1 size to 50331648 bytes 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: New log files created, LSN=45892 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Doublewrite buffer not found: creating new 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Doublewrite buffer created 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active. 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating foreign key constraint system tables. 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating tablespace and datafile system tables. 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating sys_virtual system tables. 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: Waiting for purge to start 2017-07-14 12:24:22 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 0 2017-07-14 12:24:22 140736522109888 [Note] Plugin 'FEEDBACK' is disabled. 2017-07-14 12:24:22 140736522109888 [ERROR] Could not open mysql.plugin table. Some plugins may be not loaded 2017-07-14 12:24:22 140736522109888 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist 2017-07-14 12:24:22 140736522109888 [Note] Server socket created on IP: '::'. 2017-07-14 12:24:22 140736522109888 [ERROR] Fatal error: Can't open and lock privilege tables: Table 'mysql.user' doesn't exist 170714 12:24:22 mysqld_safe mysqld from pid file /usr/local/var/mysql/agarner-MacBook-Pro.local.pid ended 170714 12:24:32 mysqld_safe Starting mysqld daemon with databases from /usr/local/var/mysql 2017-07-14 12:24:32 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26152 ... 2017-07-14 12:24:32 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Uses event mutexes 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Number of pools: 1 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Completed initialization of buffer pool 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Highest supported file format is Barracuda. 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active. 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: Waiting for purge to start 2017-07-14 12:24:32 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 1619378 2017-07-14 12:24:32 123145500360704 [Note] InnoDB: Loading buffer pool(s) from /usr/local/var/mysql/ib_buffer_pool 2017-07-14 12:24:32 123145500360704 [Note] InnoDB: Buffer pool(s) load completed at 170714 12:24:32 2017-07-14 12:24:32 140736522109888 [Note] Plugin 'FEEDBACK' is disabled. 2017-07-14 12:24:32 140736522109888 [Note] Server socket created on IP: '::'. 2017-07-14 12:24:32 140736522109888 [Note] Reading of all Master_info entries succeded 2017-07-14 12:24:32 140736522109888 [Note] Added new Master_info '' to hash table 2017-07-14 12:24:32 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld: ready for connections. Version: '10.2.7-MariaDB' socket: '/tmp/mysql.sock' port: 3306 Homebrew 2017-07-14 12:25:28 0x70000bfd3000 InnoDB: Assertion failure in file /tmp/mariadb-20170712-4418-z03ns4/mariadb-10.2.7/storage/innobase/dict/dict0dict.cc line 1760 InnoDB: Failing assertion: dict_sys->size > 0 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. 170714 12:25:28 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware.   To report this bug, see https://mariadb.com/kb/en/reporting-bugs   We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.   Server version: 10.2.7-MariaDB key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=1 max_threads=153 thread_count=7 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467207 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.   Thread pointer: 0x7fa90a82b208 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x70000bfd2e90 thread_stack 0x49000 0 mysqld 0x000000010b7a7638 my_print_stacktrace + 60 0 mysqld 0x000000010b1f0d2b handle_fatal_signal + 695 0 libsystem_platform.dylib 0x00007fffbd979b3a _sigtramp + 26 0 mysqld 0x000000010bb744bf _ZZN15Query_log_event11dummy_eventEP6Stringm24enum_binlog_checksum_algE8var_name + 229944 0 libsystem_c.dylib 0x00007fffbd7fe420 abort + 129 0 mysqld 0x000000010b6a9979 _Z14ib_list_createv + 0 0 mysqld 0x000000010b53ff6b _Z26dict_table_rename_in_cacheP12dict_table_tPKcm + 4246 0 mysqld 0x000000010b5d100d _ZN11ha_innobase26commit_inplace_alter_tableEP5TABLEP18Alter_inplace_infob + 2561 0 mysqld 0x000000010b3fab80 _Z17mysql_alter_tableP3THDPcS1_P14HA_CREATE_INFOP10TABLE_LISTP10Alter_infojP8st_orderb + 15914 0 mysqld 0x000000010b449a1b _ZN19Sql_cmd_alter_table7executeEP3THD + 939 0 mysqld 0x000000010b3789ed _Z21mysql_execute_commandP3THD + 3809 0 mysqld 0x000000010b376c33 _Z11mysql_parseP3THDPcjP12Parser_statebb + 649 0 mysqld 0x000000010b374862 _Z16dispatch_command19enum_server_commandP3THDPcjbb + 5485 0 mysqld 0x000000010b375d64 _Z10do_commandP3THD + 892 0 mysqld 0x000000010b4456de _Z24do_handle_one_connectionP7CONNECT + 547 0 mysqld 0x000000010b4454ae handle_one_connection + 56 0 libsystem_pthread.dylib 0x00007fffbd98393b _pthread_body + 180 0 libsystem_pthread.dylib 0x00007fffbd983887 _pthread_body + 0 0 libsystem_pthread.dylib 0x00007fffbd98308d thread_start + 13   Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7fa90b05c420): is an invalid pointer Connection ID (thread ID): 34 Status: NOT_KILLED   Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on   The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash.   We think the query pointer is invalid, but we will try to print it anyway. Query: ALTER TABLE `instances` ADD COLUMN `resurrection_paused` tinyint(1)   170714 12:25:28 mysqld_safe mysqld restarted 2017-07-14 12:25:28 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld (mysqld 10.2.7-MariaDB) starting as process 26349 ... 2017-07-14 12:25:28 140736522109888 [Warning] Setting lower_case_table_names=2 because file system for /usr/local/var/mysql/ is case insensitive 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Uses event mutexes 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Compressed tables use zlib 1.2.8 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Number of pools: 1 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Using SSE2 crc32 instructions 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Completed initialization of buffer pool 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Highest supported file format is Barracuda. 2017-07-14 12:25:28 140736522109888 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14432741 2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 607. Another data file called ./crash_mysqld/#sql-ib621-184483611.ibd exists with the same space ID. 2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 606. Another data file called ./crash_mysqld/#sql-ib622-184483612.ibd exists with the same space ID. 2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Ignoring data file './crash_mysqld/instances.ibd' with space ID 607. Another data file called ./crash_mysqld/#sql-ib621-184483611.ibd exists with the same space ID. 2017-07-14 12:25:29 140736522109888 [Note] InnoDB: Starting final batch to recover 4160 pages from redo log. 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: 128 out of 128 rollback segments are active. 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Creating shared tablespace for temporary tables 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: Waiting for purge to start 2017-07-14 12:25:30 140736522109888 [Note] InnoDB: 5.7.18 started; log sequence number 14492240 2017-07-14 12:25:30 123145314869248 [Note] InnoDB: Loading buffer pool(s) from /usr/local/var/mysql/ib_buffer_pool 2017-07-14 12:25:30 123145314869248 [Note] InnoDB: Buffer pool(s) load completed at 170714 12:25:30 2017-07-14 12:25:30 140736522109888 [Note] Plugin 'FEEDBACK' is disabled. 2017-07-14 12:25:30 140736522109888 [Note] Recovering after a crash using tc.log 2017-07-14 12:25:30 140736522109888 [Note] Starting crash recovery... 2017-07-14 12:25:30 140736522109888 [Note] Crash recovery finished. 2017-07-14 12:25:30 140736522109888 [Note] Server socket created on IP: '::'. 2017-07-14 12:25:30 140736522109888 [Note] Reading of all Master_info entries succeded 2017-07-14 12:25:30 140736522109888 [Note] Added new Master_info '' to hash table 2017-07-14 12:25:30 140736522109888 [Note] /usr/local/opt/mariadb/bin/mysqld: ready for connections. Version: '10.2.7-MariaDB' socket: '/tmp/mysql.sock' port: 3306 Homebrew Using a default (empty) my.cnf with a precompiled (homebrew) MariaDB 10.2.7 for this test. Here's the running global variables: $ mysql -sse 'SHOW GLOBAL VARIABLES' aria_block_size 8192 aria_checkpoint_interval 30 aria_checkpoint_log_activity 1048576 aria_encrypt_tables OFF aria_force_start_after_recovery_failures 0 aria_group_commit none aria_group_commit_interval 0 aria_log_file_size 1073741824 aria_log_purge_type immediate aria_max_sort_file_size 9223372036853727232 aria_page_checksum ON aria_pagecache_age_threshold 300 aria_pagecache_buffer_size 134217728 aria_pagecache_division_limit 100 aria_pagecache_file_hash_size 512 aria_recover_options BACKUP,QUICK aria_repair_threads 1 aria_sort_buffer_size 268434432 aria_stats_method nulls_unequal aria_sync_log_dir NEWFILE aria_used_for_temp_tables ON auto_increment_increment 1 auto_increment_offset 1 autocommit ON automatic_sp_privileges ON back_log 80 basedir /usr/local/opt/mariadb big_tables OFF binlog_annotate_row_events ON binlog_cache_size 32768 binlog_checksum CRC32 binlog_commit_wait_count 0 binlog_commit_wait_usec 100000 binlog_direct_non_transactional_updates OFF binlog_format MIXED binlog_optimize_thread_scheduling ON binlog_row_image FULL binlog_stmt_cache_size 32768 bulk_insert_buffer_size 8388608 character_set_client utf8 character_set_connection utf8 character_set_database utf8 character_set_filesystem binary character_set_results utf8 character_set_server utf8 character_set_system utf8 character_sets_dir /usr/local/Cellar/mariadb/10.2.7/share/mysql/charsets/ check_constraint_checks ON collation_connection utf8_general_ci collation_database utf8_general_ci collation_server utf8_general_ci completion_type NO_CHAIN concurrent_insert AUTO connect_timeout 10 datadir /usr/local/var/mysql/ date_format %Y-%m-%d datetime_format %Y-%m-%d %H:%i:%s deadlock_search_depth_long 15 deadlock_search_depth_short 4 deadlock_timeout_long 50000000 deadlock_timeout_short 10000 debug_no_thread_alarm OFF default_regex_flags default_storage_engine InnoDB default_tmp_storage_engine default_week_format 0 delay_key_write ON delayed_insert_limit 100 delayed_insert_timeout 300 delayed_queue_size 1000 div_precision_increment 4 encrypt_binlog OFF encrypt_tmp_disk_tables OFF encrypt_tmp_files OFF enforce_storage_engine event_scheduler OFF expensive_subquery_limit 100 expire_logs_days 0 explicit_defaults_for_timestamp OFF extra_max_connections 1 extra_port 0 flush OFF flush_time 0 foreign_key_checks ON ft_boolean_syntax + -><()~*:""&| ft_max_word_len 84 ft_min_word_len 4 ft_query_expansion_limit 20 ft_stopword_file (built-in) general_log OFF general_log_file agarner-MacBook-Pro.log group_concat_max_len 1048576 gtid_binlog_pos gtid_binlog_state gtid_current_pos gtid_domain_id 0 gtid_ignore_duplicates OFF gtid_slave_pos gtid_strict_mode OFF have_compress YES have_crypt YES have_dynamic_loading YES have_geometry YES have_openssl YES have_profiling YES have_query_cache YES have_rtree_keys YES have_ssl DISABLED have_symlink YES histogram_size 0 histogram_type SINGLE_PREC_HB host_cache_size 279 hostname agarner-MacBook-Pro.local ignore_builtin_innodb OFF ignore_db_dirs init_connect init_file init_slave innodb_adaptive_flushing ON innodb_adaptive_flushing_lwm 10.000000 innodb_adaptive_hash_index ON innodb_adaptive_hash_index_partitions 8 innodb_adaptive_hash_index_parts 8 innodb_adaptive_max_sleep_delay 150000 innodb_autoextend_increment 64 innodb_autoinc_lock_mode 1 innodb_background_scrub_data_check_interval 3600 innodb_background_scrub_data_compressed OFF innodb_background_scrub_data_interval 604800 innodb_background_scrub_data_uncompressed OFF innodb_buf_dump_status_frequency 0 innodb_buffer_pool_chunk_size 134217728 innodb_buffer_pool_dump_at_shutdown ON innodb_buffer_pool_dump_now OFF innodb_buffer_pool_dump_pct 25 innodb_buffer_pool_filename ib_buffer_pool innodb_buffer_pool_instances 1 innodb_buffer_pool_load_abort OFF innodb_buffer_pool_load_at_startup ON innodb_buffer_pool_load_now OFF innodb_buffer_pool_populate OFF innodb_buffer_pool_size 134217728 innodb_change_buffer_max_size 25 innodb_change_buffering all innodb_checksum_algorithm crc32 innodb_checksums ON innodb_cleaner_lsn_age_factor DEPRECATED innodb_cmp_per_index_enabled OFF innodb_commit_concurrency 0 innodb_compression_algorithm zlib innodb_compression_default OFF innodb_compression_failure_threshold_pct 5 innodb_compression_level 6 innodb_compression_pad_pct_max 50 innodb_concurrency_tickets 5000 innodb_corrupt_table_action deprecated innodb_data_file_path ibdata1:12M:autoextend innodb_data_home_dir innodb_deadlock_detect ON innodb_default_encryption_key_id 1 innodb_default_row_format dynamic innodb_defragment OFF innodb_defragment_fill_factor 0.900000 innodb_defragment_fill_factor_n_recs 20 innodb_defragment_frequency 40 innodb_defragment_n_pages 7 innodb_defragment_stats_accuracy 0 innodb_disable_sort_file_cache OFF innodb_disallow_writes OFF innodb_doublewrite ON innodb_empty_free_list_algorithm DEPRECATED innodb_encrypt_log OFF innodb_encrypt_tables OFF innodb_encryption_rotate_key_age 1 innodb_encryption_rotation_iops 100 innodb_encryption_threads 0 innodb_fake_changes OFF innodb_fast_shutdown 1 innodb_fatal_semaphore_wait_threshold 600 innodb_file_format Barracuda innodb_file_format_check ON innodb_file_format_max Barracuda innodb_file_per_table ON innodb_fill_factor 100 innodb_flush_log_at_timeout 1 innodb_flush_log_at_trx_commit 1 innodb_flush_method innodb_flush_neighbors 1 innodb_flush_sync ON innodb_flushing_avg_loops 30 innodb_force_load_corrupted OFF innodb_force_primary_key OFF innodb_force_recovery 0 innodb_foreground_preflush DEPRECATED innodb_ft_aux_table innodb_ft_cache_size 8000000 innodb_ft_enable_diag_print OFF innodb_ft_enable_stopword ON innodb_ft_max_token_size 84 innodb_ft_min_token_size 3 innodb_ft_num_word_optimize 2000 innodb_ft_result_cache_limit 2000000000 innodb_ft_server_stopword_table innodb_ft_sort_pll_degree 2 innodb_ft_total_cache_size 640000000 innodb_ft_user_stopword_table innodb_idle_flush_pct 100 innodb_immediate_scrub_data_uncompressed OFF innodb_instrument_semaphores OFF innodb_io_capacity 200 innodb_io_capacity_max 2000 innodb_kill_idle_transaction 0 innodb_large_prefix ON innodb_lock_schedule_algorithm vats innodb_lock_wait_timeout 50 innodb_locking_fake_changes OFF innodb_locks_unsafe_for_binlog OFF innodb_log_arch_dir innodb_log_arch_expire_sec 0 innodb_log_archive OFF innodb_log_block_size 0 innodb_log_buffer_size 16777216 innodb_log_checksum_algorithm DEPRECATED innodb_log_checksums ON innodb_log_compressed_pages ON innodb_log_file_size 50331648 innodb_log_files_in_group 2 innodb_log_group_home_dir ./ innodb_log_write_ahead_size 8192 innodb_lru_scan_depth 1024 innodb_max_bitmap_file_size 0 innodb_max_changed_pages 0 innodb_max_dirty_pages_pct 75.000000 innodb_max_dirty_pages_pct_lwm 0.000000 innodb_max_purge_lag 0 innodb_max_purge_lag_delay 0 innodb_max_undo_log_size 10485760 innodb_mirrored_log_groups 0 innodb_monitor_disable innodb_monitor_enable innodb_monitor_reset innodb_monitor_reset_all innodb_mtflush_threads 8 innodb_old_blocks_pct 37 innodb_old_blocks_time 1000 innodb_online_alter_log_max_size 134217728 innodb_open_files 2000 innodb_optimize_fulltext_only OFF innodb_page_cleaners 1 innodb_page_size 16384 innodb_prefix_index_cluster_optimization OFF innodb_print_all_deadlocks OFF innodb_purge_batch_size 300 innodb_purge_rseg_truncate_frequency 128 innodb_purge_threads 4 innodb_random_read_ahead OFF innodb_read_ahead_threshold 56 innodb_read_io_threads 4 innodb_read_only OFF innodb_replication_delay 0 innodb_rollback_on_timeout OFF innodb_rollback_segments 128 innodb_scrub_log OFF innodb_scrub_log_speed 256 innodb_show_locks_held 0 innodb_show_verbose_locks 0 innodb_sort_buffer_size 1048576 innodb_spin_wait_delay 6 innodb_stats_auto_recalc ON innodb_stats_include_delete_marked OFF innodb_stats_method nulls_equal innodb_stats_modified_counter 0 innodb_stats_on_metadata OFF innodb_stats_persistent ON innodb_stats_persistent_sample_pages 20 innodb_stats_sample_pages 8 innodb_stats_traditional ON innodb_stats_transient_sample_pages 8 innodb_status_output OFF innodb_status_output_locks OFF innodb_strict_mode ON innodb_support_xa ON innodb_sync_array_size 1 innodb_sync_spin_loops 30 innodb_table_locks ON innodb_temp_data_file_path ibtmp1:12M:autoextend innodb_thread_concurrency 0 innodb_thread_sleep_delay 10000 innodb_tmpdir innodb_track_changed_pages OFF innodb_track_redo_log_now OFF innodb_undo_directory ./ innodb_undo_log_truncate OFF innodb_undo_logs 128 innodb_undo_tablespaces 0 innodb_use_atomic_writes ON innodb_use_fallocate OFF innodb_use_global_flush_log_at_trx_commit OFF innodb_use_mtflush OFF innodb_use_native_aio OFF innodb_use_stacktrace OFF innodb_use_trim ON innodb_version 5.7.18 innodb_write_io_threads 4 interactive_timeout 28800 join_buffer_size 262144 join_buffer_space_limit 2097152 join_cache_level 2 keep_files_on_create OFF key_buffer_size 134217728 key_cache_age_threshold 300 key_cache_block_size 1024 key_cache_division_limit 100 key_cache_file_hash_size 512 key_cache_segments 0 large_files_support ON large_page_size 0 large_pages OFF lc_messages en_US lc_messages_dir lc_time_names en_US license GPL local_infile ON lock_wait_timeout 86400 locked_in_memory OFF log_bin OFF log_bin_basename log_bin_compress OFF log_bin_compress_min_len 256 log_bin_index log_bin_trust_function_creators OFF log_error /usr/local/var/mysql/agarner-MacBook-Pro.local.err log_output FILE log_queries_not_using_indexes OFF log_slave_updates OFF log_slow_admin_statements ON log_slow_filter admin,filesort,filesort_on_disk,full_join,full_scan,query_cache,query_cache_miss,tmp_table,tmp_table_on_disk log_slow_rate_limit 1 log_slow_slave_statements ON log_slow_verbosity log_tc_size 24576 log_warnings 2 long_query_time 10.000000 low_priority_updates OFF lower_case_file_system ON lower_case_table_names 2 master_verify_checksum OFF max_allowed_packet 16777216 max_binlog_cache_size 18446744073709547520 max_binlog_size 1073741824 max_binlog_stmt_cache_size 18446744073709547520 max_connect_errors 100 max_connections 151 max_delayed_threads 20 max_digest_length 1024 max_error_count 64 max_heap_table_size 16777216 max_insert_delayed_threads 20 max_join_size 18446744073709551615 max_length_for_sort_data 1024 max_long_data_size 16777216 max_prepared_stmt_count 16382 max_recursive_iterations 4294967295 max_relay_log_size 1073741824 max_seeks_for_key 4294967295 max_session_mem_used 9223372036854775807 max_sort_length 1024 max_sp_recursion_depth 0 max_statement_time 0.000000 max_tmp_tables 32 max_user_connections 0 max_write_lock_count 4294967295 metadata_locks_cache_size 1024 metadata_locks_hash_instances 8 min_examined_row_limit 0 mrr_buffer_size 262144 multi_range_count 256 myisam_block_size 1024 myisam_data_pointer_size 6 myisam_max_sort_file_size 9223372036853727232 myisam_mmap_size 18446744073709551615 myisam_recover_options BACKUP,QUICK myisam_repair_threads 1 myisam_sort_buffer_size 134216704 myisam_stats_method NULLS_UNEQUAL myisam_use_mmap OFF mysql56_temporal_format ON net_buffer_length 16384 net_read_timeout 30 net_retry_count 10 net_write_timeout 60 old OFF old_alter_table OFF old_mode old_passwords OFF open_files_limit 4162 optimizer_prune_level 1 optimizer_search_depth 62 optimizer_selectivity_sampling_limit 100 optimizer_switch index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on optimizer_use_condition_selectivity 1 performance_schema OFF performance_schema_accounts_size -1 performance_schema_digests_size -1 performance_schema_events_stages_history_long_size -1 performance_schema_events_stages_history_size -1 performance_schema_events_statements_history_long_size -1 performance_schema_events_statements_history_size -1 performance_schema_events_waits_history_long_size -1 performance_schema_events_waits_history_size -1 performance_schema_hosts_size -1 performance_schema_max_cond_classes 80 performance_schema_max_cond_instances -1 performance_schema_max_digest_length 1024 performance_schema_max_file_classes 50 performance_schema_max_file_handles 32768 performance_schema_max_file_instances -1 performance_schema_max_mutex_classes 200 performance_schema_max_mutex_instances -1 performance_schema_max_rwlock_classes 40 performance_schema_max_rwlock_instances -1 performance_schema_max_socket_classes 10 performance_schema_max_socket_instances -1 performance_schema_max_stage_classes 150 performance_schema_max_statement_classes 188 performance_schema_max_table_handles -1 performance_schema_max_table_instances -1 performance_schema_max_thread_classes 50 performance_schema_max_thread_instances -1 performance_schema_session_connect_attrs_size -1 performance_schema_setup_actors_size 100 performance_schema_setup_objects_size 100 performance_schema_users_size -1 pid_file /usr/local/var/mysql/agarner-MacBook-Pro.local.pid plugin_dir /usr/local/opt/mariadb/lib/plugin/ plugin_maturity unknown port 3306 preload_buffer_size 32768 profiling OFF profiling_history_size 15 progress_report_time 5 protocol_version 10 query_alloc_block_size 16384 query_cache_limit 1048576 query_cache_min_res_unit 4096 query_cache_size 1048576 query_cache_strip_comments OFF query_cache_type OFF query_cache_wlock_invalidate OFF query_prealloc_size 24576 range_alloc_block_size 4096 read_binlog_speed_limit 0 read_buffer_size 131072 read_only OFF read_rnd_buffer_size 262144 relay_log relay_log_basename relay_log_index relay_log_info_file relay-log.info relay_log_purge ON relay_log_recovery OFF relay_log_space_limit 0 replicate_annotate_row_events ON replicate_do_db replicate_do_table replicate_events_marked_for_skip REPLICATE replicate_ignore_db replicate_ignore_table replicate_wild_do_table replicate_wild_ignore_table report_host report_password report_port 3306 report_user rowid_merge_buff_size 8388608 secure_auth ON secure_file_priv server_id 1 session_track_schema ON session_track_state_change OFF session_track_system_variables session_track_transaction_info OFF skip_external_locking ON skip_name_resolve OFF skip_networking OFF skip_show_database OFF slave_compressed_protocol OFF slave_ddl_exec_mode IDEMPOTENT slave_domain_parallel_threads 0 slave_exec_mode STRICT slave_load_tmpdir /var/folders/wg/_x14700s5hv329slgbcc88780000gn/T/ slave_max_allowed_packet 1073741824 slave_net_timeout 60 slave_parallel_max_queued 131072 slave_parallel_mode conservative slave_parallel_threads 0 slave_parallel_workers 0 slave_run_triggers_for_rbr NO slave_skip_errors OFF slave_sql_verify_checksum ON slave_transaction_retries 10 slave_type_conversions slow_launch_time 2 slow_query_log OFF slow_query_log_file agarner-MacBook-Pro-slow.log socket /tmp/mysql.sock sort_buffer_size 2097152 sql_auto_is_null OFF sql_big_selects ON sql_buffer_result OFF sql_log_bin ON sql_log_off OFF sql_mode STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION sql_notes ON sql_quote_show_create ON sql_safe_updates OFF sql_select_limit 18446744073709551615 sql_slave_skip_counter 0 sql_warnings OFF ssl_ca ssl_capath ssl_cert ssl_cipher ssl_crl ssl_crlpath ssl_key standard_compliant_cte ON storage_engine InnoDB stored_program_cache 256 strict_password_validation ON sync_binlog 0 sync_frm ON sync_master_info 10000 sync_relay_log 10000 sync_relay_log_info 10000 system_time_zone CDT table_definition_cache 400 table_open_cache 2000 table_open_cache_instances 8 thread_cache_size 151 thread_concurrency 10 thread_handling one-thread-per-connection thread_pool_idle_timeout 60 thread_pool_max_threads 65536 thread_pool_oversubscribe 3 thread_pool_prio_kickup_timer 1000 thread_pool_priority auto thread_pool_size 8 thread_pool_stall_limit 500 thread_stack 299008 time_format %H:%i:%s time_zone SYSTEM timed_mutexes OFF tmp_disk_table_size 18446744073709551615 tmp_memory_table_size 16777216 tmp_table_size 16777216 tmpdir /var/folders/wg/_x14700s5hv329slgbcc88780000gn/T/ transaction_alloc_block_size 8192 transaction_prealloc_size 4096 tx_isolation REPEATABLE-READ tx_read_only OFF unique_checks ON updatable_views_with_limit YES use_stat_tables NEVER userstat OFF version 10.2.7-MariaDB version_comment Homebrew version_compile_machine x86_64 version_compile_os osx10.12 version_malloc_library system version_ssl_library OpenSSL 1.0.2l 25 May 2017 wait_timeout 28800 wsrep_osu_method TOI wsrep_auto_increment_control ON wsrep_causal_reads OFF wsrep_certify_nonpk ON wsrep_cluster_address wsrep_cluster_name my_wsrep_cluster wsrep_convert_lock_to_trx OFF wsrep_data_home_dir /usr/local/var/mysql/ wsrep_dbug_option wsrep_debug OFF wsrep_desync OFF wsrep_dirty_reads OFF wsrep_drupal_282555_workaround OFF wsrep_forced_binlog_format NONE wsrep_gtid_domain_id 0 wsrep_gtid_mode OFF wsrep_load_data_splitting ON wsrep_log_conflicts OFF wsrep_max_ws_rows 0 wsrep_max_ws_size 2147483647 wsrep_mysql_replication_bundle 0 wsrep_node_address wsrep_node_incoming_address AUTO wsrep_node_name agarner-MacBook-Pro.local wsrep_notify_cmd wsrep_on OFF wsrep_patch_version wsrep_25.19 wsrep_provider none wsrep_provider_options wsrep_recover OFF wsrep_replicate_myisam OFF wsrep_restart_slave OFF wsrep_retry_autocommit 1 wsrep_slave_fk_checks ON wsrep_slave_uk_checks OFF wsrep_slave_threads 1 wsrep_sst_auth wsrep_sst_donor wsrep_sst_donor_rejects_queries OFF wsrep_sst_method rsync wsrep_sst_receive_address AUTO wsrep_start_position 00000000-0000-0000-0000-000000000000:-1 wsrep_sync_wait 0
            elenst Elena Stepanova added a comment - - edited

            Got a somewhat different, yet apparently related failure on the current 10.2 debug:

            10.2 a76c05bba060f4da5ec7c56e5634eaafb6d2ebfe debug build

            mysqld: /data/src/10.2/storage/innobase/dict/dict0dict.cc:2135: void dict_table_remove_from_cache_low(dict_table_t*, ulint): Assertion `dict_sys->size >= size' failed.
            170714 20:23:25 [ERROR] mysqld got signal 6 ;
             
            #5  0x00007f50ee3bb448 in __GI_abort () at abort.c:89
            #6  0x00007f50ee3b3266 in __assert_fail_base (fmt=0x7f50ee4ebf18 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f50f18fbbb4 "dict_sys->size >= size", file=file@entry=0x7f50f18fb340 "/data/src/10.2/storage/innobase/dict/dict0dict.cc", line=line@entry=2135, function=function@entry=0x7f50f18ffb20 <dict_table_remove_from_cache_low(dict_table_t*, unsigned long)::__PRETTY_FUNCTION__> "void dict_table_remove_from_cache_low(dict_table_t*, ulint)") at assert.c:92
            #7  0x00007f50ee3b3312 in __GI___assert_fail (assertion=0x7f50f18fbbb4 "dict_sys->size >= size", file=0x7f50f18fb340 "/data/src/10.2/storage/innobase/dict/dict0dict.cc", line=2135, function=0x7f50f18ffb20 <dict_table_remove_from_cache_low(dict_table_t*, unsigned long)::__PRETTY_FUNCTION__> "void dict_table_remove_from_cache_low(dict_table_t*, ulint)") at assert.c:101
            #8  0x00007f50f13e68c7 in dict_table_remove_from_cache_low (table=0x7f507c144c78, lru_evict=0) at /data/src/10.2/storage/innobase/dict/dict0dict.cc:2135
            #9  0x00007f50f13e6919 in dict_table_remove_from_cache (table=0x7f507c144c78) at /data/src/10.2/storage/innobase/dict/dict0dict.cc:2149
            #10 0x00007f50f126ae80 in row_drop_table_from_cache (tablename=0x7f5080111a48 "crash_mysqld/instances", table=0x7f507c144c78, trx=0x7f50d8b570d8) at /data/src/10.2/storage/innobase/row/row0mysql.cc:3516
            #11 0x00007f50f126c1e5 in row_drop_table_for_mysql (name=0x7f50ec23e290 "crash_mysqld/instances", trx=0x7f50d8b570d8, drop_db=true, create_failed=0, nonatomic=true) at /data/src/10.2/storage/innobase/row/row0mysql.cc:4045
            #12 0x00007f50f11332e1 in ha_innobase::delete_table (this=0x7f50800118a8, name=0x7f50ec23fdd0 "./crash_mysqld/instances") at /data/src/10.2/storage/innobase/handler/ha_innodb.cc:13756
            #13 0x00007f50f0ee2436 in handler::ha_delete_table (this=0x7f50800118a8, name=0x7f50ec23fdd0 "./crash_mysqld/instances") at /data/src/10.2/sql/handler.cc:4295
            #14 0x00007f50f0edcf48 in ha_delete_table (thd=0x7f5080000b00, table_type=0x7f50f3ac1fc0, path=0x7f50ec23fdd0 "./crash_mysqld/instances", db=0x7f5080011008 "crash_mysqld", alias=0x7f5080011028 "instances", generate_warning=false) at /data/src/10.2/sql/handler.cc:2320
            #15 0x00007f50f0d2c0c6 in mysql_rm_table_no_locks (thd=0x7f5080000b00, tables=0x7f5080011038, if_exists=true, drop_temporary=false, drop_view=true, dont_log_query=true, dont_free_locks=false) at /data/src/10.2/sql/sql_table.cc:2466
            #16 0x00007f50f0c382a1 in mysql_rm_db_internal (thd=0x7f5080000b00, db=0x7f5080011008 "crash_mysqld", if_exists=true, silent=false) at /data/src/10.2/sql/sql_db.cc:919
            #17 0x00007f50f0c38976 in mysql_rm_db (thd=0x7f5080000b00, db=0x7f5080011008 "crash_mysqld", if_exists=true) at /data/src/10.2/sql/sql_db.cc:1066
            #18 0x00007f50f0c6fb5c in mysql_execute_command (thd=0x7f5080000b00) at /data/src/10.2/sql/sql_parse.cc:4966
            #19 0x00007f50f0c78d88 in mysql_parse (thd=0x7f5080000b00, rawbuf=0x7f5080010f48 "DROP DATABASE IF EXISTS `crash_mysqld`", length=38, parser_state=0x7f50ec241250, is_com_multi=false, is_next_command=false) at /data/src/10.2/sql/sql_parse.cc:7879
            #20 0x00007f50f0c66e34 in dispatch_command (command=COM_QUERY, thd=0x7f5080000b00, packet=0x7f50800086d1 "DROP DATABASE IF EXISTS `crash_mysqld`", packet_length=38, is_com_multi=false, is_next_command=false) at /data/src/10.2/sql/sql_parse.cc:1817
            #21 0x00007f50f0c65775 in do_command (thd=0x7f5080000b00) at /data/src/10.2/sql/sql_parse.cc:1362
            #22 0x00007f50f0db14e7 in do_handle_one_connection (connect=0x7f50f39db990) at /data/src/10.2/sql/sql_connect.cc:1354
            #23 0x00007f50f0db1274 in handle_one_connection (arg=0x7f50f39db990) at /data/src/10.2/sql/sql_connect.cc:1260
            #24 0x00007f50f0288064 in start_thread (arg=0x7f50ec242700) at pthread_create.c:309
            #25 0x00007f50ee46d62d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
            

            elenst Elena Stepanova added a comment - - edited Got a somewhat different, yet apparently related failure on the current 10.2 debug: 10.2 a76c05bba060f4da5ec7c56e5634eaafb6d2ebfe debug build mysqld: /data/src/10.2/storage/innobase/dict/dict0dict.cc:2135: void dict_table_remove_from_cache_low(dict_table_t*, ulint): Assertion `dict_sys->size >= size' failed. 170714 20:23:25 [ERROR] mysqld got signal 6 ;   #5 0x00007f50ee3bb448 in __GI_abort () at abort.c:89 #6 0x00007f50ee3b3266 in __assert_fail_base (fmt=0x7f50ee4ebf18 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x7f50f18fbbb4 "dict_sys->size >= size", file=file@entry=0x7f50f18fb340 "/data/src/10.2/storage/innobase/dict/dict0dict.cc", line=line@entry=2135, function=function@entry=0x7f50f18ffb20 <dict_table_remove_from_cache_low(dict_table_t*, unsigned long)::__PRETTY_FUNCTION__> "void dict_table_remove_from_cache_low(dict_table_t*, ulint)") at assert.c:92 #7 0x00007f50ee3b3312 in __GI___assert_fail (assertion=0x7f50f18fbbb4 "dict_sys->size >= size", file=0x7f50f18fb340 "/data/src/10.2/storage/innobase/dict/dict0dict.cc", line=2135, function=0x7f50f18ffb20 <dict_table_remove_from_cache_low(dict_table_t*, unsigned long)::__PRETTY_FUNCTION__> "void dict_table_remove_from_cache_low(dict_table_t*, ulint)") at assert.c:101 #8 0x00007f50f13e68c7 in dict_table_remove_from_cache_low (table=0x7f507c144c78, lru_evict=0) at /data/src/10.2/storage/innobase/dict/dict0dict.cc:2135 #9 0x00007f50f13e6919 in dict_table_remove_from_cache (table=0x7f507c144c78) at /data/src/10.2/storage/innobase/dict/dict0dict.cc:2149 #10 0x00007f50f126ae80 in row_drop_table_from_cache (tablename=0x7f5080111a48 "crash_mysqld/instances", table=0x7f507c144c78, trx=0x7f50d8b570d8) at /data/src/10.2/storage/innobase/row/row0mysql.cc:3516 #11 0x00007f50f126c1e5 in row_drop_table_for_mysql (name=0x7f50ec23e290 "crash_mysqld/instances", trx=0x7f50d8b570d8, drop_db=true, create_failed=0, nonatomic=true) at /data/src/10.2/storage/innobase/row/row0mysql.cc:4045 #12 0x00007f50f11332e1 in ha_innobase::delete_table (this=0x7f50800118a8, name=0x7f50ec23fdd0 "./crash_mysqld/instances") at /data/src/10.2/storage/innobase/handler/ha_innodb.cc:13756 #13 0x00007f50f0ee2436 in handler::ha_delete_table (this=0x7f50800118a8, name=0x7f50ec23fdd0 "./crash_mysqld/instances") at /data/src/10.2/sql/handler.cc:4295 #14 0x00007f50f0edcf48 in ha_delete_table (thd=0x7f5080000b00, table_type=0x7f50f3ac1fc0, path=0x7f50ec23fdd0 "./crash_mysqld/instances", db=0x7f5080011008 "crash_mysqld", alias=0x7f5080011028 "instances", generate_warning=false) at /data/src/10.2/sql/handler.cc:2320 #15 0x00007f50f0d2c0c6 in mysql_rm_table_no_locks (thd=0x7f5080000b00, tables=0x7f5080011038, if_exists=true, drop_temporary=false, drop_view=true, dont_log_query=true, dont_free_locks=false) at /data/src/10.2/sql/sql_table.cc:2466 #16 0x00007f50f0c382a1 in mysql_rm_db_internal (thd=0x7f5080000b00, db=0x7f5080011008 "crash_mysqld", if_exists=true, silent=false) at /data/src/10.2/sql/sql_db.cc:919 #17 0x00007f50f0c38976 in mysql_rm_db (thd=0x7f5080000b00, db=0x7f5080011008 "crash_mysqld", if_exists=true) at /data/src/10.2/sql/sql_db.cc:1066 #18 0x00007f50f0c6fb5c in mysql_execute_command (thd=0x7f5080000b00) at /data/src/10.2/sql/sql_parse.cc:4966 #19 0x00007f50f0c78d88 in mysql_parse (thd=0x7f5080000b00, rawbuf=0x7f5080010f48 "DROP DATABASE IF EXISTS `crash_mysqld`", length=38, parser_state=0x7f50ec241250, is_com_multi=false, is_next_command=false) at /data/src/10.2/sql/sql_parse.cc:7879 #20 0x00007f50f0c66e34 in dispatch_command (command=COM_QUERY, thd=0x7f5080000b00, packet=0x7f50800086d1 "DROP DATABASE IF EXISTS `crash_mysqld`", packet_length=38, is_com_multi=false, is_next_command=false) at /data/src/10.2/sql/sql_parse.cc:1817 #21 0x00007f50f0c65775 in do_command (thd=0x7f5080000b00) at /data/src/10.2/sql/sql_parse.cc:1362 #22 0x00007f50f0db14e7 in do_handle_one_connection (connect=0x7f50f39db990) at /data/src/10.2/sql/sql_connect.cc:1354 #23 0x00007f50f0db1274 in handle_one_connection (arg=0x7f50f39db990) at /data/src/10.2/sql/sql_connect.cc:1260 #24 0x00007f50f0288064 in start_thread (arg=0x7f50ec242700) at pthread_create.c:309 #25 0x00007f50ee46d62d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
            elenst Elena Stepanova added a comment - - edited

            On a release build of 10.2.7, got the exact described behavior, the assertion failure:

            10.2.7 release

            2017-07-14 20:59:43 0x7f6b4816b700  InnoDB: Assertion failure in file /home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc line 1760
            InnoDB: Failing assertion: dict_sys->size > 0
             
            #1  0x00007f6b4b856448 in __GI_abort () at abort.c:89
            #2  0x00007f6b4d4c4328 in ut_dbg_assertion_failed (expr=expr@entry=0x7f6b4ddef69a "dict_sys->size > 0", file=file@entry=0x7f6b4ddedd78 "/home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc", line=line@entry=1760) at /home/buildbot/buildbot/build/storage/innobase/ut/ut0dbg.cc:60
            #3  0x00007f6b4da9e6f8 in dict_table_rename_in_cache (table=0x7f6ad4049ed0, new_name=0x7f6ad4068bc8 "crash_mysqld/#sql-ib1180-38179927", rename_also_foreigns=rename_also_foreigns@entry=0) at /home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc:1760
            #4  0x00007f6b4d8b1b5a in commit_cache_rebuild (ctx=0x7f6ad4011118) at /home/buildbot/buildbot/build/storage/innobase/handler/handler0alter.cc:7892
            #5  ha_innobase::commit_inplace_alter_table (this=0x7f6ad403b560, altered_table=0x7f6ad406dc28, ha_alter_info=0x7f6b48166c00, commit=<optimized out>) at /home/buildbot/buildbot/build/storage/innobase/handler/handler0alter.cc:8783
            #6  0x00007f6b4d5f70df in mysql_inplace_alter_table (alter_ctx=0x7f6b48167830, inplace_supported=HA_ALTER_INPLACE_NO_LOCK_AFTER_PREPARE, ha_alter_info=0x7f6b48166c00, altered_table=0x7f6ad406dc28, table=0x7f6ad4065928, table_list=0x7f6ad400f070, thd=0x7f6ad40009a8, target_mdl_request=<optimized out>) at /home/buildbot/buildbot/build/sql/sql_table.cc:7343
            #7  mysql_alter_table (thd=thd@entry=0x7f6ad40009a8, new_db=<optimized out>, new_name=<optimized out>, create_info=0x7f6ad400f070, create_info@entry=0x7f6b48168410, table_list=table_list@entry=0x7f6ad400f070, alter_info=0x7f6b50b36528, alter_info@entry=0x7f6b48168360, order_num=0, order=0x0, ignore=false) at /home/buildbot/buildbot/build/sql/sql_table.cc:9247
            #8  0x00007f6b4d63afae in Sql_cmd_alter_table::execute (this=<optimized out>, thd=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_alter.cc:324
            #9  0x00007f6b4d572159 in mysql_execute_command (thd=thd@entry=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_parse.cc:6212
            #10 0x00007f6b4d5793ea in mysql_parse (thd=thd@entry=0x7f6ad40009a8, rawbuf=<optimized out>, length=67, parser_state=parser_state@entry=0x7f6b4816a280, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/sql/sql_parse.cc:7879
            #11 0x00007f6b4d57b6ad in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f6ad40009a8, packet=<optimized out>, packet_length=3556831008, packet_length@entry=67, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/sql/sql_parse.cc:1817
            #12 0x00007f6b4d57bc81 in do_command (thd=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_parse.cc:1362
            #13 0x00007f6b4d63803f in do_handle_one_connection (connect=connect@entry=0x7f6b512a9ea8) at /home/buildbot/buildbot/build/sql/sql_connect.cc:1354
            #14 0x00007f6b4d638164 in handle_one_connection (arg=0x7f6b512a9ea8) at /home/buildbot/buildbot/build/sql/sql_connect.cc:1260
            #15 0x00007f6b4c1df064 in start_thread (arg=0x7f6b4816b700) at pthread_create.c:309
            

            and the corrupt output for Dictionary memory allocated:

            Dictionary memory allocated 1219
            Dictionary memory allocated 1219
            Dictionary memory allocated 1219
            Dictionary memory allocated 18446744073709536156
            Dictionary memory allocated 18446744073709536156
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 549
            Dictionary memory allocated 2773
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709549941
            Dictionary memory allocated 2773
            Dictionary memory allocated 2773
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 2773
            Dictionary memory allocated 2773
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 18446744073709545267
            Dictionary memory allocated 549
            Dictionary memory allocated 18446744073709543043
            Dictionary memory allocated 18446744073709543043
            Dictionary memory allocated 18446744073709543043
            Dictionary memory allocated 18446744073709543043
            Dictionary memory allocated 18446744073709549941
            Dictionary memory allocated 18446744073709549952
            ERROR 2013 (HY000): Lost connection to MySQL server at 'handshake: reading inital communication packet', system error: 107
            

            The latter started much earlier than the assertion failure, so it might be a separate issue.

            elenst Elena Stepanova added a comment - - edited On a release build of 10.2.7, got the exact described behavior, the assertion failure: 10.2.7 release 2017-07-14 20:59:43 0x7f6b4816b700 InnoDB: Assertion failure in file /home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc line 1760 InnoDB: Failing assertion: dict_sys->size > 0   #1 0x00007f6b4b856448 in __GI_abort () at abort.c:89 #2 0x00007f6b4d4c4328 in ut_dbg_assertion_failed (expr=expr@entry=0x7f6b4ddef69a "dict_sys->size > 0", file=file@entry=0x7f6b4ddedd78 "/home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc", line=line@entry=1760) at /home/buildbot/buildbot/build/storage/innobase/ut/ut0dbg.cc:60 #3 0x00007f6b4da9e6f8 in dict_table_rename_in_cache (table=0x7f6ad4049ed0, new_name=0x7f6ad4068bc8 "crash_mysqld/#sql-ib1180-38179927", rename_also_foreigns=rename_also_foreigns@entry=0) at /home/buildbot/buildbot/build/storage/innobase/dict/dict0dict.cc:1760 #4 0x00007f6b4d8b1b5a in commit_cache_rebuild (ctx=0x7f6ad4011118) at /home/buildbot/buildbot/build/storage/innobase/handler/handler0alter.cc:7892 #5 ha_innobase::commit_inplace_alter_table (this=0x7f6ad403b560, altered_table=0x7f6ad406dc28, ha_alter_info=0x7f6b48166c00, commit=<optimized out>) at /home/buildbot/buildbot/build/storage/innobase/handler/handler0alter.cc:8783 #6 0x00007f6b4d5f70df in mysql_inplace_alter_table (alter_ctx=0x7f6b48167830, inplace_supported=HA_ALTER_INPLACE_NO_LOCK_AFTER_PREPARE, ha_alter_info=0x7f6b48166c00, altered_table=0x7f6ad406dc28, table=0x7f6ad4065928, table_list=0x7f6ad400f070, thd=0x7f6ad40009a8, target_mdl_request=<optimized out>) at /home/buildbot/buildbot/build/sql/sql_table.cc:7343 #7 mysql_alter_table (thd=thd@entry=0x7f6ad40009a8, new_db=<optimized out>, new_name=<optimized out>, create_info=0x7f6ad400f070, create_info@entry=0x7f6b48168410, table_list=table_list@entry=0x7f6ad400f070, alter_info=0x7f6b50b36528, alter_info@entry=0x7f6b48168360, order_num=0, order=0x0, ignore=false) at /home/buildbot/buildbot/build/sql/sql_table.cc:9247 #8 0x00007f6b4d63afae in Sql_cmd_alter_table::execute (this=<optimized out>, thd=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_alter.cc:324 #9 0x00007f6b4d572159 in mysql_execute_command (thd=thd@entry=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_parse.cc:6212 #10 0x00007f6b4d5793ea in mysql_parse (thd=thd@entry=0x7f6ad40009a8, rawbuf=<optimized out>, length=67, parser_state=parser_state@entry=0x7f6b4816a280, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/sql/sql_parse.cc:7879 #11 0x00007f6b4d57b6ad in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f6ad40009a8, packet=<optimized out>, packet_length=3556831008, packet_length@entry=67, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/sql/sql_parse.cc:1817 #12 0x00007f6b4d57bc81 in do_command (thd=0x7f6ad40009a8) at /home/buildbot/buildbot/build/sql/sql_parse.cc:1362 #13 0x00007f6b4d63803f in do_handle_one_connection (connect=connect@entry=0x7f6b512a9ea8) at /home/buildbot/buildbot/build/sql/sql_connect.cc:1354 #14 0x00007f6b4d638164 in handle_one_connection (arg=0x7f6b512a9ea8) at /home/buildbot/buildbot/build/sql/sql_connect.cc:1260 #15 0x00007f6b4c1df064 in start_thread (arg=0x7f6b4816b700) at pthread_create.c:309 and the corrupt output for Dictionary memory allocated : Dictionary memory allocated 1219 Dictionary memory allocated 1219 Dictionary memory allocated 1219 Dictionary memory allocated 18446744073709536156 Dictionary memory allocated 18446744073709536156 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 549 Dictionary memory allocated 2773 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709549941 Dictionary memory allocated 2773 Dictionary memory allocated 2773 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 2773 Dictionary memory allocated 2773 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 18446744073709545267 Dictionary memory allocated 549 Dictionary memory allocated 18446744073709543043 Dictionary memory allocated 18446744073709543043 Dictionary memory allocated 18446744073709543043 Dictionary memory allocated 18446744073709543043 Dictionary memory allocated 18446744073709549941 Dictionary memory allocated 18446744073709549952 ERROR 2013 (HY000): Lost connection to MySQL server at 'handshake: reading inital communication packet', system error: 107 The latter started much earlier than the assertion failure, so it might be a separate issue.
            elenst Elena Stepanova added a comment - - edited

            The exact same test case as in migration_crasher.sql, just wrapped into an MTR test (please do not put it into the regression suite! it's for bugfixing purposes only)

            --source include/have_innodb.inc
             
            while (1)
            {
                DROP DATABASE IF EXISTS `crash_mysqld`;
                CREATE DATABASE IF NOT EXISTS `crash_mysqld`;
                USE `crash_mysqld`;
                CREATE TABLE `instances` (`id` integer PRIMARY KEY AUTO_INCREMENT, `job` varchar(255) NOT NULL, `index` integer NOT NULL, `disk_cid` varchar(255) NULL UNIQUE, `deployment_id` integer NOT NULL, `vm_id` integer NULL UNIQUE) ENGINE=InnoDB;
                ALTER TABLE `instances` ADD COLUMN `state` varchar(255);
                ALTER TABLE `instances` CHANGE COLUMN `state` `state` varchar(255) NOT NULL;
                ALTER TABLE `instances` ADD COLUMN `disk_size` integer;
                ALTER TABLE `instances` DROP COLUMN `disk_cid`, DROP COLUMN `disk_size`;
                ALTER TABLE `instances` ADD COLUMN `resurrection_paused` tinyint(1);
                ALTER TABLE `instances` CHANGE COLUMN `resurrection_paused` `resurrection_paused` tinyint(1) NULL DEFAULT 0;
                ALTER TABLE `instances` ADD COLUMN `uuid` varchar(255) UNIQUE;
                ALTER TABLE `instances` ADD COLUMN `availability_zone` varchar(255), ADD COLUMN `cloud_properties` text;
                ALTER TABLE `instances` ADD COLUMN `compilation` tinyint(1) DEFAULT 0;
                ALTER TABLE `instances` ADD COLUMN `bootstrap` tinyint(1) DEFAULT 0;
                ALTER TABLE `instances` ADD COLUMN `dns_records` text;
                ALTER TABLE `instances` ADD COLUMN `spec_json` text;
                ALTER TABLE `instances` ADD COLUMN `vm_cid` varchar(255) UNIQUE, ADD COLUMN `agent_id` varchar(255) UNIQUE, ADD COLUMN `credentials_json` text, ADD COLUMN `vm_env_json` text, ADD COLUMN `trusted_certs_sha1` varchar(255) DEFAULT 'da39a3ee5e6b4b0d3255bfef95601890afd80709';
                ALTER TABLE `instances` DROP COLUMN `vm_env_json`;
                ALTER TABLE `instances` ADD COLUMN `post_start_completed` tinyint(1) DEFAULT 1;
                ALTER TABLE `instances` CHANGE COLUMN `post_start_completed` `update_completed` tinyint(1) NULL DEFAULT 1;
                ALTER TABLE `instances` CHANGE COLUMN `update_completed` `update_completed` tinyint(1) NULL DEFAULT 0;
                ALTER TABLE `instances` ADD COLUMN `ignore` tinyint(1) DEFAULT 0;
                ALTER TABLE `instances` CHANGE COLUMN `cloud_properties` `cloud_properties` longtext NULL;
                ALTER TABLE `instances` CHANGE COLUMN `dns_records` `dns_records` longtext NULL;
                ALTER TABLE `instances` CHANGE COLUMN `spec_json` `spec_json` longtext NULL;
                ALTER TABLE `instances` CHANGE COLUMN `credentials_json` `credentials_json` longtext NULL;
                ALTER TABLE `instances` ADD COLUMN `variable_set_id` integer;
                ALTER TABLE `instances` CHANGE COLUMN `variable_set_id` `variable_set_id` int(11) NOT NULL;
                ALTER TABLE `instances` ADD COLUMN `active_vm_id` integer;
                ALTER TABLE `instances` CHANGE COLUMN `vm_cid` `vm_cid_bak` varchar(255) NULL, CHANGE COLUMN `credentials_json` `credentials_json_bak` longtext NULL, CHANGE COLUMN `agent_id` `agent_id_bak` varchar(255) NULL, CHANGE COLUMN `trusted_certs_sha1` `trusted_certs_sha1_bak` varchar(255) NULL DEFAULT 'da39a3ee5e6b4b0d3255bfef95601890afd80709';
            }
            

            On my machine it fails within a few minutes if I run the test on disk, and within ~30 seconds if I run it in shm.

            The assertion on ALTER TABLE happens on non-debug builds, all of 10.0/10.1 (only with InnoDB plugin), 10.2, MySQL 5.6, MySQL 5.7, Percona Server 5.7.
            The assertion on DROP DATABASE happens on debug builds, all of 10.0/10.1 (both XtraDB and InnoDB), 10.2, MySQL 5.6, MySQL 5.7. I didn't try debug builds of Percona server.

            I didn't get the failure on MariaDB 5.5.

            andrew.garner, many thanks for the report and the reproducible test case.

            elenst Elena Stepanova added a comment - - edited The exact same test case as in migration_crasher.sql, just wrapped into an MTR test ( please do not put it into the regression suite! it's for bugfixing purposes only ) --source include/have_innodb.inc   while (1) { DROP DATABASE IF EXISTS `crash_mysqld`; CREATE DATABASE IF NOT EXISTS `crash_mysqld`; USE `crash_mysqld`; CREATE TABLE `instances` (`id` integer PRIMARY KEY AUTO_INCREMENT, `job` varchar (255) NOT NULL , ` index ` integer NOT NULL , `disk_cid` varchar (255) NULL UNIQUE , `deployment_id` integer NOT NULL , `vm_id` integer NULL UNIQUE ) ENGINE=InnoDB; ALTER TABLE `instances` ADD COLUMN `state` varchar (255); ALTER TABLE `instances` CHANGE COLUMN `state` `state` varchar (255) NOT NULL ; ALTER TABLE `instances` ADD COLUMN `disk_size` integer ; ALTER TABLE `instances` DROP COLUMN `disk_cid`, DROP COLUMN `disk_size`; ALTER TABLE `instances` ADD COLUMN `resurrection_paused` tinyint(1); ALTER TABLE `instances` CHANGE COLUMN `resurrection_paused` `resurrection_paused` tinyint(1) NULL DEFAULT 0; ALTER TABLE `instances` ADD COLUMN `uuid` varchar (255) UNIQUE ; ALTER TABLE `instances` ADD COLUMN `availability_zone` varchar (255), ADD COLUMN `cloud_properties` text; ALTER TABLE `instances` ADD COLUMN `compilation` tinyint(1) DEFAULT 0; ALTER TABLE `instances` ADD COLUMN `bootstrap` tinyint(1) DEFAULT 0; ALTER TABLE `instances` ADD COLUMN `dns_records` text; ALTER TABLE `instances` ADD COLUMN `spec_json` text; ALTER TABLE `instances` ADD COLUMN `vm_cid` varchar (255) UNIQUE , ADD COLUMN `agent_id` varchar (255) UNIQUE , ADD COLUMN `credentials_json` text, ADD COLUMN `vm_env_json` text, ADD COLUMN `trusted_certs_sha1` varchar (255) DEFAULT 'da39a3ee5e6b4b0d3255bfef95601890afd80709' ; ALTER TABLE `instances` DROP COLUMN `vm_env_json`; ALTER TABLE `instances` ADD COLUMN `post_start_completed` tinyint(1) DEFAULT 1; ALTER TABLE `instances` CHANGE COLUMN `post_start_completed` `update_completed` tinyint(1) NULL DEFAULT 1; ALTER TABLE `instances` CHANGE COLUMN `update_completed` `update_completed` tinyint(1) NULL DEFAULT 0; ALTER TABLE `instances` ADD COLUMN ` ignore ` tinyint(1) DEFAULT 0; ALTER TABLE `instances` CHANGE COLUMN `cloud_properties` `cloud_properties` longtext NULL ; ALTER TABLE `instances` CHANGE COLUMN `dns_records` `dns_records` longtext NULL ; ALTER TABLE `instances` CHANGE COLUMN `spec_json` `spec_json` longtext NULL ; ALTER TABLE `instances` CHANGE COLUMN `credentials_json` `credentials_json` longtext NULL ; ALTER TABLE `instances` ADD COLUMN `variable_set_id` integer ; ALTER TABLE `instances` CHANGE COLUMN `variable_set_id` `variable_set_id` int (11) NOT NULL ; ALTER TABLE `instances` ADD COLUMN `active_vm_id` integer ; ALTER TABLE `instances` CHANGE COLUMN `vm_cid` `vm_cid_bak` varchar (255) NULL , CHANGE COLUMN `credentials_json` `credentials_json_bak` longtext NULL , CHANGE COLUMN `agent_id` `agent_id_bak` varchar (255) NULL , CHANGE COLUMN `trusted_certs_sha1` `trusted_certs_sha1_bak` varchar (255) NULL DEFAULT 'da39a3ee5e6b4b0d3255bfef95601890afd80709' ; } On my machine it fails within a few minutes if I run the test on disk, and within ~30 seconds if I run it in shm. The assertion on ALTER TABLE happens on non-debug builds, all of 10.0/10.1 (only with InnoDB plugin), 10.2, MySQL 5.6, MySQL 5.7, Percona Server 5.7. The assertion on DROP DATABASE happens on debug builds, all of 10.0/10.1 (both XtraDB and InnoDB), 10.2, MySQL 5.6, MySQL 5.7. I didn't try debug builds of Percona server. I didn't get the failure on MariaDB 5.5. andrew.garner , many thanks for the report and the reproducible test case.

            commit 92cbe388b6839bc1e21abb9859c54c58fc1769cf
            Author: Jan Lindström <jan.lindstrom@mariadb.com>
            Date: Fri Jul 21 16:05:20 2017 +0300

            MDEV-13325: InnoDB assert dict_sys->size > 0 during ALTER TABLE

            Problem was that dict_sys->size tries to maintain used memory
            occupied by the data dictionary table and index objects.
            However at least on table objects table->heap size can increase
            between when table object is inserted to dict_sys and when
            it is removed from dict_sys causing inconsistency on amount
            of memory added to and removed from dict_sys->size variable.

            Removed unnecessary dict_sys:size variable as it is really
            used only for status output.

            Introduced dict_sys_get_size function to calculate memory
            occupied by the data dictionary table and index objects
            that is then used on show engine innodb output.

            dict_table_add_to_cache(),
            dict_table_rename_in_cache(),
            dict_table_remove_from_cache_low(),
            dict_index_remove_from_cache_low(),
            Remove size calculation.

            srv_printf_innodb_monitor(): Use dict_sys_get_size function to
            get dictionary memory allocated.

            xtradb_internal_hash_tables_fill_table(): Use dict_sys_get_size
            function to get dictionary memory allocated.

            jplindst Jan Lindström (Inactive) added a comment - commit 92cbe388b6839bc1e21abb9859c54c58fc1769cf Author: Jan Lindström <jan.lindstrom@mariadb.com> Date: Fri Jul 21 16:05:20 2017 +0300 MDEV-13325 : InnoDB assert dict_sys->size > 0 during ALTER TABLE Problem was that dict_sys->size tries to maintain used memory occupied by the data dictionary table and index objects. However at least on table objects table->heap size can increase between when table object is inserted to dict_sys and when it is removed from dict_sys causing inconsistency on amount of memory added to and removed from dict_sys->size variable. Removed unnecessary dict_sys:size variable as it is really used only for status output. Introduced dict_sys_get_size function to calculate memory occupied by the data dictionary table and index objects that is then used on show engine innodb output. dict_table_add_to_cache(), dict_table_rename_in_cache(), dict_table_remove_from_cache_low(), dict_index_remove_from_cache_low(), Remove size calculation. srv_printf_innodb_monitor(): Use dict_sys_get_size function to get dictionary memory allocated. xtradb_internal_hash_tables_fill_table(): Use dict_sys_get_size function to get dictionary memory allocated.

            People

              jplindst Jan Lindström (Inactive)
              andrew.garner Andrew Garner
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.