Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-23468

inline_mysql_socket_send: Assertion `mysql_socket.fd != -1' failed on shutdown

Details

    Description

      Seen with some regularity in [recent or 10.4] test runs;

      10.4.15 eae968f62d285de97ed607c87bc131cd863d5d03 (Debug)

      ... innodb monitor output ...
      2020-08-11 21:48:20 0 [Note] /test/MD110820-mariadb-10.4.15-linux-x86_64-dbg/bin/mysqld (initiated by: root[root] @ localhost []): Normal shutdown
      2020-08-11 21:48:20 0 [Note] WSREP: Shutdown replication
      2020-08-11 21:48:20 0 [Note] WSREP: killing local connection: 12
      mysqld: /test/10.4_dbg/include/mysql/psi/mysql_socket.h:744: inline_mysql_socket_send: Assertion `mysql_socket.fd != -1' failed.
      200811 21:48:20 [ERROR] mysqld got signal 6 ;  
      

      jplindst any idea what happens here?

      Very hard to reproduce. Seems WSREP kills a connection and server does subsequently assert. I am attaching full details (full trial, core dump, data dir, logs). Core can be debugged as follows:

      mv mysqld ..   # mysqld bin copy + libs directory
      ./gdb 
      

      Or

      gdb ./mysqld/mysqld ./data/core
      

      Error log in log/master.err, used sql in default.node.tld_thread-0.sql (55k lines, not reducible as bug will not reproduce likely due to some 'required state' or 'timing' or 'os slicing' issue.

      Attachments

        1. galera_sr_cc_master.log
          0.7 kB
        2. mysqld.1.err
          210 kB
        3. mysqld.2.err
          675 kB

        Issue Links

          Activity

            It fails sporadically on galera_sr.galera_sr_cc_master MTR, see MDEV-23609.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - It fails sporadically on galera_sr.galera_sr_cc_master MTR, see MDEV-23609 .
            jplindst Jan Lindström (Inactive) added a comment - - edited
            • How to repeat: ./mtr galera_sr.galera_sr_cc_master --repeat=2000
            • Query: SET GLOBAL wsrep_cluster_address = '''
            • thd->killed : KILL_CONNECTION
            jplindst Jan Lindström (Inactive) added a comment - - edited How to repeat: ./mtr galera_sr.galera_sr_cc_master --repeat=2000 Query: SET GLOBAL wsrep_cluster_address = ''' thd->killed : KILL_CONNECTION

            jplindst thank you for the core analysis and testcase.

            mkaruza It will be super great to see this mysql_socket.fd Unable to render embedded object: File (= -1 issue resolved as I see many tests fail with similar assertion message, and I suspect they are various issues (potentially not related to wsrep at all?). Thank you) not found.

            Question; do you think this issue is present in 10.5 as well?

            Roel Roel Van de Paar added a comment - jplindst thank you for the core analysis and testcase. mkaruza It will be super great to see this mysql_socket.fd Unable to render embedded object: File (= -1 issue resolved as I see many tests fail with similar assertion message, and I suspect they are various issues (potentially not related to wsrep at all?). Thank you) not found. Question; do you think this issue is present in 10.5 as well?

            I have updated the pull request with a suggestion for a better fix.

            https://github.com/MariaDB/server/pull/1709

            monty Michael Widenius added a comment - I have updated the pull request with a suggestion for a better fix. https://github.com/MariaDB/server/pull/1709

            People

              jplindst Jan Lindström (Inactive)
              Roel Roel Van de Paar
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.