Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-35113

DB1 crashed with segmentation fault (Signal 11) error on next day of DB2 crash

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Incomplete
    • 10.11.5
    • N/A
    • Parser

    Description

      Hello Team,

      We have observed 2nd crash on DB1 on 3rd OCT with Segmentation fault error.

      Kindly find below crash details
      1. DB1 crashed on 1st Oct
      2. DB2 crashed on 2nd Oct
      3. Db1 crashed on 3rd Oct

      Kindly find below details for DB1 crash:

      [root@ALEPO-DB1-ILB tmp]# systemctl status mysqld
      ● mariadb.service - MariaDB 10.11.5 database server
         Loaded: loaded (/usr/lib/systemd/system/mariadb.service; enabled; vendor preset: disabled)
        Drop-In: /etc/systemd/system/mariadb.service.d
                 └─migrated-from-my.cnf-settings.conf
         Active: active (running) since Thu 2024-10-03 14:16:10 PKT; 5 days ago
           Docs: man:mariadbd(8)
                 https://mariadb.com/kb/en/library/systemd/
        Process: 941058 ExecStartPost=/bin/sh -c systemctl unset-environment _WSREP_START_POSITION (code=exited, status=0/SUCC>
        Process: 940464 ExecStartPre=/bin/sh -c [ ! -e /usr/bin/galera_recovery ] && VAR= ||   VAR=`cd /usr/bin/..; /usr/bin/g>
        Process: 940462 ExecStartPre=/bin/sh -c systemctl unset-environment _WSREP_START_POSITION (code=exited, status=0/SUCCE>
       Main PID: 940687 (mariadbd)
         Status: "Taking your SQL requests now..."
          Tasks: 36 (limit: 3298736)
         Memory: 455.6G
         CGroup: /system.slice/mariadb.service
                 └─940687 /usr/sbin/mariadbd
       
       
      [root@ALEPO-DB1-ILB log]# mysql --version
      mysql  Ver 15.1 Distrib 10.11.5-MariaDB, for Linux (x86_64) using readline 5.1
      

      Kindly check this issue and provide solution.

      var/log/messages:
      Oct  3 14:14:56 ALEPO-DB1-ILB systemd[1]: mariadb.service: Main process exited, code=killed, status=11/SEGV
      Oct  3 14:14:56 ALEPO-DB1-ILB systemd[1]: mariadb.service: Failed with result 'signal'.
      Oct  3 14:14:58 ALEPO-DB1-ILB NetworkManager[1281]: <info>  [1727946898.9173] device (enp9s0): state change: ip-config -> failed (reason 'ip-config-unavailable', sys-iface-state: 'managed')
      Oct  3 14:14:58 ALEPO-DB1-ILB NetworkManager[1281]: <warn>  [1727946898.9177] device (enp9s0): Activation: failed for connection 'opt-net'
      Oct  3 14:14:58 ALEPO-DB1-ILB NetworkManager[1281]: <info>  [1727946898.9178] device (enp9s0): state change: failed -> disconnected (reason 'none', sys-iface-state: 'managed')
      Oct  3 14:14:58 ALEPO-DB1-ILB NetworkManager[1281]: <info>  [1727946898.9310] dhcp4 (enp9s0): canceled DHCP transaction
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Created slice User Slice of UID 0.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Starting User runtime directory /run/user/0...
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Started User runtime directory /run/user/0.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Starting User Manager for UID 0...
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Starting D-Bus User Message Bus Socket.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Reached target Timers.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Reached target Paths.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Listening on D-Bus User Message Bus Socket.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Reached target Sockets.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Reached target Basic System.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Reached target Default.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[940408]: Startup finished in 162ms.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Started User Manager for UID 0.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Started Session 390196 of user root.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Started Session 390197 of user root.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: session-390197.scope: Succeeded.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: session-390196.scope: Succeeded.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 2.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Stopped MariaDB 10.11.5 database server.
      Oct  3 14:15:01 ALEPO-DB1-ILB systemd[1]: Starting MariaDB 10.11.5 database server...
      Oct  3 14:15:02 ALEPO-DB1-ILB mariadbd[940687]: 2024-10-03 14:15:02 0 [Warning] Could not increase number of max_open_files to more than 32768 (request: 65535)
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: Stopping User Manager for UID 0...
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Stopped target Default.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Stopped target Basic System.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Stopped target Sockets.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Closed D-Bus User Message Bus Socket.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Stopped target Timers.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Stopped target Paths.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Reached target Shutdown.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Started Exit the Session.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[940408]: Reached target Exit the Session.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: user@0.service: Succeeded.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: Stopped User Manager for UID 0.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: Stopping User runtime directory /run/user/0...
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: run-user-0.mount: Succeeded.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: user-runtime-dir@0.service: Succeeded.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: Stopped User runtime directory /run/user/0.
      Oct  3 14:15:11 ALEPO-DB1-ILB systemd[1]: Removed slice User Slice of UID 0.
      Oct  3 14:15:14 ALEPO-DB1-ILB su[940694]: (to root) alepo on pts/1
      Oct  3 14:16:10 ALEPO-DB1-ILB systemd[1]: Started MariaDB 10.11.5 database server.
      

      Kindly find the attached mysqld logs and gdb output.
      Please let us know if you require some additional information.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              Priya Kunte Priya Kunte
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.