Uploaded image for project: 'MariaDB MaxScale'
  1. MariaDB MaxScale
  2. MXS-5063

Maxscale crash - "terminate called after throwing an instance of 'std::bad_alloc'"

    XMLWordPrintable

Details

    Description

      Maxscale crashed during company's out of hours, issue handled by VRRP / standby. We don't have GDB or anything installed on this server so this is all that's available right now.

      terminate called after throwing an instance of 'std::bad_alloc'
        what():  std::bad_alloc
      2024-04-14 20:37:42   alert  : (35462108) (SS); MaxScale 23.08.5 received fatal signal 6. Commit ID: 4bb6b679d2be75ba84226baea656db7a0f330eb4, System name: Linux, Release string: CentOS Linux 7 (Core), Thread: Worker-09
      2024-04-14 20:37:42   alert  : (35462108) (SS); Statement currently being classified: none/unknown
      2024-04-14 20:37:42   alert  : (35462108) (SS); Session: 35462108 Service: SS
      2024-04-14 20:37:42   notice : (35462108) (SS); For a more detailed stacktrace, install GDB and add 'debug=gdb-stacktrace' under the [maxscale] section.
        /lib64/libc.so.6(gsignal+0x37) [0x7f95046b8387]: <binutils not installed>
        /lib64/libc.so.6(abort+0x148) [0x7f95046b9a78]: <binutils not installed>
        /lib64/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x165) [0x7f9505913a95]: <binutils not installed>
        /lib64/libstdc++.so.6(+0x5ea06) [0x7f9505911a06]: <binutils not installed>
        /lib64/libstdc++.so.6(+0x5ea33) [0x7f9505911a33]: <binutils not installed>
        /lib64/libstdc++.so.6(+0x5ec53) [0x7f9505911c53]: <binutils not installed>
        /lib64/libstdc++.so.6(_Znwm+0x7d) [0x7f95059121ed]: <binutils not installed>
        /lib64/libstdc++.so.6(_Znam+0x9) [0x7f9505912289]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN10SHARED_BUFC1Em+0x15) [0x7f95078abc45]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN5GWBUF16prepare_to_writeEm+0x1b8) [0x7f95078abf48]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN5GWBUF6appendEPKhm+0x32) [0x7f95078abfd2]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN5GWBUF10merge_backEOS_+0x34) [0x7f95078ac324]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN3DCB13writeq_appendEO5GWBUF+0x18) [0x7f9507913968]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN23MariaDBClientConnection11clientReplyEO5GWBUFRKN8maxscale10ReplyRouteERKNS2_5ReplyE+0xa8) [0x7f9507a43fe8]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN15ServiceEndpoint13send_upstreamEO5GWBUFRKN8maxscale10ReplyRouteERKNS2_5ReplyE+0x31) [0x7f95079d3911]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN15ServiceEndpoint15ServiceUpstream11clientReplyEO5GWBUFRKN8maxscale10ReplyRouteERKNS3_5ReplyE+0xd) [0x7f95079e637d]: <binutils not installed>
        /usr/lib64/maxscale/libreadwritesplit.so(_ZN14RWSplitSession11clientReplyEO5GWBUFRKN8maxscale10ReplyRouteERKNS2_5ReplyE+0x5a5) [0x7f9507f51db5]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN15ServiceEndpoint11clientReplyEO5GWBUFRKN8maxscale10ReplyRouteERKNS2_5ReplyE+0x99) [0x7f95079d2be9]: <binutils
       not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN14ServerEndpoint11clientReplyEO5GWBUFRKN8maxscale10ReplyRouteERKNS2_5ReplyE+0xf4) [0x7f95079bddd4]: <binutils not installed>
          /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN24MariaDBBackendConnection11normal_readEv+0xdc9) [0x7f9507a3cd89]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN24MariaDBBackendConnection17ready_for_readingEP3DCB+0x140) [0x7f9507a405f0]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN3DCB14process_eventsEj+0x1f5) [0x7f95079150d5]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN3DCB13event_handlerEj+0x21) [0x7f9507915331]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN3DCB13FakeEventTask7executeERN7maxbase6WorkerE+0xb6) [0x7f9507915996]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker14handle_messageERNS_12MessageQueueERKNS_19MessageQueueMessageE+0xe1) [0x7f9507a8d651]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase17EventMessageQueue18handle_poll_eventsEPNS_6WorkerEjNS_8Pollable7ContextE+0x73) [0x7f9507a930e3]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker14deliver_eventsEPNS_8PollableEjNS1_7ContextE+0x23) [0x7f9507a90113]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker15poll_waiteventsEv+0x35f) [0x7f9507a9062f]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker3runEPNS_9SemaphoreE+0x53) [0x7f9507a90993]: <binutils not installed>
        /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(+0x4977c0) [0x7f9507b5f7c0]: <binutils not installed>
        /lib64/libpthread.so.0(+0x7ea5) [0x7f950667aea5]: <binutils not installed>
        /lib64/libc.so.6(clone+0x6d) [0x7f9504780b0d]: <binutils not installed>
      2024-04-14 20:37:42   notice : (35462108) (SS); GDB not found, attempting to dump stacktraces from all threads using internal profiler...
      

      Attachments

        1. Before crash.png
          46 kB
          Phil Sumner
        2. image-2024-04-15-10-56-15-270.png
          62 kB
          Phil Sumner
        3. image-2024-04-15-12-08-50-654.png
          44 kB
          Phil Sumner
        4. maxscale_config.txt
          1 kB
          Phil Sumner
        5. maxscale02.png
          57 kB
          Phil Sumner
        6. memleak.log
          137 kB
          Phil Sumner
        7. memleak-20-mins.log
          1.64 MB
          Phil Sumner
        8. memleak-during-big-query.log
          1.63 MB
          Phil Sumner
        9. memory-spike-after-bypassing-maxscale.png
          115 kB
          Phil Sumner
        10. pmm-memory-free-graph-12hrs.png
          45 kB
          Phil Sumner
        11. screenshot-1.png
          55 kB
          Phil Sumner
        12. screenshot-2.png
          71 kB
          Phil Sumner

        Activity

          People

            markus makela markus makela
            psumner Phil Sumner
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.