Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-34719

Disable purge for LOAD DATA INFILE into empty table

    XMLWordPrintable

Details

    Description

      According to thiru,
      https://github.com/MariaDB/server/commit/3cef4f8f0fc88ae5bfae4603d8d600ec84cc70a9
      optimization, with "single undo log record TRX_UNDO_EMPTY" does not work
      It does not work if I LOCK TABLE WRITE prior to LOAD DATA INFILE, it does not work if I start transaction after LOCK TABLE WRITE, and it does not work, if I also add "set autocommit=0" to the mix.

      Loading 1,4G worth of data into empty table, with any of the above tricks, profiler shows 15% of the time spent on row_purge_reset_trx_id()

      Can't enable "bulk optimization" because of the bug MDEV-34703 I filed previously,
      can't increase innodb sort buffer sizes, because actual requirement for tens of GB worth data
      is unknown.

      Attachments

        Issue Links

          blocks

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MDEV-33188 Enhance mariadb-dump and mariadb-import capabilities similar to MyDumper

          • Critical - Crashes, loss of data, severe memory leak.
          • Stalled
          relates to

          Task - A task that needs to be done. MDEV-515 innodb bulk insert

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-5171 Add support for --innodb-optimize-keys to mysqldump.

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-24621 In bulk insert, pre-sort and build indexes one page at a time

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24813 Locking full table scan fails to use table-level locking

          • Critical - Crashes, loss of data, severe memory leak.
          • In Review

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33625 Add option --dir to mariadb-dump

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34703 Innodb bulk load : high IO, crashes on Linux, OOM on Linux, as tested with LOAD DATA INFILE

          • Critical - Crashes, loss of data, severe memory leak.
          • In Progress

          Activity

            People

              thiru Thirunarayanan Balathandayuthapani
              wlad Vladislav Vaintroub
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.