Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-30610

Update RocksDB to the latest upstream version

Details

    Description

      Our RocksDB version is lagging behind the current version quite a bit. Unfortunately there have been large API changes so this isn't a case of just updating the git submodule. This needs a lot of work on our port of MyRocks, potentially porting newer features and bug fixes of MyRocks over where appropriate.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20406 Rocksdb gets corrupted on OOM during ALTER

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20693 ha_rocksdb::records_in_range() vastly overestimates the number of rows in certain ranges

          • Major - Major loss of function.
          • Confirmed
          is blocked by

          Task - A task that needs to be done. MDEV-32200 Fix bloomfilter for the RocksDB 8.1 update

          • Critical - Crashes, loss of data, severe memory leak.
          • Stalled
          is duplicated by

          Task - A task that needs to be done. MDEV-36264 RocksDB need upgrade !

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-16523 Assertion `!level_and_file.second->being_compacted' failed in LevelCompactionBuilder::SetupInitialFiles

          • Blocker - Blocks development and/or testing work, production could not run.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20470 MyRocks fails to compile on Debian Bullseye/Sid, gcc 9.2.1

          • Major - Major loss of function.
          • Stalled

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21799 Assertion `is_storage_available(tuple - packed_tuple, 0)' failed in myrocks::Rdb_key_def::pack_record upon INSERT into VARBINARY(0) or VARCHAR | heap-buffer-overflow on address from myrocks::Rdb_field_packing::fill_hidden_pk_val

          • Critical - Crashes, loss of data, severe memory leak.
          • Confirmed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29138 Assertion `padding_bytes % fpi->space_xfrm_len == 0' in myrocks::Rdb_key_def::pack_with_varchar_space_pad

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29857 ASAN heap-buffer-overflow in myrocks::Rdb_key_def::pack_variable_format or further crash on shutdown

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29875 Building RocksDB on aarch64 and riscv64

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-31057 rocksdb does not compile with gcc-13

          • Major - Major loss of function.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            TheLinuxJedi Andrew Hutchings (Inactive) created issue -
            danblack Daniel Black made changes -
            Field Original Value New Value
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            jmuchemb Julien Muchembled made changes -
            jmuchemb Julien Muchembled made changes -
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            Fix Version/s 11.3 [ 28565 ]
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            Priority Major [ 3 ] Critical [ 2 ]
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            Assignee Andrew Hutchings [ JIRAUSER52179 ]
            TheLinuxJedi Andrew Hutchings (Inactive) added a comment -

            Pull request for this for GSoC: https://github.com/MariaDB/server/pull/2648

            It needs updating for 11.3.

            TheLinuxJedi Andrew Hutchings (Inactive) added a comment - Pull request for this for GSoC: https://github.com/MariaDB/server/pull/2648 It needs updating for 11.3.
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            Fix Version/s 11.3.0 [ 29302 ]
            Fix Version/s 11.3 [ 28565 ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Closed [ 6 ]
            serg Sergei Golubchik made changes -
            serg Sergei Golubchik made changes -
            serg Sergei Golubchik made changes -
            Resolution Fixed [ 1 ]
            Status Closed [ 6 ] Stalled [ 10000 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 11.4 [ 29301 ]
            Fix Version/s 11.3.0 [ 29302 ]
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            TheLinuxJedi Andrew Hutchings (Inactive) made changes -
            Status Stalled [ 10000 ] Open [ 1 ]
            cybernet2u cybernet2u added a comment -

            any news ?

            cybernet2u cybernet2u added a comment - any news ?
            serg Sergei Golubchik added a comment -

            Yes. The pull request was merged. Then we've found out that Bloom filter is basically broken, MDEV-32200 was created to fix this. It wasn't fixed in time for 11.3 release, so the pull request was reverted. As soon as MDEV-32200 is done, we'll get new RocksDB again.

            serg Sergei Golubchik added a comment - Yes. The pull request was merged. Then we've found out that Bloom filter is basically broken, MDEV-32200 was created to fix this. It wasn't fixed in time for 11.3 release, so the pull request was reverted. As soon as MDEV-32200 is done, we'll get new RocksDB again.
            cybernet2u cybernet2u added a comment -

            thanks

            cybernet2u cybernet2u added a comment - thanks
            serg Sergei Golubchik made changes -
            Fix Version/s 11.5 [ 29506 ]
            Fix Version/s 11.4 [ 29301 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 11.6 [ 29515 ]
            Fix Version/s 11.5 [ 29506 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 11.7 [ 29815 ]
            Fix Version/s 11.6 [ 29515 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 11.8 [ 29921 ]
            Fix Version/s 11.7 [ 29815 ]
            danblack Daniel Black made changes -
            Assignee Andrew Hutchings [ JIRAUSER52179 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 11.8 [ 29921 ]
            serg Sergei Golubchik made changes -
            Assignee Sergei Petrunia [ psergey ]
            serg Sergei Golubchik made changes -
            Assignee Sergei Petrunia [ psergey ]
            danblack Daniel Black made changes -
            psergei Sergei Petrunia added a comment -

            Note: in MDEV-16523, trying a much smaller update, to RocksDB 6.29.

            psergei Sergei Petrunia added a comment - Note: in MDEV-16523 , trying a much smaller update, to RocksDB 6.29.
            psergei Sergei Petrunia made changes -

            People

              Unassigned Unassigned
              TheLinuxJedi Andrew Hutchings (Inactive)
              Votes:
              5 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.