Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-33817

Implement AVX512BW and VPCLMULQDQ based CRC-32 algorithms

Details

    Description

      MDEV-22749 introduced faster checksum calculation on AMD64 by means of the 128-bit carry-less multiplication (pclmul) of the AVX ISA extension. Some recent ISA extensions include wider vpclmulqdq as well as vmovdqu8, which allows unaligned loads of up to 64 bytes at a time. Making use of these instructions could greatly improve performance.

      Some reference implementations exist in NASM format in https://github.com/intel/intel-ipsec-mb/ and https://github.com/intel/isa-l/ under the BSD 3-clause license. CRC-32 with the ISO 3309 polynomical is called gzip, and the Castagnoli polynomial is referred to as SCTP or iSCSI.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34510 UBSAN: crc32 x86 - integer overflow

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34565 MariaDB crashes with SIGILL because the OS does not support AVX512

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22749 Implement portable PCLMUL accelerated crc32() with Intel intrinsics

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34062 mariadb-backup --backup is extremely slow at copying ib_logfile0

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34070 mariadb-backup --prepare with larger --use-memory may be slower

          • Major - Major loss of function.
          • Confirmed

          Activity

            Transition Time In Source Status Execution Times
            Marko Mäkelä made transition -
            Open In Progress
            		7d 22h 56m 1
            Marko Mäkelä made transition -
            In Progress In Review
            		19d 3h 20m 1
            Vladislav Vaintroub made transition -
            In Review Stalled
            		2d 23h 39m 1
            Marko Mäkelä made transition -
            Stalled Closed
            		51m 20s 1

            People

              marko Marko Mäkelä
              marko Marko Mäkelä
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.