Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-42299

DuckDB: parallel replication stops with "Got error 168 'DeltaAppender flush failed' from DuckDB"

    XMLWordPrintable

Details

    Description

      Version: 11.4 branch at 095cfb5e468e (2026-11-11), built with storage/duckdb/build.sh -t RelWithDebInfo, DuckDB v1.5.5. Ubuntu 24.04, aarch64 (m7g.2xlarge, 8 vCPU, 32 GB).

      Setup:

      • Primary: MariaDB 10.11.14, binlog_format=ROW, binlog_row_image=FULL, sysbench schema (8 tables x 10M rows, utf8mb4).
      • Replica: the same 8 tables created as ENGINE=DuckDB (id INT NOT NULL, k INT, c CHAR(120), pad CHAR(60), PRIMARY KEY (id), KEY k_1 (k)), loaded from mariadb-dump, then replicating from the dump's position. Default duckdb_* settings, innodb_buffer_pool_size=2G.
      • Load on the primary: sysbench oltp_read_write, 16 threads, 400 tps (per transaction: 2 UPDATE, 1 DELETE, 1 INSERT).

      Steps:
      1. STOP SLAVE SQL_THREAD; SET GLOBAL slave_parallel_threads=8; SET GLOBAL slave_parallel_mode='optimistic'; START SLAVE SQL_THREAD;
      2. Wait. The applier runs at ~215 transactions/s.

      Result: after about 10 minutes the SQL thread stops:

      [ERROR] Slave SQL: Got error 168 'DeltaAppender flush failed' from DuckDB, Gtid 0-1-102595, Internal MariaDB error code: 1296
      [ERROR] Slave (additional info): Commit failed due to failure of an earlier commit on which this one depends Error_code: 1964

      With slave_parallel_threads=16 it stopped within a minute with the same error. With slave_parallel_threads=0 it ran without errors in every period we left it on (about 40 minutes in total, at ~48 transactions/s).

      Expected: parallel replication either works or is refused up front.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nethalo Daniel Guzman Burgos
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.