Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-1077

Two applications using Bulk Insert API

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.1.2, 1.1.6
    • Fix Version/s: 1.1.3
    • Component/s: mcsapi
    • Labels:
      None
    • Environment:
      Multi-server ColumnStore instance

      Description

      Thank you for releasing Bulk Insert API that enable applications to stream data remotely to the ColumnStore nodes.

      By their nature, data streaming applications run continuously. Redundant applications could increase data streaming uptime, since if one application fails, a second application would still be running.

      For such redundancy, I would like to run two applications that write to the same table from remote hosts. Applications alternate holding the table write lock in a following sequence:

      The first application:

      • polls the database to check that the table is not locked;
      • when the table is not locked, calls createBulkInsert() and locks the table;
      • buffers data by calling writeRow();
      • calls commit() successfully and releases the lock.

      The second application:

      • polls the database to check that the table is not locked;
      • when the table is no longer locked, the second application calls createBulkInsert() and locks the table;
      • buffers data by calling writeRow();
      • calls commit() successfully and releases the lock.

      Then first application gets the table lock, and so on.

      Could the Bulk Insert API be extended with a call to check if the table is currently locked?

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              LinuxJedi Andrew Hutchings (Inactive)
              Reporter:
              sasha Sasha V
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Git Integration