Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-990

provide a resetRow method

    XMLWordPrintable

Details

    • Task
    • Status: Closed (View Workflow)
    • Critical
    • Resolution: Fixed
    • 1.1.0
    • 1.1.1
    • None
    • None
    • 2017-22

    Description

      We should provide a 'reset row' method that allows you to effectively reset / cancel the current row write. This should always succeed and should have the effect that the temporary holding area for the current working row is emptied allowing the prior records in the batch to be committed.

      What this would allow you to do is to commit the prior rows in your transaction should you get some sort of error in the middle of processing the current row. Right now if you have an error the only solution is to rollback the entire transaction. This could result in you losing a significant number of prior records in a streaming / micro batched use case (or requires you to stage that locally which makes it more complex.

      The following python code should work after this is implemented (in a real case it would probably be in an exception handler of course):

      import pymcsapi
      driver = pymcsapi.ColumnStoreDriver()
      bulk = driver.createBulkInsert('test', 't1', 0,0)
      bulk.setColumn(0, 1)
      bulk.setColumn(1, 'A')
      bulk.writeRow()
      bulk.setColumn(0, 2)
      bulk.resetRow()
      bulk.commit()
      

      Attachments

        Activity

          People

            dthompson David Thompson (Inactive)
            dthompson David Thompson (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.