Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-1292

Warning about inserting of NULL values in DB fields appears in base log for every field

    XMLWordPrintable

    Details

    • Sprint:
      2018-07

      Description

      Process of a bulk load of data from CSV file displays a warning message about inserting a NULL values into database fields.
      This message appears for every such field in the base log.
      This message can fill the log very quickly if file contains lots of data.

      example:

      ......
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 3: Field_003 into column 3: merchant_id
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
      2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
      2018/03/22 14:58:40 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=134970, W=134970, U=0, E=0)
      2018/03/22 14:58:40 - svv-load - Starting entry [Transformation]
      2018/03/22 14:58:40 - Transformation - Loading transformation from XML file [file:///home/elena.kotsinova/downloads/PDI-TEST-SCENARIOS/transactions-load.ktr]
      2018/03/22 14:58:40 - Transformation - Using run configuration [Pentaho local]
      2018/03/22 14:58:40 - Transformation - Using legacy execution engine
      2018/03/22 14:58:40 - transactions-load - Dispatching started for transformation [transactions-load]
      2018/03/22 14:58:43 - CSV file input.0 - Line number : 50000
      2018/03/22 14:58:43 - MariaDB ColumnStore Bulk Loader.0 - Linenr 50000
      2018/03/22 14:58:45 - CSV file input.0 - Line number : 100000
      2018/03/22 14:58:45 - CSV file input.0 - Finished processing (I=101714, O=0, R=0, W=101714, U=0, E=0)
      2018/03/22 14:58:49 - MariaDB ColumnStore Bulk Loader.0 - Linenr 100000
      2018/03/22 14:58:55 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=101714, W=101714, U=0, E=0)
      2018/03/22 14:58:55 - svv-load - Starting entry [Do 50 load cycles]
      2018/03/22 14:58:55 - svv-load - Starting entry [Success]
      2018/03/22 14:58:55 - svv-load - Finished job entry [Success] (result=[true])
      2018/03/22 14:58:55 - svv-load - Finished job entry [Do 50 load cycles] (result=[true])
      2018/03/22 14:58:55 - svv-load - Finished job entry [Transformation] (result=[true])
      2018/03/22 14:58:55 - svv-load - Finished job entry [Cards Load] (result=[true])
      2018/03/22 14:58:55 - svv-load - Finished job entry [Cards] (result=[true])
      2018/03/22 14:58:55 - svv-load - Finished job entry [Set of retry counter] (result=[true])
      2018/03/22 14:58:55 - svv-load - Job execution finished
      2018/03/22 14:58:55 - Kitchen - Finished!
      2018/03/22 14:58:55 - Kitchen - Start=2018/03/22 14:57:30.014, Stop=2018/03/22 14:58:55.970
      2018/03/22 14:58:55 - Kitchen - Processing ended after 1 minutes and 25 seconds (85 seconds total).
      

      Expected:
      Basic log must not be flooded with this message on every field.
      Also I am not sure how this logging affects the performance of the loading operation.

        Attachments

          Activity

            People

            Assignee:
            elena.kotsinova Elena Kotsinova
            Reporter:
            elena.kotsinova Elena Kotsinova
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.