Details
-
Bug
-
Status: Closed (View Workflow)
-
Minor
-
Resolution: Fixed
-
1.1.4
-
None
-
None
-
2018-07
Description
Process of a bulk load of data from CSV file displays a warning message about inserting a NULL values into database fields.
This message appears for every such field in the base log.
This message can fill the log very quickly if file contains lots of data.
example:
......
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 3: Field_003 into column 3: merchant_id
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
|
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
|
2018/03/22 14:58:40 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=134970, W=134970, U=0, E=0)
|
2018/03/22 14:58:40 - svv-load - Starting entry [Transformation]
|
2018/03/22 14:58:40 - Transformation - Loading transformation from XML file [file:///home/elena.kotsinova/downloads/PDI-TEST-SCENARIOS/transactions-load.ktr]
|
2018/03/22 14:58:40 - Transformation - Using run configuration [Pentaho local]
|
2018/03/22 14:58:40 - Transformation - Using legacy execution engine
|
2018/03/22 14:58:40 - transactions-load - Dispatching started for transformation [transactions-load]
|
2018/03/22 14:58:43 - CSV file input.0 - Line number : 50000
|
2018/03/22 14:58:43 - MariaDB ColumnStore Bulk Loader.0 - Linenr 50000
|
2018/03/22 14:58:45 - CSV file input.0 - Line number : 100000
|
2018/03/22 14:58:45 - CSV file input.0 - Finished processing (I=101714, O=0, R=0, W=101714, U=0, E=0)
|
2018/03/22 14:58:49 - MariaDB ColumnStore Bulk Loader.0 - Linenr 100000
|
2018/03/22 14:58:55 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=101714, W=101714, U=0, E=0)
|
2018/03/22 14:58:55 - svv-load - Starting entry [Do 50 load cycles]
|
2018/03/22 14:58:55 - svv-load - Starting entry [Success]
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Success] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Do 50 load cycles] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Transformation] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Cards Load] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Cards] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Finished job entry [Set of retry counter] (result=[true])
|
2018/03/22 14:58:55 - svv-load - Job execution finished
|
2018/03/22 14:58:55 - Kitchen - Finished!
|
2018/03/22 14:58:55 - Kitchen - Start=2018/03/22 14:57:30.014, Stop=2018/03/22 14:58:55.970
|
2018/03/22 14:58:55 - Kitchen - Processing ended after 1 minutes and 25 seconds (85 seconds total).
|
Expected:
Basic log must not be flooded with this message on every field.
Also I am not sure how this logging affects the performance of the loading operation.