[MCOL-1292] Warning about inserting of NULL values in DB fields appears in base log for every field Created: 2018-03-22  Updated: 2023-10-26  Resolved: 2018-03-30

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: 1.1.4
Fix Version/s: 1.1.4

Type: Bug Priority: Minor
Reporter: Elena Kotsinova (Inactive) Assignee: Elena Kotsinova (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2018-07

 Description   

Process of a bulk load of data from CSV file displays a warning message about inserting a NULL values into database fields.
This message appears for every such field in the base log.
This message can fill the log very quickly if file contains lots of data.

example:

......
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 3: Field_003 into column 3: merchant_id
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 4: Field_004 into column 4: balance
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 6: Field_006 into column 6: expiry_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 8: Field_008 into column 8: lost_stolen_datetime
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 9: Field_009 into column 9: first_topup_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 10: Field_010 into column 10: first_debit_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 11: Field_011 into column 11: last_transaction_date
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: trying to insert item of type null from field 13: Field_013 into column 13: coupon_id
2018/03/22 14:58:30 - MariaDB ColumnStore Bulk Loader.0 - Warning: using default value for null
2018/03/22 14:58:40 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=134970, W=134970, U=0, E=0)
2018/03/22 14:58:40 - svv-load - Starting entry [Transformation]
2018/03/22 14:58:40 - Transformation - Loading transformation from XML file [file:///home/elena.kotsinova/downloads/PDI-TEST-SCENARIOS/transactions-load.ktr]
2018/03/22 14:58:40 - Transformation - Using run configuration [Pentaho local]
2018/03/22 14:58:40 - Transformation - Using legacy execution engine
2018/03/22 14:58:40 - transactions-load - Dispatching started for transformation [transactions-load]
2018/03/22 14:58:43 - CSV file input.0 - Line number : 50000
2018/03/22 14:58:43 - MariaDB ColumnStore Bulk Loader.0 - Linenr 50000
2018/03/22 14:58:45 - CSV file input.0 - Line number : 100000
2018/03/22 14:58:45 - CSV file input.0 - Finished processing (I=101714, O=0, R=0, W=101714, U=0, E=0)
2018/03/22 14:58:49 - MariaDB ColumnStore Bulk Loader.0 - Linenr 100000
2018/03/22 14:58:55 - MariaDB ColumnStore Bulk Loader.0 - Finished processing (I=0, O=0, R=101714, W=101714, U=0, E=0)
2018/03/22 14:58:55 - svv-load - Starting entry [Do 50 load cycles]
2018/03/22 14:58:55 - svv-load - Starting entry [Success]
2018/03/22 14:58:55 - svv-load - Finished job entry [Success] (result=[true])
2018/03/22 14:58:55 - svv-load - Finished job entry [Do 50 load cycles] (result=[true])
2018/03/22 14:58:55 - svv-load - Finished job entry [Transformation] (result=[true])
2018/03/22 14:58:55 - svv-load - Finished job entry [Cards Load] (result=[true])
2018/03/22 14:58:55 - svv-load - Finished job entry [Cards] (result=[true])
2018/03/22 14:58:55 - svv-load - Finished job entry [Set of retry counter] (result=[true])
2018/03/22 14:58:55 - svv-load - Job execution finished
2018/03/22 14:58:55 - Kitchen - Finished!
2018/03/22 14:58:55 - Kitchen - Start=2018/03/22 14:57:30.014, Stop=2018/03/22 14:58:55.970
2018/03/22 14:58:55 - Kitchen - Processing ended after 1 minutes and 25 seconds (85 seconds total).

Expected:
Basic log must not be flooded with this message on every field.
Also I am not sure how this logging affects the performance of the loading operation.



 Comments   
Comment by Jens Röwekamp (Inactive) [ 2018-03-27 ]

Due to git merge issues, committed to branch MCOL-1283.

Comment by Elena Kotsinova (Inactive) [ 2018-03-30 ]

Verified for:
Version: 1.1.4
Revision: 2b9b9e1

Generated at Thu Feb 08 02:27:39 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.