Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-2023

mcsimport run in concurrency is causing crash and mcs restating

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Won't Do
    • Affects Version/s: 1.2.2, 1.2.3
    • Fix Version/s: N/A
    • Labels:
      None
    • Environment:
      mcs single server, 64G memory, 8 CPUs ; CentOS7.5
    • Sprint:
      2021-5

      Description

      mcsimport run in concurrency is causing crash and mcs restating

      mcsimport was rum from the cs node in order to compare the mcsimport performance to cpimport performance.
      Several mcsimport tasks are run in concurrency to load 1TB data in 24 tables , as 1 mcsimport per table.
      It is observed hight CPU usage in mcs controllernode process followed by
      "Error during mcsapi initialization: Could not read data: EOF " Errors
      crashing and mcs restarting .

       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  call_center insert-data-tables/data/tpcds_1000/call_center.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  catalog_page insert-data-tables/data/tpcds_1000/catalog_page.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  catalog_returns insert-data-tables/data/tpcds_1000/catalog_returns.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  catalog_sales insert-data-tables/data/tpcds_1000/catalog_sales.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  customer_address insert-data-tables/data/tpcds_1000/customer_address.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  customer_demographics insert-data-tables/data/tpcds_1000/customer_demographics.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  customer insert-data-tables/data/tpcds_1000/customer.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  date_dim insert-data-tables/data/tpcds_1000/date_dim.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  household_demographics insert-data-tables/data/tpcds_1000/household_demographics.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  income_band insert-data-tables/data/tpcds_1000/income_band.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  inventory insert-data-tables/data/tpcds_1000/inventory.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  item insert-data-tables/data/tpcds_1000/item.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  promotion insert-data-tables/data/tpcds_1000/promotion.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  reason insert-data-tables/data/tpcds_1000/reason.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  ship_mode insert-data-tables/data/tpcds_1000/ship_mode.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  store_returns insert-data-tables/data/tpcds_1000/store_returns.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  store_sales insert-data-tables/data/tpcds_1000/store_sales.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  store insert-data-tables/data/tpcds_1000/store.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  time_dim insert-data-tables/data/tpcds_1000/time_dim.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  warehouse insert-data-tables/data/tpcds_1000/warehouse.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  web_page insert-data-tables/data/tpcds_1000/web_page.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  web_returns insert-data-tables/data/tpcds_1000/web_returns.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  web_sales insert-data-tables/data/tpcds_1000/web_sales.tbl -d "|"   &
       /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport    tpcds_1000  web_site insert-data-tables/data/tpcds_1000/web_site.tbl -d "|"   &
      
      

      [root@cps mariadb-columnstore-tpcds]# jobsError during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      Error during mcsapi initialization: Could not read data: EOF
      
      

       
        PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
       3438 root      20   0 1860976  16032  10608 S 300.3  0.0   2:20.71 controllernode
        629 ovirtag+  20   0  451680  12636   5476 S   0.3  0.0  84:29.11 python
       6938 root      20   0  161972   2296   1580 R   0.3  0.0   0:00.03 top
          1 root      20   0  191548   2996   2020 S   0.0  0.0   0:06.77 systemd
          2 root      20   0       0      0      0 S   0.0  0.0   0:00.25 kthreadd
          3 root      20   0       0      0      0 S   0.0  0.0   0:01.97 ksoftirqd/0
          5 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/0:0H
          7 root      rt   0       0      0      0 S   0.0  0.0   0:09.81 migration/0
          8 root      20   0       0      0      0 S   0.0  0.0   0:00.00 rcu_bh
          9 root      20   0       0      0      0 S   0.0  0.0   4:28.74 rcu_sched
         10 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 lru-add-drain
         11 root      rt   0       0      0      0 S   0.0  0.0   0:09.63 watchdog/0
         12 root      rt   0       0      0      0 S   0.0  0.0   0:08.96 watchdog/1
         13 root      rt   0       0      0      0 S   0.0  0.0   0:09.50 migration/1
         14 root      20   0       0      0      0 S   0.0  0.0   0:06.02 ksoftirqd/1
         16 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/1:0H
         17 root      rt   0       0      0      0 S   0.0  0.0   0:09.10 watchdog/2
       
       
      
      

      Dec 14 13:31:17 cps ServerMonitor[9157]: 17.188334 |0|0|0| W 09 CAL0000: / alarm # 5 cleared
      Dec 14 13:31:17 cps ServerMonitor[9157]: 17.190685 |0|0|0| W 09 CAL0000: / alarm # 6 cleared
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.560304 |0|0|0| C 18 CAL0000: *****MariaDB ColumnStore Process Restarting: DBRMControllerNode, old PID = 27579
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.560508 |0|0|0| D 18 CAL0000: STOPPING Process: DBRMControllerNode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.560643 |0|0|0| D 18 CAL0000: Send SET Alarm ID 13 on device DBRMControllerNode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.560775 |0|0|0| D 18 CAL0000: StatusUpdate of Process DBRMControllerNode State = 1 PID = 0
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.565322 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DBRMControllerNode State = AUTO_OFFLINE
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.565368 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DBRMControllerNode State = AUTO_OFFLINE PID = 0
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.565970 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DBRMControllerNode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.566888 |0|0|0| D 18 CAL0000: Send SET Alarm ID 13 on device DBRMControllerNode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.575111 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: controllernode*
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.575202 |0|0|0| D 18 CAL0000: STARTING Process: DBRMControllerNode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.575221 |0|0|0| D 18 CAL0000: Process location: /usr/local/mariadb/columnstore/bin/controllernode
      Dec 14 13:32:00 cps ProcessMonitor[1203]: 00.575696 |0|0|0| D 18 CAL0000: Dependent process of ProcessManager/pm1 is 4
      Dec 14 13:32:02 cps ProcessMonitor[1203]: 02.614417 |0|0|0| D 18 CAL0000: BRM reset_locks script run
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.103242 |0|0|0| D 18 CAL0000: Clear Shared Memory script run
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.103307 |0|0|0| D 18 CAL0000: load_brm cmd = /usr/local/mariadb/columnstore/bin/load_brm /usr/local/mariadb/columnstore/data1/systemFiles/dbrm/BRM_savesA > / var/log/mariadb/columnstore/load_brm.log1 2>&1
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.181417 |0|0|0| D 18 CAL0000: Successfully return from load_brm
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.185011 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 27 on device DBRM
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.196671 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: controllernode*
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.196778 |0|0|0| D 18 CAL0000: StatusUpdate of Process DBRMControllerNode State = 3 PID = 0
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.197500 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DBRMControllerNode State = AUTO_INIT
      Dec 14 13:32:03 cps ProcessMonitor[1203]: 03.197545 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DBRMControllerNode State = AUTO_INIT PID = 0
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.215839 |0|0|0| D 18 CAL0000: StatusUpdate of Process DBRMControllerNode State = 21 PID = 3438
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.216866 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DBRMControllerNode State = PID_UPDATE
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.216913 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DBRMControllerNode State = PID_UPDATE PID = 3438
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.217015 |0|0|0| D 18 CAL0000: DBRMControllerNode PID is 3438
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.217308 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 21 on device DBRMControllerNode
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.217841 |0|0|0| D 18 CAL0000: Inform Process Mgr that process was restarted: DBRMControllerNode
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.218313 |0|0|0| D 18 CAL0000: Inform Process Mgr that process was restarted: DBRMControllerNode
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.218524 |0|0|0| I 18 CAL0000: MariaDB ColumnStore Process DBRMControllerNode restarted successfully!!
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.218833 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 13 on device DBRMControllerNode
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.221898 |0|0|0| I 17 CAL0000: MSG RECEIVED: Process Restarted on pm1/DBRMControllerNode
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.221998 |0|0|0| D 17 CAL0000: setQuerySystemState called = 0
      Dec 14 13:32:04 cps controllernode[20607]: 04.222548 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::clearSystemState() failed (network)
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.222585 |0|0|0| D 17 CAL0000: setSystemQueryReady = 0
      Dec 14 13:32:04 cps controllernode[20607]: 04.224363 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::clearSystemState() failed (network)
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.224396 |0|0|0| D 17 CAL0000: setSystemReady = 0
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.227198 |0|0|0| D 17 CAL0000: Set System State = BUSY_INIT
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.227431 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DBRMControllerNode
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.227815 |0|0|0| I 17 CAL0000: MSG RECEIVED: Process Restarted on pm1/DBRMControllerNode
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.227971 |0|0|0| D 17 CAL0000: setQuerySystemState called = 0
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.228238 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = BUSY_INIT
      Dec 14 13:32:04 cps controllernode[20607]: 04.228437 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::clearSystemState() failed (network)
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.228478 |0|0|0| D 17 CAL0000: setSystemQueryReady = 0
      Dec 14 13:32:04 cps controllernode[20607]: 04.229235 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::clearSystemState() failed (network)
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.229272 |0|0|0| D 17 CAL0000: setSystemReady = 0
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.229704 |0|0|0| D 17 CAL0000: Set System State = BUSY_INIT
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.231692 |0|0|0| D 17 CAL0000: reinitProcessType: ReInit all cpimport
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.231713 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = BUSY_INIT
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.234384 |0|0|0| D 17 CAL0000: reinitProcessType: ReInit all cpimport
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.235520 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.235750 |0|0|0| D 17 CAL0000: cpimport process is reinited by request.
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.235783 |0|0|0| D 17 CAL0000: reinitProcessType: ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.235997 |0|0|0| I 18 CAL0000: MSG RECEIVED: Re-Init process request on: cpimport
      Dec 14 13:32:04 cps ProcessManager[20607]: 04.239641 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:04 cps ProcessMonitor[1203]: 04.249813 |0|0|0| I 18 CAL0000: PROCREINITPROCESS: completed, no ack to ProcMgr
      Dec 14 13:32:05 cps ProcessMonitor[1203]: 05.247720 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DBRMControllerNode State = ACTIVE
      Dec 14 13:32:05 cps ProcessMonitor[1203]: 05.247767 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DBRMControllerNode State = ACTIVE PID = 3438
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.250133 |0|0|0| D 17 CAL0000: cpimport process is reinited by request.
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.250177 |0|0|0| D 17 CAL0000: reinitProcessType: ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:05 cps ProcessMonitor[1203]: 05.250573 |0|0|0| I 18 CAL0000: MSG RECEIVED: Re-Init process request on: cpimport
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.254776 |0|0|0| D 17 CAL0000: restartProcessType: Restart all DDLProc
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.257860 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.258671 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.259457 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:05 cps ProcessManager[20607]: 05.259525 |0|0|0| D 17 CAL0000: distributeConfigFile called for system file = Columnstore.xml
      Dec 14 13:32:05 cps ProcessMonitor[1203]: 05.265714 |0|0|0| I 18 CAL0000: PROCREINITPROCESS: completed, no ack to ProcMgr
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.243144 |0|0|0| D 17 CAL0000: restartProcessType: Restart all DDLProc
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.246130 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.246952 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.247731 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.247798 |0|0|0| D 17 CAL0000: distributeConfigFile called for system file = Columnstore.xml
      Dec 14 13:32:06 cps ProcessManager[20607]: 06.266321 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.266679 |0|0|0| I 18 CAL0000: MSG RECEIVED: Restart process request on DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.266759 |0|0|0| D 18 CAL0000: STOPPING Process: DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.266885 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 0 PID = 0
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.267051 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.271483 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = MAN_OFFLINE
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.271521 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = MAN_OFFLINE PID = 0
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.272981 |0|0|0| D 18 CAL0000: Send SET Alarm ID 21 on device DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.281283 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DDLProc*
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.281551 |0|0|0| D 18 CAL0000: checkSpecialProcessState on : DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.281580 |0|0|0| D 18 CAL0000: checkSpecialProcessState status return : 2
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.281639 |0|0|0| D 18 CAL0000: STARTING Process: DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.281655 |0|0|0| D 18 CAL0000: Process location: /usr/local/mariadb/columnstore/bin/DDLProc
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.282277 |0|0|0| D 18 CAL0000: Dependent process of WriteEngineServer/pm1 is 4
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.284513 |0|0|0| D 18 CAL0000: Dependent process of DBRMWorkerNode/pm1 is 4
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.285022 |0|0|0| D 18 CAL0000: Dependent process of ExeMgr/pm1 is 4
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.286885 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 27 on device DBRM
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.300050 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DDLProc*
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.300157 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 2 PID = 0
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.300856 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = MAN_INIT
      Dec 14 13:32:06 cps ProcessMonitor[1203]: 06.300892 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = MAN_INIT PID = 0
      Dec 14 13:32:07 cps ProcessManager[20607]: 07.253461 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.318358 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 21 PID = 3507
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.319166 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = PID_UPDATE
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.319202 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = PID_UPDATE PID = 3507
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.319309 |0|0|0| D 18 CAL0000: DDLProc PID is 3507
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.319603 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 21 on device DDLProc
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.320965 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 13 on device DDLProc
      Dec 14 13:32:07 cps ProcessMonitor[1203]: 07.322585 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DDLProc
      Dec 14 13:32:08 cps ProcessMonitor[1203]: 08.366078 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = ACTIVE
      Dec 14 13:32:08 cps ProcessMonitor[1203]: 08.366129 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = ACTIVE PID = 3507
      Dec 14 13:32:10 cps ProcessMonitor[1203]: 10.320336 |0|0|0| I 18 CAL0000: RESTART: ACK back to ProcMgr, return status = 0
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.320491 |0|0|0| D 17 CAL0000: DDLProc process is restarted by request.
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.320526 |0|0|0| D 17 CAL0000: restartProcessType: Start ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.321480 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.322306 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.322522 |0|0|0| D 17 CAL0000: restartProcessType: Restart all DMLProc
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.325370 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.326193 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.326978 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:10 cps ProcessManager[20607]: 10.327045 |0|0|0| D 17 CAL0000: distributeConfigFile called for system file = Columnstore.xml
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.321615 |0|0|0| I 18 CAL0000: MSG RECEIVED: Restart process request on DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.321707 |0|0|0| D 18 CAL0000: STOPPING Process: DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.321825 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 0 PID = 0
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.325286 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.326784 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = MAN_OFFLINE
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.326822 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = MAN_OFFLINE PID = 0
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.327627 |0|0|0| D 18 CAL0000: Send SET Alarm ID 21 on device DDLProc
      Dec 14 13:32:11 cps ProcessManager[20607]: 11.332525 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.337514 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DDLProc*
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.337789 |0|0|0| D 18 CAL0000: checkSpecialProcessState on : DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.337821 |0|0|0| D 18 CAL0000: checkSpecialProcessState status return : 2
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.337881 |0|0|0| D 18 CAL0000: STARTING Process: DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.337899 |0|0|0| D 18 CAL0000: Process location: /usr/local/mariadb/columnstore/bin/DDLProc
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.338573 |0|0|0| D 18 CAL0000: Dependent process of WriteEngineServer/pm1 is 4
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.340801 |0|0|0| D 18 CAL0000: Dependent process of DBRMWorkerNode/pm1 is 4
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.341307 |0|0|0| D 18 CAL0000: Dependent process of ExeMgr/pm1 is 4
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.346526 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 27 on device DBRM
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.358169 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DDLProc*
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.358290 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 2 PID = 0
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.358962 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = MAN_INIT
      Dec 14 13:32:11 cps ProcessMonitor[1203]: 11.359000 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = MAN_INIT PID = 0
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.380121 |0|0|0| D 18 CAL0000: StatusUpdate of Process DDLProc State = 21 PID = 3586
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.381002 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = PID_UPDATE
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.381042 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = PID_UPDATE PID = 3586
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.381168 |0|0|0| D 18 CAL0000: DDLProc PID is 3586
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.381543 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 13 on device DDLProc
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.382857 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DDLProc
      Dec 14 13:32:12 cps ProcessMonitor[1203]: 12.383874 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 21 on device DDLProc
      Dec 14 13:32:13 cps ProcessMonitor[1203]: 13.424613 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DDLProc State = ACTIVE
      Dec 14 13:32:13 cps ProcessMonitor[1203]: 13.424656 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DDLProc State = ACTIVE PID = 3586
      Dec 14 13:32:15 cps ProcessMonitor[1203]: 15.381766 |0|0|0| I 18 CAL0000: RESTART: ACK back to ProcMgr, return status = 0
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.381915 |0|0|0| D 17 CAL0000: DDLProc process is restarted by request.
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.381974 |0|0|0| D 17 CAL0000: restartProcessType: Start ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.382819 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.383649 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.383846 |0|0|0| D 17 CAL0000: restartProcessType: Restart all DMLProc
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.386800 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.387625 |0|0|0| D 17 CAL0000: setPMProcIPs for DDLProc: no update needed
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.388409 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:15 cps ProcessManager[20607]: 15.388478 |0|0|0| D 17 CAL0000: distributeConfigFile called for system file = Columnstore.xml
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.383206 |0|0|0| I 18 CAL0000: MSG RECEIVED: Restart process request on DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.383290 |0|0|0| D 18 CAL0000: STOPPING Process: DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.383422 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 0 PID = 0
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.383688 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.388237 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = MAN_OFFLINE
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.388292 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = MAN_OFFLINE PID = 0
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.388458 |0|0|0| D 18 CAL0000: Send SET Alarm ID 21 on device DMLProc
      Dec 14 13:32:16 cps ProcessManager[20607]: 16.393904 |0|0|0| D 17 CAL0000: sendMsgProcMon: Process module pm1
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.399084 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DMLProc*
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.399338 |0|0|0| D 18 CAL0000: checkSpecialProcessState on : DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.399370 |0|0|0| D 18 CAL0000: checkSpecialProcessState status return : 2
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.399437 |0|0|0| D 18 CAL0000: STARTING Process: DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.399454 |0|0|0| D 18 CAL0000: Process location: /usr/local/mariadb/columnstore/bin/DMLProc
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.400043 |0|0|0| D 18 CAL0000: Dependent process of WriteEngineServer/pm1 is 4
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.402293 |0|0|0| D 18 CAL0000: Dependent process of DBRMWorkerNode/pm1 is 4
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.402782 |0|0|0| D 18 CAL0000: Dependent process of DDLProc/pm1 is 4
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.405582 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 27 on device DBRM
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.416428 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DMLProc*
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.416534 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 2 PID = 0
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.417190 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = MAN_INIT
      Dec 14 13:32:16 cps ProcessMonitor[1203]: 16.417219 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = MAN_INIT PID = 0
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.439067 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 21 PID = 3662
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.440024 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = PID_UPDATE
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.440072 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = PID_UPDATE PID = 3662
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.440141 |0|0|0| D 18 CAL0000: DMLProc PID is 3662
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.440409 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 21 on device DMLProc
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.441436 |0|0|0| I 18 CAL0000: RESTART: ACK back to ProcMgr, return status = 0
      Dec 14 13:32:17 cps ProcessManager[20607]: 17.441509 |0|0|0| D 17 CAL0000: DMLProc process is restarted by request.
      Dec 14 13:32:17 cps ProcessManager[20607]: 17.441560 |0|0|0| D 17 CAL0000: restartProcessType: Start ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.442732 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 13 on device DMLProc
      Dec 14 13:32:17 cps ProcessManager[20607]: 17.443454 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:17 cps ProcessManager[20607]: 17.444990 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:17 cps ProcessMonitor[1203]: 17.445110 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.441871 |0|0|0| I 18 CAL0000: MSG RECEIVED: Restart process request on DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.441988 |0|0|0| D 18 CAL0000: STOPPING Process: DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.442108 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 0 PID = 0
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.442292 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.448293 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = MAN_OFFLINE
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.448337 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = MAN_OFFLINE PID = 0
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.448689 |0|0|0| D 18 CAL0000: Send SET Alarm ID 21 on device DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.458708 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DMLProc*
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.459000 |0|0|0| D 18 CAL0000: checkSpecialProcessState on : DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.459030 |0|0|0| D 18 CAL0000: checkSpecialProcessState status return : 2
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.459094 |0|0|0| D 18 CAL0000: STARTING Process: DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.459112 |0|0|0| D 18 CAL0000: Process location: /usr/local/mariadb/columnstore/bin/DMLProc
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.459702 |0|0|0| D 18 CAL0000: Dependent process of WriteEngineServer/pm1 is 4
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.462130 |0|0|0| D 18 CAL0000: Dependent process of DBRMWorkerNode/pm1 is 4
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.462619 |0|0|0| D 18 CAL0000: Dependent process of DDLProc/pm1 is 4
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.465946 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 27 on device DBRM
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.477983 |0|0|0| D 18 CAL0000: Pkill Process just to make sure: DMLProc*
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.478088 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 2 PID = 0
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.478813 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = MAN_INIT
      Dec 14 13:32:18 cps ProcessMonitor[1203]: 18.478852 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = MAN_INIT PID = 0
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.498315 |0|0|0| D 18 CAL0000: StatusUpdate of Process DMLProc State = 21 PID = 3739
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.499175 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = PID_UPDATE
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.499222 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = PID_UPDATE PID = 3739
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.499348 |0|0|0| D 18 CAL0000: DMLProc PID is 3739
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.499777 |0|0|0| I 18 CAL0000: RESTART: ACK back to ProcMgr, return status = 0
      Dec 14 13:32:19 cps ProcessManager[20607]: 19.499860 |0|0|0| D 17 CAL0000: DMLProc process is restarted by request.
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.499843 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 13 on device DMLProc
      Dec 14 13:32:19 cps ProcessManager[20607]: 19.499899 |0|0|0| D 17 CAL0000: restartProcessType: Start ACK received from Process-Monitor, return status = 0
      Dec 14 13:32:19 cps ProcessManager[20607]: 19.500997 |0|0|0| D 17 CAL0000: setPMProcIPs called for pm1
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.501389 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 21 on device DMLProc
      Dec 14 13:32:19 cps ProcessManager[20607]: 19.502393 |0|0|0| D 17 CAL0000: setPMProcIPs for DMLProc: no update needed, exiting function
      Dec 14 13:32:19 cps ProcessMonitor[1203]: 19.503025 |0|0|0| D 18 CAL0000: Send CLEAR Alarm ID 25 on device DMLProc
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.540517 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = BUSY_INIT
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.540565 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = BUSY_INIT PID = 3739
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.540588 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = BUSY_INIT
      Dec 14 13:32:20 cps DMLProc[3739]: 20.542227 |0|0|0| I 20 CAL0002: DMLProc starts rollbackAll.
      Dec 14 13:32:20 cps DMLProc[3739]: 20.573206 |0|0|0| I 20 CAL0002: DDLCleanup is cleaning table with oid 29534
      Dec 14 13:32:20 cps DMLProc[3739]: 20.573624 |0|0|0| I 20 CAL0002: DMLProc will rollback 0 tables.
      Dec 14 13:32:20 cps DMLProc[3739]: 20.574004 |0|0|0| I 20 CAL0002: DDLCleanup is cleaning table with oid 46357
      Dec 14 13:32:20 cps DMLProc[3739]: 20.585146 |0|0|0| I 20 CAL0002: DMLProc finished rollbackAll.
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.644783 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set Process pm1/DMLProc State = ACTIVE
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.644829 |0|0|0| D 18 CAL0000: statusControl: Set Process pm1/DMLProc State = ACTIVE PID = 3739
      Dec 14 13:32:20 cps ProcessMonitor[1203]: 20.644851 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = ACTIVE
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.451157 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.451647 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.451778 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.452385 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.452531 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.452594 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.452844 |0|0|0| D 17 CAL0000: Set System State = ACTIVE
      Dec 14 13:32:21 cps ProcessMonitor[1203]: 21.453314 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = ACTIVE
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.453515 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.453631 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.453701 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.456002 |0|0|0| I 17 CAL0000: MSG RECEIVED: Process Restarted Completed
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.504776 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.504882 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.504962 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.505501 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.505582 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.505640 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.505885 |0|0|0| D 17 CAL0000: Set System State = ACTIVE
      Dec 14 13:32:21 cps ProcessMonitor[1203]: 21.506315 |0|0|0| D 18 CAL0000: statusControl: REQUEST RECEIVED: Set System State = ACTIVE
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.506463 |0|0|0| D 17 CAL0000: setQuerySystemState called = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.506553 |0|0|0| D 17 CAL0000: setSystemQueryReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.506613 |0|0|0| D 17 CAL0000: setSystemReady = 1
      Dec 14 13:32:21 cps ProcessManager[20607]: 21.509115 |0|0|0| I 17 CAL0000: MSG RECEIVED: Process Restarted Completed

      
      

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              winstone Zdravelina Sokolovska (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Git Integration