[MCOL-4149] MCS build is very slow Created: 2020-07-06  Updated: 2021-01-14

Status: Open
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: None
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Otto Kekäläinen Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: None

Attachments: PNG File screenshot-1.png     PNG File screenshot-2.png    
Issue Links:
Blocks
blocks MCOL-4057 Package ColumnStore 5.x with 10.5 ser... Closed

 Description   

While working on the Debian packaging and doing builds of the MariaDB Server 10.5 with ColumnStore, I noticed that builds are 2-3x slowed now when ColumnStore was included.

Also re-builds when ccache is enabled are very slow, seems ccache does not get a that many hits.

This has among others the implication that CI builds at https://salsa.debian.org/mariadb-team/mariadb-server/-/pipelines/152994/builds take over 3 hours and cannot complete.

With MCS disabled it takes 0,5-1,5 hours depending on ccache hit rate:
https://salsa.debian.org/mariadb-team/mariadb-server/-/pipelines/150582/builds



 Comments   
Comment by Otto Kekäläinen [ 2020-07-06 ]

vs

Comment by Otto Kekäläinen [ 2020-07-28 ]

The build file size is also quite massive now. Sources + built binaries about to 20,4 GiB.

Biggest directories:

   13,2 GiB [######### ] /builddir                                                                                                                                                                                 
    5,5 GiB [####      ] /debian
    1,1 GiB [          ] /.git
  288,8 MiB [          ] /storage
  204,7 MiB [          ] /mysql-test
   43,6 MiB [          ] /extra
...
 
    8,4 GiB [##########] /storage                                                                                                                                                                                  
    2,3 GiB [##        ] /libmysqld
    1,1 GiB [#         ] /sql
  574,5 MiB [          ] /unittest
  390,5 MiB [          ] /extra
  120,6 MiB [          ] /client
...
 
    3,7 GiB [##########] /columnstore
    2,0 GiB [#####     ] /rocksdb
  917,1 MiB [##        ] /innobase
  674,4 MiB [#         ] /maria
  646,6 MiB [#         ] /perfschema
  150,4 MiB [          ] /mroonga
...
 
  817,5 MiB [##########] /dbcon                                                                                                                                                                                    
  695,5 MiB [########  ] /utils
  642,7 MiB [#######   ] /lib
  372,5 MiB [####      ] /writeengine
  292,3 MiB [###       ] /bin
  152,9 MiB [#         ] /storage-manager
  151,8 MiB [#         ] /obj
  123,8 MiB [#         ] /primitives
  119,3 MiB [#         ] /versioning
   98,2 MiB [#         ] /oamapps
   77,0 MiB [          ] /tools
   61,9 MiB [          ] /procmgr
   58,8 MiB [          ] /oam
   42,6 MiB [          ] /procmon
   27,5 MiB [          ] /dmlproc
   19,2 MiB [          ] /exemgr
   10,4 MiB [          ] /ddlproc
   12,0 KiB [          ]  mcsconfig.h
   12,0 KiB [          ] /CMakeFiles
    8,0 KiB [          ]  Makefile
    8,0 KiB [          ]  cmake_install.cmake
    8,0 KiB [          ] /build
    4,0 KiB [          ]  CTestTestfile.cmake
    4,0 KiB [          ]  gitversionEngine

Generated at Thu Feb 08 02:48:11 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.