Uploaded image for project: 'MariaDB Foundation Development'
  1. MariaDB Foundation Development
  2. MDBF-1048

DirectoryUpload causes master to disconnect from Crossbar

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Critical
    • Resolution: Fixed
    • BB V1.06
    • BB V1.07
    • Buildbot
    • None

    Description

      Large files transferred via DirectoryUpload step can block the master and finally causing it to disconnect from Crossbar.

      To reduce the load on master, instead of:
      https://github.com/MariaDB/buildbot/blob/d5136c7dce664a65ae8932712da3298af34cf3d7/master-docker-nonstandard-2/master.cfg#L338
      where DirectoryUpload will transfer the data to the master and then the master will write it to ci.mariadb.org

      we should rather switch to the standard approach of using a network attached storage, implemented by saveLogs() function in:
      https://github.com/MariaDB/buildbot/blob/d5136c7dce664a65ae8932712da3298af34cf3d7/master-docker-nonstandard-2/master.cfg#L670

      this will keep the load on the worker and the master will only be responsible of retrieving the stdout/err logs.

      Attachments

        Activity

          People

            rvarzaru Varzaru Razvan-Liviu
            rvarzaru Varzaru Razvan-Liviu
            Daniel Black Daniel Black
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 0.5d
                0.5d
                Remaining:
                Remaining Estimate - 0d
                0d
                Logged:
                Time Spent - 0.5d
                0.5d