Uploaded image for project: 'MariaDB Foundation Development'
  1. MariaDB Foundation Development
  2. MDBF-329

twised[tls]==19.2.1 needed for Debian 9 builders

Details

    • Task
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • N/A
    • Buildbot
    • None

    Description

      Debian 9 builders do no start without having a particular twisted[tls]==19.2.1. On buildbot side, this translates into

      worker not available
      

      error.

      One example of problematic image is: quay.io/mariadb-foundation/bb-worker:debian9

      [vlad@mariadb-arm-ci04 ~]$ sudo docker run -it quay.io/mariadb-foundation/bb-worker:debian9
      /home/buildbot/.local/lib/python3.5/site-packages/OpenSSL/crypto.py:14: CryptographyDeprecationWarning: Python 3.5 support will be dropped in the next release of cryptography. Please upgrade your Python.
        from cryptography import utils, x509
      Unhandled Error
      Traceback (most recent call last):
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 648, in run
          runApp(config)
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/scripts/twistd.py", line 25, in runApp
          _SomeApplicationRunner(config).run()
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 379, in run
          self.application = self.createOrGetApplication()
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 444, in createOrGetApplication
          application = getApplication(self.config, passphrase)
      --- <exception caught here> ---
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 455, in getApplication
          application = service.loadApplication(filename, style, passphrase)
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/service.py", line 411, in loadApplication
          passphrase)
        File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/persisted/sob.py", line 223, in loadValueFromFile
          eval(codeObj, d, d)
        File "/home/buildbot/buildbot.tac", line 9, in <module>
          from buildbot_worker.bot import Worker
        File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/bot.py", line 19, in <module>
          from buildbot_worker.null import LocalWorker
        File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/null.py", line 21, in <module>
          from buildbot_worker.base import WorkerBase
        File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/base.py", line 28, in <module>
          from twisted.spread import pb
      builtins.ImportError: cannot import name 'pb'
       
       
      Failed to load application: cannot import name 'pb'
      

      Attachments

        Issue Links

          Activity

            Seems to be a ARM related problem only.
            I will try to implement a multi-arch check directly in the CI (for the moment only AMD64 was tested).

            faust Faustin Lammler added a comment - Seems to be a ARM related problem only. I will try to implement a multi-arch check directly in the CI (for the moment only AMD64 was tested).

            I have improved the CI, those error should now be catched directly in the CI:
            https://github.com/MariaDB/mariadb.org-tools/pull/99

            I'll close this once #99 is merged.

            faust Faustin Lammler added a comment - I have improved the CI, those error should now be catched directly in the CI: https://github.com/MariaDB/mariadb.org-tools/pull/99 I'll close this once #99 is merged.

            https://github.com/MariaDB/mariadb.org-tools/pull/99 is working as it now detects the problem directly in the CI.
            vladbogo can you investigate how to install BB worker on debian9 ARM (this seems to be the only distrib where we have the pb).

            faust Faustin Lammler added a comment - https://github.com/MariaDB/mariadb.org-tools/pull/99 is working as it now detects the problem directly in the CI. vladbogo can you investigate how to install BB worker on debian9 ARM (this seems to be the only distrib where we have the pb).
            vladbogo Vlad Bogolin added a comment -

            Temporary revert to the older image to have the aarch64-debian-9 built for release.

            vladbogo Vlad Bogolin added a comment - Temporary revert to the older image to have the aarch64-debian-9 built for release.
            vladbogo Vlad Bogolin added a comment -

            faust I was able to install twised[tls]==19.2.1 manually and I can confirm that this solved the Debian 9 issue. However, if I remember correctly, this version couldn't be installed in the CI. Do you remember any details? I cannot find at this point the run. An older version would work, but I think we should understand the issue first.

            vladbogo Vlad Bogolin added a comment - faust I was able to install twised [tls] ==19.2.1 manually and I can confirm that this solved the Debian 9 issue. However, if I remember correctly, this version couldn't be installed in the CI. Do you remember any details? I cannot find at this point the run. An older version would work, but I think we should understand the issue first.

            It seems that we need to specifically install the incremental package before twised.
            This should fix it: https://github.com/MariaDB/mariadb.org-tools/pull/105

            faust Faustin Lammler added a comment - It seems that we need to specifically install the incremental package before twised. This should fix it: https://github.com/MariaDB/mariadb.org-tools/pull/105

            People

              vladbogo Vlad Bogolin
              vladbogo Vlad Bogolin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 0d
                  0d
                  Remaining:
                  Remaining Estimate - 0d
                  0d
                  Logged:
                  Time Spent - 0.5d
                  0.5d