[MDBF-329] twised[tls]==19.2.1 needed for Debian 9 builders Created: 2022-01-27  Updated: 2022-02-14  Resolved: 2022-02-14

Status: Closed
Project: MariaDB Foundation Development
Component/s: None
Affects Version/s: None
Fix Version/s: N/A

Type: Task Priority: Major
Reporter: Vlad Bogolin Assignee: Vlad Bogolin
Resolution: Fixed Votes: 0
Labels: buildbot
Remaining Estimate: 0d
Time Spent: 0.5d
Original Estimate: 0d

Issue Links:
PartOf
is part of MDBF-41 Milestone 5: Desirable fixes Open

 Description   

Debian 9 builders do no start without having a particular twisted[tls]==19.2.1. On buildbot side, this translates into

worker not available

error.

One example of problematic image is: quay.io/mariadb-foundation/bb-worker:debian9

[vlad@mariadb-arm-ci04 ~]$ sudo docker run -it quay.io/mariadb-foundation/bb-worker:debian9
/home/buildbot/.local/lib/python3.5/site-packages/OpenSSL/crypto.py:14: CryptographyDeprecationWarning: Python 3.5 support will be dropped in the next release of cryptography. Please upgrade your Python.
  from cryptography import utils, x509
Unhandled Error
Traceback (most recent call last):
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 648, in run
    runApp(config)
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/scripts/twistd.py", line 25, in runApp
    _SomeApplicationRunner(config).run()
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 379, in run
    self.application = self.createOrGetApplication()
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 444, in createOrGetApplication
    application = getApplication(self.config, passphrase)
--- <exception caught here> ---
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 455, in getApplication
    application = service.loadApplication(filename, style, passphrase)
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/service.py", line 411, in loadApplication
    passphrase)
  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/persisted/sob.py", line 223, in loadValueFromFile
    eval(codeObj, d, d)
  File "/home/buildbot/buildbot.tac", line 9, in <module>
    from buildbot_worker.bot import Worker
  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/bot.py", line 19, in <module>
    from buildbot_worker.null import LocalWorker
  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/null.py", line 21, in <module>
    from buildbot_worker.base import WorkerBase
  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/base.py", line 28, in <module>
    from twisted.spread import pb
builtins.ImportError: cannot import name 'pb'
 
 
Failed to load application: cannot import name 'pb'



 Comments   
Comment by Faustin Lammler [ 2022-01-28 ]

Seems to be a ARM related problem only.
I will try to implement a multi-arch check directly in the CI (for the moment only AMD64 was tested).

Comment by Faustin Lammler [ 2022-01-28 ]

I have improved the CI, those error should now be catched directly in the CI:
https://github.com/MariaDB/mariadb.org-tools/pull/99

I'll close this once #99 is merged.

Comment by Faustin Lammler [ 2022-01-31 ]

https://github.com/MariaDB/mariadb.org-tools/pull/99 is working as it now detects the problem directly in the CI.
vladbogo can you investigate how to install BB worker on debian9 ARM (this seems to be the only distrib where we have the pb).

Comment by Vlad Bogolin [ 2022-02-07 ]

Temporary revert to the older image to have the aarch64-debian-9 built for release.

Comment by Vlad Bogolin [ 2022-02-14 ]

faust I was able to install twised[tls]==19.2.1 manually and I can confirm that this solved the Debian 9 issue. However, if I remember correctly, this version couldn't be installed in the CI. Do you remember any details? I cannot find at this point the run. An older version would work, but I think we should understand the issue first.

Comment by Faustin Lammler [ 2022-02-14 ]

It seems that we need to specifically install the incremental package before twised.
This should fix it: https://github.com/MariaDB/mariadb.org-tools/pull/105

Generated at Thu Feb 08 03:37:05 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.