[MDBF-329] twised[tls]==19.2.1 needed for Debian 9 builders - Jira

Details

Type: Task
Status: Closed (View Workflow)
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: N/A
Component/s: Buildbot
Labels:
None

Description

Debian 9 builders do no start without having a particular twisted[tls]==19.2.1. On buildbot side, this translates into

worker not available

error.

One example of problematic image is: quay.io/mariadb-foundation/bb-worker:debian9

[vlad@mariadb-arm-ci04 ~]$ sudo docker run -it quay.io/mariadb-foundation/bb-worker:debian9

/home/buildbot/.local/lib/python3.5/site-packages/OpenSSL/crypto.py:14: CryptographyDeprecationWarning: Python 3.5 support will be dropped in the next release of cryptography. Please upgrade your Python.

  from cryptography import utils, x509

Unhandled Error

Traceback (most recent call last):

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 648, in run

    runApp(config)

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/scripts/twistd.py", line 25, in runApp

    _SomeApplicationRunner(config).run()

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 379, in run

    self.application = self.createOrGetApplication()

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 444, in createOrGetApplication

    application = getApplication(self.config, passphrase)

--- <exception caught here> ---

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/app.py", line 455, in getApplication

    application = service.loadApplication(filename, style, passphrase)

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/application/service.py", line 411, in loadApplication

    passphrase)

  File "/home/buildbot/.local/lib/python3.5/site-packages/twisted/persisted/sob.py", line 223, in loadValueFromFile

    eval(codeObj, d, d)

  File "/home/buildbot/buildbot.tac", line 9, in <module>

    from buildbot_worker.bot import Worker

  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/bot.py", line 19, in <module>

    from buildbot_worker.null import LocalWorker

  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/null.py", line 21, in <module>

    from buildbot_worker.base import WorkerBase

  File "/home/buildbot/.local/lib/python3.5/site-packages/buildbot_worker/base.py", line 28, in <module>

    from twisted.spread import pb

builtins.ImportError: cannot import name 'pb'

Failed to load application: cannot import name 'pb'

Attachments

Issue Links

is part of

MDBF-41 Milestone 5: Desirable fixes

Closed

Activity

Ascending order - Click to sort in descending order

Vlad Bogolin created issue - 2022-01-27 15:15

Vlad Bogolin made changes - 2022-01-27 15:15

Field	Original Value	New Value
Link		This issue is part of ~~MDBF-41~~ [ ~~MDBF-41~~ ]

Faustin Lammler added a comment - 2022-01-28 11:41

Seems to be a ARM related problem only.
I will try to implement a multi-arch check directly in the CI (for the moment only AMD64 was tested).

Faustin Lammler added a comment - 2022-01-28 11:41 Seems to be a ARM related problem only. I will try to implement a multi-arch check directly in the CI (for the moment only AMD64 was tested).

Faustin Lammler added a comment - 2022-01-28 14:49

I have improved the CI, those error should now be catched directly in the CI:
https://github.com/MariaDB/mariadb.org-tools/pull/99

I'll close this once #99 is merged.

Faustin Lammler added a comment - 2022-01-28 14:49 I have improved the CI, those error should now be catched directly in the CI: https://github.com/MariaDB/mariadb.org-tools/pull/99 I'll close this once #99 is merged.

Faustin Lammler made changes - 2022-01-28 14:49

Comment

[ 2h ]

Permalink

Faustin Lammler logged work - 2022-01-28 14:50

Time Spent:

0.25d

https://github.com/MariaDB/mariadb.org-tools/pull/99

Faustin Lammler made changes - 2022-01-28 14:50

Worklog Id	93998 [ 93998 ]
Remaining Estimate		0d [ 0 ]
Time Spent		0.25d [ 7200 ]

Faustin Lammler added a comment - 2022-01-31 18:41

https://github.com/MariaDB/mariadb.org-tools/pull/99 is working as it now detects the problem directly in the CI.
vladbogo can you investigate how to install BB worker on debian9 ARM (this seems to be the only distrib where we have the pb).

Faustin Lammler added a comment - 2022-01-31 18:41 https://github.com/MariaDB/mariadb.org-tools/pull/99 is working as it now detects the problem directly in the CI. vladbogo can you investigate how to install BB worker on debian9 ARM (this seems to be the only distrib where we have the pb).

Ian Gilfillan made changes - 2022-02-01 08:26

Assignee

Faustin Lammler [ faust ]

Ian Gilfillan [ greenman ]

Ian Gilfillan made changes - 2022-02-01 08:26

Assignee

Ian Gilfillan [ greenman ]

Faustin Lammler [ faust ]

Sergei Golubchik made changes - 2022-02-01 08:34

Workflow	MFWA: Task Management Workflow [ 161926 ]	MariaDB v4 [ 162363 ]
Status	To Do [ 10003 ]	Open [ 1 ]

Faustin Lammler made changes - 2022-02-03 09:27

Assignee

Faustin Lammler [ faust ]

Vlad Bogolin [ vladbogo ]

Vlad Bogolin added a comment - 2022-02-07 19:38

Temporary revert to the older image to have the aarch64-debian-9 built for release.

Vlad Bogolin added a comment - 2022-02-07 19:38 Temporary revert to the older image to have the aarch64-debian-9 built for release.

Vlad Bogolin made changes - 2022-02-07 19:39

Component/s		None [ 18105 ]
Fix Version/s		N/A [ 27305 ]
Original Estimate		0d [ 0 ]

Vlad Bogolin made changes - 2022-02-07 19:39

Status

Open [ 1 ]

In Progress [ 3 ]

Vlad Bogolin added a comment - 2022-02-14 16:18

faust I was able to install twised[tls]==19.2.1 manually and I can confirm that this solved the Debian 9 issue. However, if I remember correctly, this version couldn't be installed in the CI. Do you remember any details? I cannot find at this point the run. An older version would work, but I think we should understand the issue first.

Vlad Bogolin added a comment - 2022-02-14 16:18 faust I was able to install twised [tls] ==19.2.1 manually and I can confirm that this solved the Debian 9 issue. However, if I remember correctly, this version couldn't be installed in the CI. Do you remember any details? I cannot find at this point the run. An older version would work, but I think we should understand the issue first.

Permalink

Faustin Lammler logged work - 2022-02-14 17:30

Time Spent:

1h

Debug pb on debian 9 ARM
https://github.com/MariaDB/mariadb.org-tools/pull/105
https://github.com/MariaDB/mariadb.org-tools/commit/9026c01b1276634c686afe5d514713b53da2ad95

Faustin Lammler made changes - 2022-02-14 17:31

Worklog Id	94709 [ 94709 ]
Time Spent	0.25d [ 7200 ]	3h [ 10800 ]

Faustin Lammler added a comment - 2022-02-14 17:33

It seems that we need to specifically install the incremental package before twised.
This should fix it: https://github.com/MariaDB/mariadb.org-tools/pull/105

Faustin Lammler added a comment - 2022-02-14 17:33 It seems that we need to specifically install the incremental package before twised. This should fix it: https://github.com/MariaDB/mariadb.org-tools/pull/105

Vlad Bogolin made changes - 2022-02-14 22:14

Worklog Id	94719 [ 94719 ]
issue.field.resolutiondate	2022-02-14 22:14:37.0	2022-02-14 22:14:37.303
Time Spent	3h [ 10800 ]	0.5d [ 14400 ]

Vlad Bogolin made changes - 2022-02-14 22:14

Resolution		Fixed [ 1 ]
Status	In Progress [ 3 ]	Closed [ 6 ]

Vicențiu Ciorbaru made changes - 2025-01-16 08:57

Component/s		Buildbot [ 18503 ]
Labels	buildbot

Julien Fritsch made changes - 2025-01-21 15:10

Workflow

MariaDB v4 [ 162363 ]

MariaDB Foundation v1 [ 188560 ]

Vicențiu Ciorbaru made changes - 2025-01-24 08:06

Component/s

None [ 18105 ]

People

Assignee:: Vlad Bogolin

Reporter:: Vlad Bogolin

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 2022-01-27 15:15

Updated:: 2025-01-24 08:06

Resolved:: 2022-02-14 22:14

Time Tracking

Estimated:

Remaining:

Logged:

0.5d

MariaDB Foundation Development

Details

Description

Attachments

Issue Links

Activity

People

Dates

Time Tracking