~alexmurray/qa-regression-testing:lpcraft-ci

Last commit made on 2023-02-22
Get this branch:
git clone -b lpcraft-ci https://git.launchpad.net/~alexmurray/qa-regression-testing
Only Alex Murray can upload to this branch. If you are Alex Murray please log in for upload directions.

Branch merges

Branch information

Name:
lpcraft-ci
Repository:
lp:~alexmurray/qa-regression-testing

Recent commits

d6407f2... by Alex Murray

.launchpad.yaml: Try testing sudo instead of glibc-security

glibc-security looks unmaintained so lets try using the sudo test script instead
to exercise a test for QRT scripts that have testlib.require_sudo() instead.

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[SUCCEEDED] sudo:0 (build)
[SUCCEEDED] sudo:1 (build)
[SUCCEEDED] sudo:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[SUCCEEDED] sudo:0 (build)
[SUCCEEDED] sudo:1 (build)
[SUCCEEDED] sudo:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[SUCCEEDED] sudo:0 (build)
[SUCCEEDED] sudo:1 (build)
[SUCCEEDED] sudo:2 (build)
130 of 30 results
3e1685c... by Alex Murray

scripts/test-gnupg.py: Specify to use hkp for the keyserver protocol

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[SUCCEEDED] gnupg:0 (build)
[SUCCEEDED] gnupg:1 (build)
[SUCCEEDED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
130 of 30 results
9fee4d2... by Alex Murray

scripts/test-gnupg.py: Specify port 80 for the ubuntu keyserver

Since this runs behind the launchpad proxy then with any luck if we specify port
80 it should be allowed through.

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
130 of 30 results
8c2fa92... by Alex Murray

Fix typo in reference to job name

Thanks cjwatson

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[FAILED] glibc-security:0 (build)
[FAILED] glibc-security:1 (build)
[FAILED] glibc-security:2 (build)
130 of 30 results
4fdac10... by Alex Murray

.launchpad.yaml: Seems parallel jobs are not supported (LP: #2007650)

So revert back to just using a regular pipeline as a list of jobs

Signed-off-by: Alex Murray <email address hidden>

cea273d... by Alex Murray

.launchpad.yaml: Specify tests as a list of jobs to get parallelism

Signed-off-by: Alex Murray <email address hidden>

b22b473... by Alex Murray

.launchpad.yaml: Don't run known broken tests in the pipeline

Since these result in the tests that come after failing also

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gnupg:0 (build)
[FAILED] gnupg:1 (build)
[FAILED] gnupg:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
121 of 21 results
1f11943... by Alex Murray

lpcraft-runner: Remove bits from earlier iteration of this script

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
130 of 30 results
e06a1ac... by Alex Murray

lpcraft-helper: Rename to lpcraft-runner

Signed-off-by: Alex Murray <email address hidden>

Failed
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
[SUCCEEDED] coverage:0 (build)
[FAILED] gcc-security:0 (build)
[FAILED] gcc-security:1 (build)
[FAILED] gcc-security:2 (build)
[WAITING] glibc-security:0 (build)
[WAITING] glibc-security:1 (build)
[WAITING] glibc-security:2 (build)
[WAITING] gnupg:0 (build)
[WAITING] gnupg:1 (build)
[WAITING] gnupg:2 (build)
130 of 30 results
c3a79fc... by Alex Murray

lpcraft-helper: Ensure we exit on failure so jobs fail as expected

Signed-off-by: Alex Murray <email address hidden>