Commit Graph

114 Commits

Author SHA1 Message Date
Ian Wienand
687919e2bd Add sibling container builds to experimental queue
These are required for the experimental container boot jobs

Change-Id: I16c27311adab09eafef747c1bba868115c000928
2020-04-27 08:52:31 +10:00
Zuul
8781c5d139 Merge "Add a focal test" 2020-04-24 16:20:23 +00:00
Zuul
ba518d2553 Merge "Restore SUSE tests to gate" 2020-04-24 16:20:21 +00:00
Zuul
b81e94e8f1 Merge "Switch functional tests to containers" 2020-04-24 16:14:01 +00:00
Zuul
8634b42e4d Merge "Bionic functional tests should be voting" 2020-04-24 09:41:26 +00:00
Ian Wienand
dfdf04bf2d Add a focal test
This adds a boot test for the newly released Ubuntu Focal release.

Depends-On: https://review.opendev.org/722556
Change-Id: If8976a3f99a02c8d85cd3818d8c77c75b60816d8
2020-04-24 08:01:39 +00:00
Zuul
534b799de8 Merge "pip-and-virtualenv : fix fedora 30 install" 2020-04-24 05:34:35 +00:00
Zuul
65fc9e1f7d Merge "Fix args to debuntu functional tests" 2020-04-24 05:31:06 +00:00
Ian Wienand
5fdc31ce8a Restore SUSE tests to gate
We can build SUSE in the container after the switch in
Ieaf07438c145ba609d4d7b9a055e91b894eca6d9.

Let's start non-voting and promote when we feel it's stable.

Change-Id: Ibe997d3167dc918fcdb28cf065c50049943dd86a
2020-04-24 15:10:24 +10:00
Ian Wienand
5d899d97a0 Switch functional tests to containers
This switches the functional tests to container based build jobs.
This is mostly transparent for the existing build and boot jobs.

The release test is a bit interesting here.  The nodepool
container-based release job doesn't work in this context because it
doesn't have a way to also include dib from the zuul checkout into the
container -- ergo it's pointless to run in the dib gate.

We should probably reorganise the nodepool siblings job so it can
check some projects out from tags, then we could run something similar
to this with nodepool/openstacksdk/glean etc checked out from tags if
we want.

We can handle this in a future update so we can test these images
which we want to build in our production container asap.

Depends-On: https://review.opendev.org/722556
Depends-On: https://review.opendev.org/722549
Change-Id: Ieaf07438c145ba609d4d7b9a055e91b894eca6d9
2020-04-24 14:44:51 +10:00
Ian Wienand
90a21b84b5 Bionic functional tests should be voting
We now have a bionic(-ish ... buster debian image anyway) builder and
have moved some of the important tests (fedora, pip-and-virtualenv) to
here because they don't work on Xenial any more.  This should now be
voting so we don't miss anything.

Change-Id: I16d313e1dfa95707d996456da244667c38d6343f
2020-04-24 12:43:28 +10:00
Ian Wienand
a8a5b1ac77 pip-and-virtualenv : fix fedora 30 install
This should be installing the python2 and python3 packages (that's
what pip-and-virtualenv is designed to do), but we dropped the +=
accidentally in ee9ad32b6f.

However, we've moved on anyway and after
I7a6a342461d6001c25e55638ba9b7438c28f2519 F31 doesn't support this
element.  fedora-latest is already updated to f31 in the opendev gate.
Remove the testing as it is no longer relevant.

Change-Id: Id696a90baa1eb05cb4c08501f8dac3665d395682
2020-04-24 12:42:35 +10:00
Ian Wienand
99d5a8d219 Fix args to debuntu functional tests
Ia4dde1fb01da284a5e681237ab88c68fb9afcbef dropped these from the
generic job in nodepool, because they shouldn't apply to other distros
using the job like CentOS etc.  Add the required args back here to the
debuntu tests.

Change-Id: I3f9ae58f3aa534d65344d79d44b0b74368e329a8
2020-04-24 12:34:59 +10:00
Zuul
eebb68b385 Merge "pip-and-virtualenv: drop f31 & tumbleweed, rework suse 15 install" 2020-04-23 23:52:10 +00:00
Ian Wienand
262281e5f7 Remove Trusty testing
Opendev has dropped trusty from the mirrors.  With no testing the
distribution is effectively unsupported, add a release note.  Update a
few other random doc bits (that are not really that up to date
anyway).

Change-Id: I5bd0d0a94477cf8d84cef72f5d4b2e9e15ab9fd2
2020-04-23 10:00:13 +10:00
Ian Wienand
ac7fba7040 pip-and-virtualenv: drop f31 & tumbleweed, rework suse 15 install
This is an alternative approach to commit
68bb43535e.  I think this proposes a
better overall solution that the prior change which had the Python 3
packages being installed, but did not specify the _do_py3 flag to do
the installation steps that redirect the various tool installations.

Fedora 31+ doesn't have python2, and Tumbleweed does have some Python
2 support but there seems to be no reason to bother updating this
element for either with infra very close to removing this completely
[1].  Error out on these platforms, and add a release note.

The 15 path should include the python2 and python3 packages, along
with the flags to do the "cleanup"; i.e. forced removal of distutils
packages that pip 10+ won't touch.  As mentioned in the original
change, the six package causes problems here, but we can clear that
too by explicitly listing it instead of letting it come in via
dependencies.  Again, this element will be removed from the infra 15
builds ASAP; but we can release with this to provide a roll-back point
if we need to revert the removal to fix things temporarily.

Add it to the testing path as well.

[1] https://docs.opendev.org/opendev/infra-specs/latest/specs/cleanup-test-node-python.html

Change-Id: I7a6a342461d6001c25e55638ba9b7438c28f2519
2020-04-23 08:10:26 +10:00
Zuul
b262e88443 Merge "Make ipa centos8 dib job voting" 2020-04-22 01:44:27 +00:00
Ian Wienand
3f823488c5 Add centos aarch64 tests
Change-Id: I2fffeeffa82c505a34c5c9972724b557f3b58975
2020-04-16 14:15:50 +10:00
Riccardo Pittau
716286117c Make ipa centos8 dib job voting
The ironic-python-agent-builder dib job based on centos8 is stable
since a while now.
We should make it voting to catch any possible issue on dib side.

Change-Id: I42dd81fa17de1130a3af7c031f9479e18790c350
2020-04-06 11:55:54 +02:00
Lee Yarwood
ee9ad32b6f Add Fedora 31 support and test jobs
Change-Id: Iad0261ac8db001ffa4d3a4dd6df05fe923402a69
2020-03-30 08:47:00 +11:00
Andreas Jaeger
9a6e111b8c Remove Fedora 29 job
Fedora 29 is EOL, remove the job.

Depends-On: https://review.opendev.org/#/c/711970
Change-Id: Ic3ad24a0268ac8421218b944d15f130a13ee9cdc
2020-03-09 20:20:28 +01:00
Carlos Goncalves
8226384cf0 Add CentOS 8 support
* Add "centos" element, a CentOS version-independent element. This is in
  line with the same work done for RHEL in Stein cycle.
* Deprecate the centos7 element. CentOS 7 support itself it not
  deprecated though. The new "centos" element provides the same support
  level as the "centos7" element.
* Add functional testing

The default CentOS version is 8. You can adjust it using the DIB_RELEASE
environment variable.

Change-Id: I373ba2296c4613765676e59aabd9c651345298d1
2020-02-19 10:44:56 +01:00
Dmitry Tantsur
3b27ae1578 Add ironic jobs to the CI
Ironic is now using diskimage-builder for producing and publishing
official production-ready IPA ramdisks. These jobs test ironic
against changes in diskimage-builder to ensure they still work:
* Two check-image jobs merely build an IPA image with DIB:
  * The CentOS 8 job is our primary now and should eventually
    become voting.
  * The CentOS 7 one is used on stable/train and will be removed
    once DIB stops supporting this version.
* The two other jobs build and use the IPA image to deploy a node
  in two different ways (pushed via iSCSI and pulled via HTTP).
  Since they're likely to be affected by factors outside of DIB
  control, they're added non-voting.

Depends-On: https://review.opendev.org/703585
Change-Id: Ibce594657bb90db1bac63fa9f965ee88586f8246
2020-01-21 12:48:32 +01:00
Andreas Jaeger
71ef0a8b3c Remove trusty jobs
OpenDev is removing trusty from the infrastructure, remove the jobs
using ubuntu-trusty.

Depends-On: https://review.opendev.org/702817
Change-Id: I0d328f4d1125be7e3801a9dd2c9374086024b903
2020-01-17 09:23:05 +01:00
Zuul
f6d32a684f Merge "Add arm64 based functional test" 2019-12-16 21:31:51 +00:00
Ian Wienand
082397a86a Add arm64 based functional test
An initial functional test for bionic/arm64 builds, put it in the new
arm64 check queue.

Change-Id: I5f8a047f41c6555da7211b758c55f7a87b3aa5d1
2019-12-16 10:51:01 +11:00
Ian Wienand
801fa77a16 Work around Trusty ext4 metadata_csum errors on Bionic
As described inline, Bionic hosts will build invalid Trusty images.
Hack around this by disabling metadata_csum in the ext4 mkfs.

Change-Id: Ibd67d58ca830a9e60605d0700ee2b17906c804e6
2019-12-11 16:02:13 +11:00
Ian Wienand
4ca306cc0e Drop Xenial from functional test
Devstack dropped Xenial support with
Iefcca99904dde76b34efbbfc0e04515dfa5a09e5.

I have ported the required debootstrap in the openstackci PPA to
Bionic, so these builds should work there now.

Unfortunatley, there's no current solution for Suse builds as there is
no zypper for the minimal builds on bionic.  These will either have to
fix that, or figure out how to pin devstack to Train branch for the
jobs.  Since it causes retries in the gate as non-voting, put it in
experimental for now until we figure something out.

Trusty also fails due to issues with ext4 versions using bionic hosts.
This is fixed in a follow-on
Ibd67d58ca830a9e60605d0700ee2b17906c804e6; the job is disabled for now.

Change-Id: I71823236731583e28fddcceb71f44d09b58664a4
2019-12-11 16:01:52 +11:00
Andreas Jaeger
76389d0afe Remove unused job
The job dib-nodepool-functional-openstack-opensuse-150-src has been
replaced by  dib-nodepool-functional-openstack-opensuse-15-src, remove
the now obsolete job.

openSUSE 15.0 is EOL in infra.

Change-Id: I54d9a0f43240c4e76b645e632ba24a793ba79aee
2019-11-13 08:00:30 +01:00
Ian Wienand
371669c981 Revert "Pause Fedora jobs"
This reverts commit dad99e54f6 and
c26cb9c2cfe20ba60ba7e6dbcd428bc14c990034; fixed by [1]

[1] https://bodhi.fedoraproject.org/updates/FEDORA-2019-2368fc415f

Change-Id: I397637c1de4414397305158d6a4f51c63c76141a
2019-10-29 10:02:18 +11:00
nishagbkar
9e149ce8bb Deprecates the existing "ironic-agent" element in DIB
The "ironic-agent" is copied to ironic-python-agent-builder and
hence it is deprecated from DIB.

Remove from functional testing

Change-Id: Ibc4f75b9d7e2a31994fc86d05bd57975f00fb74f
Task: 36198
Story: 2005114
2019-10-29 10:00:47 +11:00
Zuul
d6e6538ade Merge "Update gentoo test to current system profile" 2019-10-22 03:19:16 +00:00
Ian Wienand
dad99e54f6 Pause Fedora jobs
Per the linked bugs, this does not seem to have a quick resolution.
The bug mentions that the copr nightly repos have other known issues,
so there just does not seem to be a good solution until fixed packages
are imported upstream.  For now, pause Fedora jobs to get the gate
working.

Change-Id: Ib349592c3fcf2008fcab9ae8875de1c997eef7d5
2019-10-22 09:54:00 +11:00
Ian Wienand
c26cb9c2cf Temporarily disable Fedora 30 build jobs
We are debugging a upstream dnf segfault that is consistently making
this job fail.  Make it non-voting for now while this is sorted out.

Change-Id: I538e9d1b380e78549229b71e47a776ab97dd1b9c
2019-10-14 11:43:04 +11:00
Ian Wienand
5b5385cf84 CentOS 8 minimal testing and support
This adds CentOS 8 into functional and boot tests.

This completes centos-minimal support, documentation is updated and a
release note is added.

Change-Id: I435c2967b4f49faeb6d6edf189907b9f96e80357
2019-10-08 00:17:14 +02:00
Ian Wienand
cbe1a0fc6b simple-init: default to NetworkManager for CentOS and Fedora
NetworkManager with simple-init has proven to be stable in OpenStack
infra, switch to it by default for CentOS and Fedora.  For CentOS 8
and Fedora, add a check to make it the only option.  Thus only CenOS 7
remains optionally using the legacy scripts; this is likely not used
anywhere (infra is really the primary user, where NetworkManager is
already used); we can likely remove this variable (and hence path) in
a future cleanup.

In the setup, remove rhel7 element which was never really tested.
Reorganise the fallthrough to call out the default paths as doing
nothing.

Change-Id: Ic996956da4b85f7d95179b8df9881d5f52c091af
2019-10-07 10:46:57 +00:00
Jens Harbott
fb8258912b Update gentoo test to current system profile
Gentoo is at 17.1 now, most code was updated in [0], update the test job
accordingly.

[0] I0f2e7976845b1d3c55ffe8869eec0bc04a191252

Change-Id: I30e018e67f3637ce36b3ef6e20380453fe6b2bb9
2019-09-17 12:43:28 +00:00
Ian Wienand
68f0ace08a Add fedora-30 testing to gate
Forgotten in If60eb0b87e45efc0e71db2ddcd814223539f07b7

Change-Id: Ia2887c84510f09e37d0cbc27d13f770655bc95fc
2019-09-06 17:31:46 +10:00
Dirk Mueller
d40c87876a Rename openSUSE 15.1 testing to 15
This is consistent with the previous simplication of
build targets in the opendev environment to refer to
"opensuse15" being the alias of "latest stable openSUSE Leap 15.x".

Change-Id: I904a3ca0d6dbddd2bb1a673836ab6a0ad249526d
2019-08-30 22:44:40 +02:00
Ian Wienand
a5a6482ac1 Fedora 30 functional and boot tests
Update testing for Fedora 30

Change-Id: If60eb0b87e45efc0e71db2ddcd814223539f07b7
2019-08-28 11:21:46 +10:00
Ian Wienand
75faaf9306 Enable nodepool debugging for functional tests
This is helpful because if the inner host fails to boot, nodepool will
dump its console at debug level

Change-Id: I8d97e4378dda176521361ca03deac8337a059515
Depends-On: https://review.opendev.org/#/c/669939
2019-07-25 09:42:14 +10:00
James E. Blair
fa50926d93 Add a nodepool job based on releases
To avoid breaking systems that depend on released versions of
dib/glean (eg, nodepool), add one non-src nodepool job.

Change-Id: Ia8db42754429c79a80f6e8be545be2e48f019994
2019-07-15 08:04:45 -07:00
Dirk Mueller
97444ad92e Enable nodepool testing for opensuse 15.1
There are several jobs depending on working opensuse 15.1
images in nodepool, so it makes sense to ensure its working.
Also upgrade the previously marked experimental opensuse-15.0
job as it tests the xenial->opensuse combination, which is
particularly difficult to keep working and we'll need it in
the CI.

Change-Id: Icb6d998756ce5221e017959dcb59b21f0f023454
2019-06-27 19:59:45 +02:00
James E. Blair
d32329f596 Replace nodepool func jobs
These are new nodepool functional jobs designed to give more
flexibility to the DIB/clean projects to define what they need
to test.  Otherwise, they behave very similarly to the current
nodepool functional jobs

Depends-On: https://review.opendev.org/665023
Change-Id: Id73e913300cf3f0aaea05f7c2e8fdcb753421d04
2019-06-27 08:59:52 -07:00
James E. Blair
3df4e8b9ca Move existing Zuul project config to projects.yaml
There was a project stanza in zuul.d/jobs.yaml which was unexpected.
Move it to projects.yaml and combine it with the one just added.

Change-Id: Ie3b2e31833423ae8658861e8cc85300d45882f8e
2019-06-24 13:47:48 -07:00
James E. Blair
4a46ea7764 Move Zuul config in-repo
This moves the Zuul project configuration into this repo rather
than project-config for easier modification of check/gate jobs.

Change-Id: I235a0584d2b0156406b2d07848d484a9148d064e
2019-06-24 13:47:48 -07:00
Dirk Mueller
a81cf9e231 Update test coverage for openSUSE/-minimal to 15.1
Use openSUSE 15.1 as default, which is the latest released stable
openSUSE release.

Remove leftovers for unmaintained openSUSE 42.2 images.

Depends-On: https://review.opendev.org/#/c/660126/
Change-Id: I0b204b7b3d7ae74b6749320b3bfe1ca89d154ebb
2019-06-13 09:20:40 +02:00
Dirk Mueller
c7ac6ee0cb Update test coverage for openSUSE/-minimal to 15.0
Use openSUSE 15.0 as default, which is the latest released stable
openSUSE release. Switch to https for accessing download.o.org
as encrypted transfers should be used by default.

Remove leftovers for definitely unmaintained openSUSE 13.x images
and split into old/new leap style versioning scheme for clarity.

Change-Id: Iab129eeee2b1a2563f0f0d2cb17bbad57c068e38
2019-05-08 14:59:51 +00:00
Andreas Jaeger
1cfe812a75 Use template for lower-constraints
Use openstack-lower-constraints-jobs template, remove individual
jobs.

Change-Id: I145b3349feba9386f5cb7271a7ecd0151aa38b70
Needed-By: https://review.openstack.org/623229
2018-12-20 21:56:05 +01:00
Ian Wienand
b203e2ad19 Revert "Make tripleo-buildimage-overcloud-full-centos-7 non-voting"
This reverts commit db2d26a75f331e99f6e39d9e6775fc5f48c0cc90.

The bad upstream RPM has been removed, and the job no longer fails.
The jobs are part of the template, so don't need to be explicitly
listed as they were previously, however.

Related-Change: https://review.openstack.org/619625
Change-Id: I138b7f6bdef1d955a6e0babf228543ab2530159a
2018-11-30 10:02:22 +11:00
Ian Wienand
ca96f06d63 Make tripleo-buildimage-overcloud-full-centos-7 non-voting
This has been broken for a few days due to upstream issues.  Will
restore when working

Change-Id: I2c1d0a7b64f9bb263358970127adbfa36f7c1a46
Related-Change: https://review.openstack.org/619625
Related-Bug: #1804475
2018-11-27 13:15:56 +11:00
Ian Wienand
f0a8476509 Add systemd-containers functional tests
Add functional tests for the Ubuntu systemd-container elements
introduced with I45651de2aa1b19bdeee301094f0bdffdd0a3b45c

These test the Xenial and Bionic guest images build on Xenial and
Bionic hosts.  I'm not sure it's worth the gate resources to also do
this on CentOS/Trusty at this point, so they're left out.

Change-Id: Ie9da9e22f5421999ac96750624f7d53bb0aa6160
2018-10-31 14:28:56 +11:00
Ian Wienand
d2654c7d60 Remove python3 legacy jobs
These were replaced Ied67a31f0d31503d13eccad8662c29740c93f33e but
missed being cleaned up.  The jobs are unused.

Change-Id: Ie5fb396c1d753e8b3e0e5822aa0e98659374fc6a
2018-10-30 11:17:18 +11:00
Ian Wienand
36d642a6a0 Native zuulv3 tests
This finalises the ports of the legacy jobs to zuul native jobs.

The dib-setup-gate-mirrors role preconfigures the repo templates,
etc. for the openstack-ci-mirrors element.

The dib-functests role runs the tests as specified by dib_functests,
and can run under python2 or 3.

Change-Id: Ied67a31f0d31503d13eccad8662c29740c93f33e
2018-10-29 12:46:15 +11:00
Paul Belanger
753ad7d0eb Remove unsued opensuse jobs
These jobs are not used any place, remove them from zuul configuration.
We can always add them back.

Change-Id: Ia503d6e302b5f5fd1a477d761d9e497056aec614
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-14 13:30:50 -04:00
Paul Belanger
c2c408a989 Remove legacy-opensuse-423 nodeset
Stop using legacy-opensuse-423 so we can remove it from
openstack-zuul-jobs.

Change-Id: I3f89f2dd633ab59200b89645b0d2930fe66e776d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-14 13:29:35 -04:00
Doug Hellmann
28287942bb add lower-constraints job
Create a tox environment for running the unit tests against the lower
bounds of the dependencies.

Create a lower-constraints.txt to be used to enforce the lower bounds
in those tests.

Add openstack-tox-lower-constraints job to the zuul configuration.

See http://lists.openstack.org/pipermail/openstack-dev/2018-March/128352.html
for more details.

Change-Id: I911c66b2e9971a3e134c482a4b4ffa529d358a76
Depends-On: https://review.openstack.org/555034
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-04-06 01:23:10 -04:00
Rafael Folco
52fe5ebe32 Revert "Remove tripleo jobs"
This reverts commit ca8a89b1fb.

tripleo job is back to business again per latest runs
(see changes #553658 and #553701):
tripleo-buildimage-overcloud-full-centos-7    SUCCESS in 27m 39s

Change-Id: I111ed21f537b747877a34931a4085671cb9bc338
2018-03-23 14:38:21 +00:00
Ian Wienand
ca8a89b1fb Remove tripleo jobs
Due to the issue in I72cab0131ccffb1989d6c1324d0c9b92166782da the
tripleo job is failing.  Unfortunately due to known issues there, the
tripleo gate is also blocked.  Remove this job for now so we can get
dib moving.

Change-Id: I07173cc11a98a946e3ee1418288136aa1f791f85
2018-03-22 07:18:06 +11:00
James E. Blair
9025c8ae00 Zuul: Remove project name
Zuul no longer requires the project-name for in-repo configuration.
Omitting it makes forking or renaming projects easier.

Change-Id: Ida494299f8c159a73542982a9064c9092969b9d1
2018-02-01 04:37:33 -08:00
Sagi Shnaidman
7465bf5eac Remove RH1 check OVB jobs from configuration
Remove OVB check RH1 jobs from configuration for this repo
Related-Bug: #1744763

Change-Id: I4d3989e6177fbb3130f9cecbb3f0d913a215c56a
2018-01-22 19:28:13 +02:00
Emilien Macchi
cc11be49b8 zuul: add tripleo jobs
Import the new jobs from tripleo-ci, with parity from what we had before
with legacy jobs:
- buildimage jobs
- ovb-ha

Change-Id: If93f9f3b6df1dec4c6edef43f6c5f126eeac8a32
2017-11-18 12:02:31 -08:00
James E. Blair
5008358d52 Zuul: add file extension to playbook path
Zuul now supports including the file extension on the playbook path
and omitting the extension is now deprecrated.  Update references
to include the extension.

Change-Id: I358a4ee4d7faed68e449592480cb5d8fafa70cd1
2017-10-29 12:43:09 -07:00
Ian Wienand
cc61e6ac12 Import legacy playbooks
Import legacy playbooks for zuulv3 transition

Change-Id: I30763af7a4062d3c254a21eda532e3a4e90192da
2017-10-17 10:41:30 +11:00