Commit Graph

233 Commits

Author SHA1 Message Date
Zuul f87a63a46e Merge "Add check job for FIPS" 2022-01-25 01:34:55 +00:00
Zuul ae779740c5 Merge "nova-next: Deploy noVNC from source instead of packages" 2022-01-22 02:18:09 +00:00
Ade Lee 82c91e8cd8 Add check job for FIPS
The job makes sure that integration tests pass when the nodes are
set to be in fips mode.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/822560
Change-Id: Iae13b0ffcded76ef1712fdbad3fbff3dc774336c
2022-01-18 18:46:52 +00:00
Ghanshyam Mann b88ca72c71 Update centos 8 py36 functional job nodeset to centos stream 8
centOS 8 image and nodeset is planned to be remove as centOS is
EOLing soon.
- http://lists.openstack.org/pipermail/openstack-discuss/2022-January/026621.html

Devstack is also removing devstack-single-node-centos-8 nodeset
which is used in nova py36 functional job
- https://review.opendev.org/q/I36751569d92fbc5084b8308d423a75318ae7d406

This commit updates the nodeset in nove jobs to
devstack-single-node-centos-8-stream which will run functional
test on py36 env.

Change-Id: I50ced59e3aa86e629702f0fece2c4cb990ebb1ed
2022-01-13 12:06:17 -06:00
Zuul 8c714c76ae Merge "Enable min pps tempest testing in nova-next" 2022-01-12 10:38:44 +00:00
Ghanshyam Mann cb1a52a828 Re-add python 3.6 functional testing
We have updated the yoga testing runtime to keep the
py36 testing.

- https://review.opendev.org/c/openstack/governance/+/820195

Unit tests job template is also updated to keep python
3.6 as a voting job.

- https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/820286

This commit re-add the python 3.6 functional tests also which we
removed in https://review.opendev.org/c/openstack/nova/+/819194
also, re-adding py3.6/3.7 versions in setup.cfg classifier.

Change-Id: I7c83f1d64f31741dc51cc736265cf50fd0dad7af
2021-12-13 19:26:19 -06:00
Lee Yarwood 40c0f7fdd9 nova-next: Deploy noVNC from source instead of packages
To help improve early detection of issues with newer noVNC releases the
nova-next job now deploys directly from source.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/816736

Change-Id: Ic14d2b13cbf0369fc752d457d73d65488e6df3f9
2021-12-03 12:09:03 +00:00
Zuul 7670303aab Merge "Remove broken tempest-full-py3-opensuse15 job" 2021-12-01 19:48:17 +00:00
Ghanshyam Mann 9dd0070ce6 Updating tests with Yoga testing runtime
Yoga testing runtime is updated now
- https://governance.openstack.org/tc/reference/runtimes/yoga.html

which needs to test py38 and py39. Unit tests update are
handled by the job template change in openstack-zuul-job and
this commit makes changes to fucntional job to run py39 as voting
and updating the metdata in setup file.

Change-Id: I314fd61f20f2c3551f6231d191b7dcaaefabd2b5
2021-11-25 17:38:32 +00:00
Zuul 69b0d31d20 Merge "Add a WA flag waiting for vif-plugged event during reboot" 2021-11-18 20:06:43 +00:00
Balazs Gibizer ed3abea3b2 Apply common irrelevant_files for centos 8 job
Apply the common nova irrelevant files filter for the new
tempest-integrated-compute-centos-8-stream job

Change-Id: I0bacb8884a75b5ae604383d73d60fc618123a8d3
2021-11-09 17:46:12 +01:00
Balazs Gibizer 68c970ea99 Add a WA flag waiting for vif-plugged event during reboot
The libvirt driver power on and hard reboot destroys the domain first
and unplugs the vifs then recreate the domain and replug the vifs.
However nova does not wait for the network-vif-plugged event before
unpause the domain. This can cause that the domain starts running and
requesting IP via DHCP before the networking backend finished plugging
the vifs.

So this patch adds a workaround config option to nova to wait for
network-vif-plugged events during hard reboot the same way as nova waits
for this event during new instance spawn.

This logic cannot be enabled unconditionally as not all neutron
networking backend sending plug time events to wait for. Also the logic
needs to be vnic_type dependent as ml2/ovs and the in tree sriov backend
often deployed together on the same compute. While ml2/ovs sends plug
time event the sriov backend does not send it reliably. So the
configuration is not just a boolean flag but a list of vnic_types
instead. This way the waiting for the plug time event for a vif that is
handled by ml2/ovs is possible while the instance has other vifs handled
by the sriov backend where no event can be expected.

Change-Id: Ie904d1513b5cf76d6d5f6877545e8eb378dd5499
Closes-Bug: #1946729
2021-11-04 16:09:12 +01:00
Balazs Gibizer 5d2f2da0af Enable min pps tempest testing in nova-next
Note that the existing qos min bw tests was running in nova next before
but the test file was renamed in
https://review.opendev.org/c/openstack/tempest/+/806255 in a way that
now need the modification of the tempest exclude patter in the job to
still run those tests and the new ones.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/806257
Depends-On: https://review.opendev.org/c/openstack/neutron/+/805391
Change-Id: Iaa0bdd12c07fd51b3cab4c80371f2c868126ccc8
2021-11-04 08:11:01 +00:00
Ghanshyam Mann f08d9aaa04 Remove broken tempest-full-py3-opensuse15 job
tempest-full-py3-opensuse15 is failing all the time[1] and
opensuse is not tested/supported distro in testing runtime
or devstack anymore. So let's remove opensuse broken job from
tempest too.

Needed-By: https://review.opendev.org/c/openstack/tempest/+/816569

[1] https://zuul.opendev.org/t/openstack/builds?job_name=tempest-full-py3-opensuse15

Change-Id: I7b0363dc9bd759a3432c838e717c3f090afb887d
2021-11-03 15:55:47 -05:00
Federico Ressi 171138146a Check Nova project changes with Tobiko scenario test cases
Change-Id: I30fd6563292520865545a10ae9af32c765b314da
2021-10-28 07:58:12 +00:00
Lee Yarwood cf4e516f55 zuul: Move live migration jobs back to voting
With the resolution of bug #1945983 within devstack we can now move our
live migration jobs back to voting.

Related-Bug: #1945983
Closes-Bug: #1912310
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812391
Depends-On: https://review.opendev.org/c/openstack/devstack/+/812925
Change-Id: I25177554802579952510c73985287fd76681012c
2021-10-07 11:21:51 +01:00
OpenStack Release Bot 11f95eebea Add Python3 yoga unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for yoga.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I541fc92f69142d0d5186fba07370667cf42f3de7
2021-09-17 14:44:22 +00:00
Lee Yarwood 4e18f07670 zuul: Mark live migration jobs as non-voting due to bug #1912310
Bug #1912310 details an underlying QEMU live migration failure seen
during both volume backend and block migration based live migration
tests in the nova-live-migration job. The failure rate is getting high
enough now that we should mark these jobs as non-voting until it is
resolved.

Change-Id: Ifc211fadb3ca9c7c0a74d7dcd225bdb3f3008d26
Related-Bug: #1912310
2021-08-05 13:01:47 +01:00
Lee Yarwood dbf3e276ba zuul: Increase GLANCE_LIMIT_IMAGE_SIZE_TOTAL for nova-lvm
As seen before in bug #1913451 the nova-lvm job creates large RAW
snapshots during each run due to the nature of using LVM storage for the
ephemeral instance disks.

Id425aa546f1a5973bae8be9c017782d18f0b4a47 recently landed capping the
per teneant image size total to 1000 MiB that is far too low for this
job given the RAW snapshots it's creating. This in turn resulted in
504 failures when n-cpu attempted to upload snapshots to g-api.

This change simply increases the per tenant limit to 10 GiB that should
be more than enough for all of the tests covered by the nova-lvm job.

Closes-Bug: #1938765
Change-Id: I824655387a10ac9b813c1b7b2399e25ed95f7fc3
2021-08-03 10:06:25 +01:00
Zuul 3daf6d5fe5 Merge "Make explicit the network backend used in the CI jobs" 2021-06-30 19:44:54 +00:00
Rodolfo Alonso Hernandez 17cca270a6 Make explicit the network backend used in the CI jobs
All Neutron CI jobs (except for unit, functional and fullstack jobs),
have explicitly defined the network backend used:
- linuxbridge
- ovs
- ovn

That was discussed and approved during the Neutron CI meetings [1].

[1]https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-06-15-15.00.log.html

Depends-On: https://review.opendev.org/c/openstack/neutron/+/797051
Change-Id: I23889eb8ebc5911f6ac6c283bcd7316271a77715
2021-06-23 13:05:35 +00:00
Lee Yarwood b5b2e99824 zuul: Add nova-tox-functional-centos8-py36 job
The nova-tox-functional-py36 job was replaced with the current py38
version during Victoria by I1d6a2986fcb0435cfabdd104d202b65329909d2b.

However as clearly stated in both the Victoria and Xena runtime
reference documents python 3.6 remains supported through CentOS 8 and
later CentOS 8 stream.

This change reintroduces functional test coverage for py36 using a
CentOS 8 stream based job.

[1] https://governance.openstack.org/tc/reference/runtimes/victoria.html
[2] https://governance.openstack.org/tc/reference/runtimes/xena.html

Change-Id: I6ef77bd92f2595016a99d1953414d3f554f6b2eb
2021-06-18 12:34:44 +01:00
Stephen Finucane 98b01c9a59 Move 'check-cherry-picks' test to gate, n-v check
This currently runs in the 'check' pipeline, as part of the pep8 job,
which causes otherwise perfectly valid backports to report as failing
CI. There's no reason a stable core shouldn't be encouraged to review
these patches: we simply want to prevent them *merging* before their
parent(s). Resolve this conflict by moving the check to separate voting
job in the 'gate' pipeline as well as a non-voting job in the 'check'
pipeline to catch more obvious issues.

Change-Id: Id3e4452883f6a3cf44ff58b39ded82e882e28c23
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
2021-06-16 15:51:38 +01:00
Lee Yarwood 7c478ac099 zuul: Skip block migration with attached volumes tests due to bug #1931702
Bug #1931702 details soft lockups reported within the guest OS during
live migration with block migration and a volume attached. These lockups
then causing the request to detach the volume as part of the cleanup to
fail. For the time being we should skip these tests until the underlying
issue is resolved.

Related-Bug: #1931702
Change-Id: I7c1a647fb840fce98672a8429d554dd399cd13b7
2021-06-11 13:31:48 +01:00
Lee Yarwood d5ed968826 zuul: Skip swap_volume tests as part of nova-next
The volume update or swap_volume API has long been a source of gate
failures within Nova. Most recently we've seen increased instability
when running the temptest.api.compute.admin.test_volume_swap tests as
part of the nova-next job as documented in bug #1929710.

This change temporarily removes the failing test from the nova-next job
while the underlying issue is identified lower in the virt stack.

Change-Id: Ib56a034fb08e309981d0b4553b8cee8d16b10152
Related-Bug: #1929710
2021-05-26 19:35:29 +01:00
Lee Yarwood dab4ec1a53 zuul: Remove nova-dsvm-multinode-base
This is no longer used with the removal of the legacy
nova-grenade-multinode job in I02b2b851a74f24816d2f782a66d94de81ee527b0.

dsvm-irrelevant-files is also renamed to nova-base-irrelevant-files and
now defined within the nova-live-migration job.

Change-Id: I67faa85618e2de1400d868299426b0ba8274c90e
2021-04-29 11:05:58 +01:00
Lee Yarwood 91e53e4c2b zuul: Replace grenade and nova-grenade-multinode with grenade-multinode
If2608406776e0d5a06b726e65b55881e70562d18 dropped the single node
grenade job from the integrated-gate-compute template as it duplicates
the existing grenade-multinode job. However it doesn't remove the
remianing single node grenade job still present in the Nova project.

This change replaces the dsvm based nova-grenade-multinode job with the
zuulv3 native grenade-multinode based job.

Various legacy playbooks and hook scripts are also removed as they are
no longer used. Note that this does result in a loss of coverage for
ceph that should be replaced as soon as a zuulv3 native ceph based
multinode job is available.

Change-Id: I02b2b851a74f24816d2f782a66d94de81ee527b0
2021-04-29 11:05:58 +01:00
Zuul 3c52685125 Merge "Switch to new rolevar for run-tempest role" 2021-04-24 09:37:23 +00:00
Lucas Alvares Gomes a3c44c6243 [OVN] Explicitly set nova-next job to ML2/OVS
This patch explicitly enable ML2/OVS for the nova-next job.

Devstack is changing the Neutron default to OVN backend. Currently, the
nova-next job requires QoS minimum bandwidth support in its
post_test_hook.sh script [0] which is currently not supported in OVN [1]
(feature needs to come to core OVN first).

[0]
https://github.com/openstack/nova/blob/ede0147abd54fdd043e7aabd33c01f88e4a01e51/gate/post_test_hook.sh#L131-L136
[1] https://docs.openstack.org/neutron/latest/ovn/gaps.html

Change-Id: I91b8056e73658fc815eb2f6711e89d4ab5deed92
Signed-off-by: Lucas Alvares Gomes <lucasagomes@gmail.com>
2021-04-12 09:40:19 +01:00
Zuul 08ef1a4985 Merge "nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default" 2021-04-11 10:23:16 +00:00
Ghanshyam Mann 9d285e0bb4 Switch to new rolevar for run-tempest role
Tempest replaced the below rolevar for run-tempest role
- tempest_test_blacklist is replaced by tempest_test_exclude_list
- tempest_black_regex is replaced by tempest_exclude_regex

old name are still supported for compatiblity but we recommend
to switch to new one.

Change-Id: I4f2d01a4cf443f9c539158e77032cd3d8ce24ad7
2021-04-09 16:06:10 +00:00
Zuul 7a1222a865 Merge "Add Python3 xena unit tests" 2021-03-29 21:06:15 +00:00
OpenStack Release Bot b8ca4d3139 Add Python3 xena unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for xena.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/783310

Change-Id: I7ba67f4763730affa259189d10230d90d294b100
2021-03-26 14:22:52 +00:00
Lee Yarwood efd2816619 zuul: Add nova-live-migration-ceph job
Since Ib342e2d3c395830b4667a60de7e492d3b9de2f0a the nova gate has lacked
any libvirt live migration test coverage for ceph. This change
reintroduces this via a new zuulv3 native multinode live migration job
for ceph that includes additional instance evacuation coverage.

Depends-On: https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/711625
Change-Id: I6d0dbdcc84fe070e84d19d0c3d4306e6e0326e46
2021-03-19 15:59:55 +00:00
Lee Yarwood 8f317f442c nova-next: Start testing the q35 machine type
With the introduction of the libvirt-default-machine-type blueprint
operators are now able to change the default machine type used by an
existing environment more easily. This should hopefully allow more
deployments to switch to the modern q35 machine type, away from the
legacy pc machine type that is currently the default.

With this in mind this change aims to start testing the q35 machine type
as part of the nova-next job before we eventually change the default in
the future.

The following changes are made to the job to allow it to pass with q35:

- [libvirt]num_pcie_ports is increased to 24

This is required as more devices are now connected by default over PCIe.

- [compute-feature-enabled]ide_bus is disabled

The q35 machine type does not support an IDE bus so any tests using this
bus are now skipped.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/779179
Depends-On: https://review.opendev.org/c/openstack/tempest/+/775630
blueprint: libvirt-default-machine-type
Change-Id: Iad1adbc23b31dd54a96299e7a8a4b622c15eed8d
2021-03-08 08:58:57 +00:00
Zuul bf6a53f8b4 Merge "Run nova-live-migration job with neutron-trunk enabled" 2021-02-17 15:22:01 +00:00
elajkat 21656d4e9c Run nova-live-migration job with neutron-trunk enabled
A recent fix was merged to Neutron (see [0]), that fixed live-migration
of VMs with trunks, a new tempest test will cover this usecase (see [1])

To make the test executed enable neutron_trunk for the job
nova-live-migration.

[0]: https://review.opendev.org/q/I98e55242d381ada642ca0729e9aefdea7628c945
[1]: https://review.opendev.org/c/openstack/tempest/+/774689
Related-Bug: #1914747

Change-Id: I89989f69f76d1a1ad4c2851da027b3e763e6b0d3
2021-02-16 14:58:51 +01:00
Lee Yarwood bc0d1c8d63 nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default
Change-Id: I68f7b7e78cc8a7f22f3e495b1b20a311dacff6c5
Depends-On: https://review.opendev.org/c/openstack/devstack/+/775573
2021-02-15 10:32:53 +00:00
Dan Smith 94b5db6d2e Make a couple test jobs run async devstack
This makes us run a couple of our jobs with devstack in parallel
mode.

Change-Id: Ie3ca2332f8172ec8f0e3062a812e57739475e8af
2021-02-11 15:58:51 -08:00
Lee Yarwood 96cf885ecd zuul: Mark nova-lvm as voting
As covered in the removed TODO this was to be done after bug #1771700
was resolved in Queens but instability in the job over the years stopped
this from ever happening.

With I7ad1d9820c48644bff7834560cdc7d5c13f7ed41 hopefully addressing the
only outstanding stability issue we can now finally mark the job as
voting again.

Related-Bug: #1771700
Change-Id: Ie9cba36ab602ab7c20c9a2c3b60e11e8506581ce
2021-02-02 10:23:37 +00:00
Lee Yarwood 7d66f97e0a zuul: Increase SWIFT_LOOPBACK_DISK_SIZE within nova-lvm job
This is required as instance snapshots taken in this environment are
fully allocated RAW snapshots and consume considerably more space than
sparsely allocated RAW snapshots taken when Nova is using a file based
imagebackend.

We could look into sparsifying the resulting snapshots from the lvm
imagebackend but for the time being given the available space in our CI
hosts we can just extend space available to g-api via swift.

Closes-Bug: #1913451
Change-Id: I7ad1d9820c48644bff7834560cdc7d5c13f7ed41
2021-02-02 10:22:52 +00:00
Zuul 3fc4824e66 Merge "zuul: Allow encryption tests in nova-ceph-multistore again" 2021-01-27 13:35:10 +00:00
Zuul 93e0994b56 Merge "add openstack-python3-wallaby-jobs-arm64 job" 2021-01-23 20:01:22 +00:00
Lee Yarwood 6b4db089b2 zuul: Allow encryption tests in nova-ceph-multistore again
I50d3b874b7e0676436c434be6c059f221041560f and
Iee0d863770def63df8601222265dc22226457c0c should avoid any image
creation from breaking these tests while
[workarounds]/never_download_image_if_on_rbd remains set in this job.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/771958
Depends-On: https://review.opendev.org/c/openstack/cinder-tempest-plugin/+/771835

Related-Bug: #1912607
Change-Id: I06f95d68fcf20d40096b0ee120fe780097d82320
2021-01-22 10:15:42 +00:00
Lee Yarwood 6eae97843a zuul: Skip test_attach_cloned_encrypted_volume in nova-ceph-multistore
As with the already listed encrypted volume tests this job specifically
blocks us from downloading non-raw images via Glance as part of these
tests so skip it.

Change-Id: Iaf6f6e0dbcb25561bf00e969e1964cd30e974e64
Closes-Bug: #1912607
2021-01-21 09:43:34 +00:00
ricolin af15488be9 add openstack-python3-wallaby-jobs-arm64 job
This is a non-voting job to validate py3 unittests on ARM64

Task: 40400
Story: 2007938
Change-Id: Ib45df16aaf718850ccdaf4b001f3b7c03b2f1d04
2021-01-19 20:45:05 +08:00
Zuul b012361a53 Merge "Revert "zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore"" 2020-11-30 10:23:11 +00:00
Ghanshyam Mann 4bea68f12b Revert "zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore"
This reverts commit 836e13cd57.

Reason for revert: depends-on patch fixed the test.

Change-Id: I999336dff277954e7621489cc7f5e486962ee2a5
Depends-On: https://review.opendev.org/c/openstack/tempest/+/764407
2020-11-28 14:36:49 +00:00
Lee Yarwood 7f7a7a163e zuul: Add devstack-plugin-ceph-compute-local-ephemeral to experimental
This job tests the recently introduced direct download of rbd hosted
Glance images into a file based imagecache.

Depends-On: https://review.opendev.org/748212
Change-Id: I0933447e6caa0013f0b26dbf6532ff1976197e80
2020-11-27 13:33:16 +00:00
Lee Yarwood 836e13cd57 zuul: Skip test_attach_scsi_disk_with_config_drive in nova-ceph-multistore
Related-Bug: #1905725
Change-Id: Ia108a7ac04defe742efcac09e7c0d61b08ab4e6d
2020-11-27 09:11:34 +00:00