Commit Graph

365 Commits

Author SHA1 Message Date
Lee Yarwood 9f0d2d8ecf zuul: Switch to the Zuulv3 grenade job
This change switches the single node legacy grenade-py3 job over to the
newly introduced Zuulv3 based grenade job.

Change-Id: I212692905a1d645cd911c2a161c13c794c0e0f4d
2020-04-27 08:48:58 +00:00
OpenStack Release Bot 347d656c35 Add Python3 victoria unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for victoria.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I1178c8fed5f7fdcbbb52c036bf7fab8bf4de6807
2020-04-23 21:37:47 +00:00
Sundar Nadathur ca49e46c4f Add cyborg tempest job.
The Cyborg tempest plugin has been merged in Train [1]. The
creation and deletion of VMs with this patch series are
validated with that plugin.

The plugin is being enhanced to cover other VM operations like
reboots, pause, etc. [2]

[1] https://opendev.org/openstack/cyborg-tempest-plugin
[2] https://review.opendev.org/#/c/685183/

Change-Id: Id8762d0d95aa7c90feee64eb07a50433ca6ca3d1
Blueprint: nova-cyborg-interaction
2020-03-31 00:24:01 -07:00
Monty Taylor 2092c3e714 Run sdk functional tests on nova changes
The SDK API tests provide another set of verification of nova
behavior. In a perfect world, as we add new microversions to
nova, we'd add support for the microversion first to SDK along
with a test that should work if the MV isn't there, and then
adding the microversion the test should still work - which would
allow us to make sure SDK is always up to date with the very
latest and greatest nova api.

Change-Id: I2406bd6d9e69e33e57b715ff0812c5770b1b53d8
2020-03-10 16:11:00 -05:00
Zuul 89891959d9 Merge "zuul: Add Fedora based jobs to the experimental queue" 2020-02-20 15:03:03 +00:00
Ghanshyam Mann fe7655abe2 Use tempest-full-py3 as base job
tempest-full is py2 job which are not supposed
to use for master gate. nova-tempest-full-oslo.versionedobjects
job is derived from tempest-full. Changing this job
to drive from tempest-full-py3.

Change-Id: I15390e7e11565030c7c6211b0af03c1c20d6bee5
2020-02-18 20:32:12 -06:00
Ghanshyam Mann db39391fe0 Skip to run all integration jobs for policy-only changes.
Currently we run all the integration jobs for policies
only changes which is not required. Policy-only changes
can be covered by unit, functional and single tempest, grenade
job.

Change-Id: I4b2d321b7243ec149e9445035d1feb7a425e9a4b
2020-02-12 16:33:17 +00:00
Zuul b8f4e46939 Merge "zuul: Remove unnecessary 'USE_PYTHON3'" 2020-01-30 17:09:07 +00:00
Lee Yarwood 28627d6595 zuul: Add Fedora based jobs to the experimental queue
This change adds two Fedora based jobs to the experimental queue with
the aim of providing improved coverage for anyone working on features
that rely on recently released Libvirt, QEMU or KVM features.

Depends-On: https://review.opendev.org/#/c/701228/
Change-Id: Ie2e2a4dc31b9fdcd6ac87c14f564621803c8d4cf
2020-01-27 20:13:58 +00:00
Zuul 4fcecdb55a Merge "Restore test_minbw_allocation_placement in nova-next job" 2020-01-03 20:45:45 +00:00
Matt Riedemann 7661995b69 Enable cross-cell resize in the nova-multi-cell job
This changes the nova-multi-cell job to essentially
force cross-cell resize and cold migration. By "force"
I mean there is only one compute in each cell and
resize to the same host is disabled, so the scheduler
has no option but to move the server to the other cell.

This adds a new role to write the nova policy.yaml file
to enable cross-cell resize and a pre-run playbook so
that the policy file setup before tempest runs.

Part of blueprint cross-cell-resize

Change-Id: Ia4f3671c40e69674afc7a96b5d9b198dabaa4224
2019-12-23 10:10:57 -05:00
Luigi Toscano e7e39b8c2e Zuul v3: use devstack-plugin-nfs-tempest-full
... and replace its legacy ancestor.

Change-Id: Ifd4387a02b3103e1258e146e63c73be1ad10030c
2019-12-18 00:28:15 +01:00
Eric Fried 53ef08276c Restore test_minbw_allocation_placement in nova-next job
This test was accidentally removed via [1] so we restored it via [2],
but that fell afoul of the related bug so we re-disabled it via [3].
Once the dependency merges, we should be able to re-restore it.

[1] https://review.opendev.org/#/c/683988/
[2] https://review.opendev.org/#/c/697180/
[3] https://review.opendev.org/#/c/697491/

Depends-On: https://review.opendev.org/682964
Change-Id: I9c11f25307b6b3859522775bb8172b901b468d79
Related-Bug: #1854993
2019-12-06 11:04:57 -06:00
Matt Riedemann 15c59f1897 Skip test_minbw_allocation_placement in nova-next job
We just recently enable this scenario test [1] but it's
causing the nova-next job to intermittently fail because
the nova-next job runs the tempest compute API and scenario
tests concurrently (unlike the tempest-full job which runs
the API tests concurrently and then the scenario tests serially)
and the scenario test is creating a public shared network which
causes the compute API tests, when creating a server without
specifying a network, to fail since nova doesn't know which
network to use. So for now just blacklist the scenario test
until the related tempest bug is fixed.

[1] https://review.opendev.org/#/c/697180/

Change-Id: Ie0e6136e88bedb2c4c6d0b742319627d58da147e
Related-Bug: #1844568
2019-12-05 09:55:28 -05:00
Eric Fried f347839151 Add QoS tempest config so bw tests run
In [1] the tempest-slow-py3 job was dropped and non-redundant bits
folded into the nova-next job.

Except we forgot to move over some of the config necessary to make this
QoS bandwidth test [2] work, so it gets skipped:

setUpClass (tempest.scenario.test_minbw_allocation_placement.MinBwAllocationPlacementTest)
... SKIPPED: Skipped as no physnet is available in config for placement based QoS allocation.

This syncs the nova-next job with the config like what was done for
tempest-slow here [3]. Some of that was already in place (to make
QoS heal allocation testing work).

[1] https://review.opendev.org/#/c/683988/
[2] https://github.com/openstack/tempest/blob/3eb3c29e979fd3f13c205d62119748952d63054a/tempest/scenario/test_minbw_allocation_placement.py#L142
[3] https://github.com/openstack/tempest/commit/c87a06b3c29427dc8f2513047c804e0410b4b99c

Closes-Bug: #1854993

Change-Id: Ib9332b8677c4ccb9e38b6fcdf39e989a891a56fe
2019-12-03 20:19:24 +00:00
Zuul 3e96266708 Merge "Force config drive in nova-next multinode job" 2019-11-29 16:44:15 +00:00
Zuul 23995b4f99 Merge "zuul: Remove unnecessary 'tox_install_siblings'" 2019-11-27 01:07:13 +00:00
Zuul ca0b03d178 Merge "zuul: Make functional job inherit from openstack parents" 2019-11-27 01:07:08 +00:00
Matt Riedemann fcb64bd0f8 Force config drive in nova-next multinode job
We made the nova-next job multinode in Ussuri and we
sometimes see intermittent failures setting up guests
in tempest tests that move a guest from one host to
another, e.g. test_shelve_volume_backed_instance. If
this is due to slow nodes or slow network connections
between the subnode and the primary where the metadata
API server is running, the guest setup can fail which
results in SSH failures in the tempest tests which are
generally not easy to debug.

This makes the nova-next job force the use of a config
drive for the servers that are created so we can take
the metadata API server out of the mix for these types
of SSH failures with this specific job.

Change-Id: Idc45d5ebc26e3a8a94fc5ec13c07465b9dd460e6
Related-Bug: #1853453
2019-11-21 08:27:22 -05:00
Stephen Finucane 4a876df468 zuul: Remove unnecessary 'USE_PYTHON3'
The DevStack change to switch to Python 3 by default [1] has now landed,
which means we no longer need to override this in our zuul
configuration. Remove the relevant entries.

[1] https://review.opendev.org/#/c/649097/

Change-Id: I40e515cd4ddc85cd1dba613c2b5c0505e35df295
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2019-11-21 09:30:40 +00:00
Stephen Finucane 50ad9245f0 zuul: Remove unnecessary 'tox_install_siblings'
This it the default value defined by zuul-jobs. There's no need to
manually configure it.

[1] https://opendev.org/zuul/zuul-jobs/src/commit/6228b71b071c037f486f4e60b0e064625537d173/roles/tox/defaults/main.yaml#L6

Change-Id: Ib8ffb8a3ae3bfdd2cfedd8313b9221945e392141
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2019-11-20 16:11:25 +00:00
Matt Riedemann 8cb6f07444 Drop neutron-grenade-multinode job
We were running the voting neutron-grenade-multinode job in the
check queue on nova changes but were not running it in the gate
queue.

We run the nova-grenade-multinode job in both check and gate queues.

The major differences between those jobs are that the neutron
job runs the tempest smoke tests during the grenade run on the
old and new side of the grenade environment and the nova job would
not run smoke tests but ran a select few live migration and
resize/cold migration tests via the post-test hook script, and would
run those with an lvm/local storage/block migration and ceph/shared
storage setup.

This change makes the nova-grenade-multinode job run smoke tests
like the neutron-grenade-multinode job was so we can drop the
neutron-grenade-multinode job from running on nova changes in the
check queue and save a few nodes.

Note that neutron-grenade-multinode ran all smoke tests but this
change makes nova-grenade-multinode run a subset of smoke tests for
only the ones that involve compute. This is in order to keep the
execution time of the job down by not testing non-compute API things
that nova changes don't care about, e.g. keystone, swift, cinder, etc
smoke tests.

[1] https://zuul.opendev.org/t/openstack/build/377affdf97b04022a321087352e1cc4c/log/logs/grenade.sh.txt.gz#41965

Change-Id: Icac785eec824da5146efe0ea8ecd01383f18398e
2019-11-19 15:52:26 +00:00
Matt Riedemann 9e665c8a95 FUP to Ie1a0cbd82a617dbcc15729647218ac3e9cd0e5a9
Mention that nova-grenade-multinode and nova-live-migration
run under python 3 in the job description since it's not
obvious from the job names.

Change-Id: I86f56b0238c72d2784e62f199cfc7704b95bbcf2
2019-11-19 15:37:50 +00:00
Stephen Finucane 6a04c5546a zuul: Make functional job inherit from openstack parents
Change-Id: Iabbbca8f16bcae8c8240fec65d5f2621ce4a98fb
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2019-11-18 10:31:48 +00:00
Stephen Finucane 14872caae1 Stop testing Python 2
It's Ussuri. We can *finally* stop testing Python 2 [1]. Time to party.
We don't attempt any cleanup but simply stop testing with Python 2,
indicate that we only support Python 3 via 'setup.cfg' and remove any
Python 2 only dependencies. Our 'tox.ini' is modified such that
'functional' now runs with 'python3', whatever that may point to, though
the gate will only use a versioned variant (currently
'functional-py36').

This should free up a significant amount of resources from the gate and
let us start using Python 3 idioms in our code. Win-win.

[1] https://governance.openstack.org/tc/resolutions/20180529-python2-deprecation-timeline.html#python2-deprecation-timeline

Change-Id: Ie1a0cbd82a617dbcc15729647218ac3e9cd0e5a9
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2019-11-18 10:31:06 +00:00
Zuul adaf619a03 Merge "Remove unused 'nova-dsvm-base' job" 2019-11-07 07:47:56 +00:00
Stephen Finucane 3e1680cc71 Remove unused 'nova-dsvm-base' job
This has been unused since I4630066731f12c42091ddf9dd3159e0494df88b1,
which converted the 'nova-lvm' job to zuul v3 native format.

Change-Id: If9e2eb3bbda53c71846e8a08ad507d3faa07722d
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2019-11-06 22:01:32 +00:00
Zuul f88abe3fed Merge "Switch to devstack-plugin-ceph-tempest-py3 for ceph" 2019-11-01 20:56:49 +00:00
Zuul 6f121c1653 Merge "Make nova-next multinode and drop tempest-slow-py3" 2019-10-30 03:14:24 +00:00
melanie witt 23871ad4ad Switch to devstack-plugin-ceph-tempest-py3 for ceph
We dropped the tempest-full python2 job from our zuul config awhile
back with change I93e938277454a1fc203b3d930ec1bc1eceac0a1e. Since we
track ceph job health by how its failure rate compares with our basic
tempest full job, this updates our config to run the python3 version
of the ceph job by default and drops the python2 version of the job.

Change-Id: I92e01b896751f7f29a0b2b826c33cb2c74b8ced4
2019-10-28 22:31:41 +00:00
Matt Riedemann 6f8c2f0df5 Make nova-next multinode and drop tempest-slow-py3
The tempest-slow-py3 job is, well, very slow. It takes
over 2.5 hours sometimes to complete. There are a few
reasons beyond it just running slow tests but it runs
all slow tests serially and for nova it's testing things
we don't care about like network scenario tests like
test_slaac_from_os. The one benefit we get from running
tempest-slow-py3 is that it's multinode and there are
certain slow test scenarios for multinode that are
important for test coverage.

This change drops the tempest-slow-py3 job from our
job list and changes nova-next to be multinode. The
nova-next job runs a select set of tempest compute API
and scenario tests only and runs them concurrently, which
in the gate is 4 workers at a time. The nova-next job
will take a bit longer since we have to setup the subnode
now but overall it should still be faster than the
tempest-slow-py3 job and we'll save on one more node
required from nodepool to run jobs against nova changes.

The USE_PYTHON3 variable can be dropped from the nova-next
job definition now that it extends tempest-multinode-full-py3.

Depends-On: https://review.opendev.org/690469/

Change-Id: I1b7d71e833bf0743f22d7fa0241c9d1bbcd0faac
2019-10-24 09:53:07 -04:00
Andreas Jaeger 604efd382a Switch to opensuse-15 nodeset
opensuse-150 nodeset is referring to openSUSE 15.0, which is still in
maintenance but openSUSE 15.1 has been released already. "opensuse-15"
is going to refer to the "latest openSUSE 15.x" build released and
working for OpenStack going forward, so add this nodeset and use
it by default going forward.

The new job tempest-full-py3-opensuse15 use the opensuse-15 nodeset,
change tempest-full-py3-opensuse150 to tempest-full-py3-opensuse15.

Change-Id: Ida6b3f115d987b85e811be246468acd290f6c911
2019-10-16 21:42:43 +02:00
Matt Riedemann 3f3114c94e Skip functional test jobs for doc redirect changes
Changes to docs to handle redirects like [1] should not
trigger functional jobs. Note that functional-irrelevant-files
does not just blindly ignore all changes to the docs/* path
because we do need to run functional test jobs for changes to
doc/notification_samples.

[1] Iad18f355a20261313ddb3dafd302ed66ebca64bc

Change-Id: I4c2cb97de1fc8e1ed80fa22680621fd4f6390cfd
2019-10-08 12:43:59 -04:00
Zuul 6ee5cfb397 Merge "Test heal port allocations in nova-next" 2019-10-03 03:28:30 +00:00
Balazs Gibizer 0044702e0d Test heal port allocations in nova-next
This patch extends the existing integration test for
heal_allocations to test the recently implemented port
allocation healing functionality.

Change-Id: I993c9661c37da012cc975ee8c04daa0eb9216744
Related-Bug: #1819923
2019-10-02 11:15:36 +02:00
Zuul 0568676132 Merge "Modernize nova-lvm job" 2019-09-04 20:43:02 +00:00
Zuul 85d21ad5e0 Merge "Convert nova-lvm job to zuul v3" 2019-09-04 20:08:05 +00:00
Balazs Gibizer 2cf9a5f9fa Add cold migrate and resize to nova-grenade-multinode
Changes in [1] could potentially break a mixed-compute-version
environment as we don't have grenade coverage for cold migrate and
resize. This adds that coverage to the nova-grenade-multinode
job.

[1]https://review.opendev.org/#/c/655721/10

Change-Id: I81372d610ddf8abb473621deb6e7cb68eb000fee
2019-08-30 15:35:46 -04:00
Balazs Gibizer 7f8dd04108 Rename the nova-grenade-live-migration job to nova-grenade-multinode
We are planning to add non-live-migration multinode tests to this job
so first we rename it to be more generic.

Change-Id: I7571ff508fcccba40cf2307a8788c1850d2d9fd8
2019-08-30 15:35:46 -04:00
Balazs Gibizer 3c1d9dab85 Move live_migration test hooks under gate/
This patch resolves a TODO in the .zuul.yaml about using common
irrelevant files in our dsvm jobs. To be able to do that we need to move
the test hooks from nova/tests/live_migraton under gate/.

Change-Id: I4e5352fd1a99ff2b4134a734eac6626be772caf1
2019-08-29 14:45:48 -04:00
Eric Fried d91c1626ff Process [compute] in $NOVA_CPU_CONF in nova-next
Due to bug 1802143, devstack was ignoring variables set in the
$NOVA_CPU_CONF section of local_conf. Now that that bug has been fixed
(see the Depends-On) we can put those back in their rightful place.

This patch moves the [compute]resource_provider_association_refresh
setting, introduced via [1], accordingly.

[1] https://review.opendev.org/616033

Depends-On: https://review.opendev.org/672805
Change-Id: Ifa50748b6d6e91ac954d0a7a6060505fd45716d4
Related-Bug: #1802143
2019-08-23 14:11:48 +00:00
Zuul 3a5f8498f4 Merge "Make nova-multi-cell job voting and gating" 2019-08-09 22:54:22 +00:00
Matt Riedemann a8f502c04f Make nova-multi-cell job voting and gating
Compared to tempest-full-py3 and tempest-slow-py3
the nova-multi-cell job has been relatively stable
for the past couple of months so let's make it voting
so we don't regress multi-cell functionality.

Change-Id: I11081177abfe2fb69fbd8fc17464c9f08962ab4c
2019-08-03 08:45:03 -04:00
Matt Riedemann 8823280724 Add nova-osprofiler-redis job to experimental queue
This adds a nova-specific variant of the
tempest-smoke-py3-osprofiler-redis job to nova's
experimental queue. This could be useful in comparing
before and after results on nova changes that are
related to performance, although that's admittedly
hard in a CI environment where we could be running on
different node providers (we could pin that though?)
and differing levels of noisy neighbors during each
job run.

Change-Id: I2dcb5c1e8289eaf7977b38a3d26e74183823c42b
2019-08-02 13:31:24 -04:00
Matt Riedemann 573b3799a0 Modernize nova-lvm job
This updates the job to run with python3 and also
disables the cinder-backup service since we are not
testing anything that needs it - so this saves a bit
of time stacking the test node.

Change-Id: I68ad1716b5ee9c58418a8e687bb521ee75495585
2019-08-02 13:13:07 -04:00
Matt Riedemann 35d8f93645 Convert nova-lvm job to zuul v3
Converts the job to zuul v3 native format so the legacy
playbook is deleted.

Drops the blacklist regex file in favor of simply configuring
tempest to not run resize or cold migration tests.

Change-Id: I4630066731f12c42091ddf9dd3159e0494df88b1
2019-08-02 13:08:50 -04:00
Zuul 0fc5b35758 Merge "(Re-)enable vnc console tests in nova-multi-cell job" 2019-08-02 13:04:58 +00:00
Zuul 78ce2e89e5 Merge "Replace "integrated-gate-py3" template with new "integrated-gate-compute"" 2019-07-30 19:42:41 +00:00
Zuul 7313b10e48 Merge "Run 'tempest-ipv6-only' job in gate" 2019-07-30 18:49:21 +00:00
Matt Riedemann 4188d08c20 Disable cinder-backup service in nova-next job
We don't run any tests that require the cinder backup
service in the nova-next job nor do we care to so save
some time in stacking and space on the node by not
installing that service.

Change-Id: I6991a231366908920847fa1b8375ece8d8b35268
2019-07-24 14:05:44 +00:00