Commit Graph

53743 Commits

Author SHA1 Message Date
melanie witt 872a9b4e7c Re-enable testing of console with TLS in nova-next job
This is a partial revert of Ie46311fa9195b8f359bfc3f61514fc7f70d78084.

Depends-On: https://review.openstack.org/643045

Related-Bug: #1819794

Change-Id: I1bf37edb4dc3bdb6f23d077eae32e81ef48bdcdc
2019-03-25 03:45:36 +00:00
Zuul 926e584136 Merge "Pass kwargs to exception to get better format of error message" 2019-03-18 10:57:11 +00:00
Zuul be8af28a4f Merge "Trivial typo fix for REST API in policy enforcement docs" 2019-03-15 17:48:01 +00:00
Zuul ca39bdd17e Merge "Add descriptions of numbered resource classes and traits" 2019-03-15 17:47:53 +00:00
Zuul e272b280f1 Merge "Remove resize caveat from conductor docs" 2019-03-15 17:47:44 +00:00
Zuul d1797d8f58 Merge "docs: cleanup driver parity scope section" 2019-03-15 17:47:36 +00:00
Zuul d40125ef7f Merge "add python 3.7 unit test job" 2019-03-15 14:15:41 +00:00
Zuul c8f7246343 Merge "Avoid crashing while getting libvirt capabilities with unknown arch names" 2019-03-15 13:13:56 +00:00
Matt Riedemann 0a44d3ae0a Trivial typo fix for REST API in policy enforcement docs
Change-Id: If17a910f8a891ce93491d931c95f65d9fd9529e5
2019-03-15 08:33:12 -04:00
Matt Riedemann 1308d644bb Remove resize caveat from conductor docs
This document was written back in the liberty release [1]
and says that conductor is not used for orchestrating the
resize/migrate flow, but given the description of how
conductor is used to orchestrate scheduling and reschedules
during a server create, it is unclear why the doc says that
resize is not used the same way since it is used for rescheduling
when prep_resize fails in a selected dest compute. This removes
the caveat to reflect reality.

[1] Ieb9134302d21a11fe9b9ee876bb7b0dd32b437e1

Change-Id: I932a7ac6870a3f9d26556c23c9074115963b3c27
2019-03-15 08:02:52 -04:00
Matt Riedemann 5de08c0966 docs: cleanup driver parity scope section
This fixes some grammar issues, links to the interop
page and fixes a misuse of tenant.

Change-Id: I3ce0e130e3691240a625c67dfb6123bafe7f48b8
2019-03-15 08:01:19 -04:00
Zuul 5ca858eaa7 Merge "Add functional test to delete a server while in VERIFY_RESIZE" 2019-03-15 04:13:23 +00:00
zhufl 40cbea18e6 Pass kwargs to exception to get better format of error message
If we do not pass kwargs to exception, the parameter will be deemed
as message and msg_fmt is ignored, so the message will be displayed
directly. This is to pass kwargs to some exceptions, to get better
format of error message.

Change-Id: I66677a90430d9e6699619539cb8f575f57b19433
2019-03-15 10:42:18 +08:00
Dan Smith 71df650d0a Avoid crashing while getting libvirt capabilities with unknown arch names
In _get_instance_capabilities() we get a list of host capabilities and then
build a list of arches supported by the virt type of an instance to arrive
at the list of possibilities for the instance. We check each of those
against our enum, but fail to gracefully skip unsupported values should we
encounter one.

This patch makes that graceful, and also introduces an unsupported arch to
the test stub to make sure we always skip it. Note that we do not warn
because this happens once per instance in a periodic task, and since the
situation is caused by a (somewhat permanent) mismatch of libvirt and
nova version support, isn't something that needs to be remedied by an
operator.

Closes-Bug: #1820125
Change-Id: I5d95bd50279a6bf903a5793ad5f3ae9d06f085f4
2019-03-14 14:14:31 -07:00
melanie witt 9b2a7f9e7c Re-enable Ceph in live migration testing
Revert I05182d8fd0df5e8f3f9f4fb11feed074990cdb9f and
Add fix to enable proper OS detection.

Closes-Bug: #1819944

Co-Authored-By: Jens Harbott <j.harbott@x-ion.de>

Change-Id: Iea6288fe6d341ee92f87a35e0b0a59fe564ab96c
2019-03-14 18:48:55 +00:00
Matt Riedemann f9a6321c7b Customize irrelevant-files for nova-live-migration job
I noticed change Iea6288fe6d341ee92f87a35e0b0a59fe564ab96c
was not running the nova-live-migration job even though
it was making changes to nova/tests/live_migration/hooks/run_tests.sh.
The reason is the nova-live-migration job irrelevant-files were
excluding changes to nova/tests/*.

This copies the nova-grenade-live-migration irrelevant-files list
to the nova-live-migration job and defines it as a variable so it
can be re-used in the nova-grenade-live-migration job definition.

Change-Id: I753fda1a83b340f4699c049158e6744b099f55d8
2019-03-14 10:05:23 -04:00
Zuul 63e5cba88a Merge "Migrate legacy jobs to Ubuntu Bionic" 2019-03-14 09:04:56 +00:00
Zuul 5455277e3f Merge "Update compute rpc version alias for stein" 2019-03-14 08:43:59 +00:00
Zuul b7bd97bc88 Merge "Disable the tls-proxy in nova-next & fix nova-tox-functional-py35 parent" 2019-03-14 04:06:32 +00:00
ghanshyam 452fd2d91b Migrate legacy jobs to Ubuntu Bionic
We have migrated the zuulv3 job to Bionic during Dec/Jan month.
 - http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000837.html
 - https://etherpad.openstack.org/p/devstack-bionic
But that effort does not move all gate job to Bionic as there are
large amount of jobs are still legacy jobs. All the legacy jobs still
use Xenial as nodeset.

As per the decided runtime for Stein, we need to test everything on openstack
CI/CD on Bionic - https://governance.openstack.org/tc/reference/runtimes/stein.html

Below patch move the legacy base jobs to bionic which will move the derived jobs
automatically to bionic. These jobs are modified with branch variant so that they will use
Bionic node from stein onwards and xenial for all other stable branches
until stable/rocky.
- https://review.openstack.org/#/c/639096

This commit remove the overridden nodeset from legacy jobs
so that it will start using the nodeset defined in parent job.

More Details: 
- https://etherpad.openstack.org/p/legacy-job-bionic
- http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003614.html

Depends-On: https://review.openstack.org/#/c/639096

Change-Id: I3266b6fd26ec86f429b91b69d82c8e99f80cb6ca
2019-03-13 23:54:38 +00:00
Zuul ca7cb9eeb7 Merge "Trivial: fix typo in reno" 2019-03-13 23:50:01 +00:00
ghanshyam d74a5b23a5 Disable the tls-proxy in nova-next & fix nova-tox-functional-py35 parent
While moving the legacy job nova-next on bionic, tls-proxy
did not work and leads to nova-next job fail.

To proceed further on Bionic migration which is blocked by nova-next failure,
this commit temporary disable the tls-proxy service until bug#1819794 is fixed.

Also this updates the parent of nova-tox-functional-py35 from openstack-tox
to openstack-tox-functional-py35 in order to handle the upcoming change
of the infra CI default node type from ubuntu-xenial to ubuntu-bionic.

The python3.5 binary is not provided on ubuntu-bionic and the shared
"py35" job definitions in the openstack-zuul-jobs repository have been
patched to force them to run on ubuntu-xenial [1]. We should inherit
from one of these jobs for jobs that rely on python3.5.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003746.html

Related-Bug: #1819794

Change-Id: Ie46311fa9195b8f359bfc3f61514fc7f70d78084
2019-03-13 23:46:19 +00:00
Zuul 52567a6cb2 Merge "Skip the ceph based live migration testing" 2019-03-13 23:25:21 +00:00
Zuul 60cad7abc8 Merge "Update instance.availability_zone during live migration" 2019-03-13 23:25:11 +00:00
Zuul f7af48363f Merge "docs: Fix nits in remote console guide" 2019-03-13 21:03:32 +00:00
Zuul d0be0b75d5 Merge "api-ref: Add description for BDM volume_size" 2019-03-13 21:03:23 +00:00
Zuul ca14e0f860 Merge "Add missing libvirt exception during device detach" 2019-03-13 21:00:07 +00:00
Zuul 7a244c1ce4 Merge "Trivialfix for help description of images_type" 2019-03-13 20:48:07 +00:00
Matt Riedemann 5fd2402d56 Trivial: fix typo in reno
Change-Id: I451a65cc8d7e755a9229b788d1c82492c62ea3b0
2019-03-13 14:51:45 -04:00
ghanshyam f8b578b2ac Skip the ceph based live migration testing
While moving the legacy jobs on Bionic[1], it is found
that ceph pckg hammer is not available to download
on bionic and it error with 404. Due to that job testing the
live migration on ceph not working:
-  nova-live-migration skip the ceph live migration testing[2]
-  nova-grenade-live-migration fail due to no ceph pckg[3]

To proceed further on Bionic migration which is blocked by these failure,
this commit temporary skip the ceph live migration testing until
bug#1819944 is fixed.

Related-Bug: 1819944
[1] https://review.openstack.org/#/c/639017
[2] http://logs.openstack.org/17/639017/8/check/nova-live-migration/87084aa/logs/devstack-gate-post_test_hook.txt.gz#_2019-03-13_14_34_20_967
[3] http://logs.openstack.org/17/639017/8/check/nova-grenade-live-migration/735242b/logs/devstack-gate-post_test_hook.txt.gz#_2019-03-13_15_00_32_310

Change-Id: I05182d8fd0df5e8f3f9f4fb11feed074990cdb9f
2019-03-13 18:05:54 +00:00
Takashi NATSUME f87bf4c6b9 api-ref: Add description for BDM volume_size
Add description of cases that 'block_device_mapping_v2.volume_size`
is required in the "Create Server" (POST /servers) API.

Change-Id: I36f28ca756b908b5fc591cc87f5786a3e217285e
Closes-Bug: #1818310
2019-03-13 16:17:20 +00:00
Zuul 482f4fed65 Merge "Remove duplicate cleanup in functional tests" 2019-03-13 15:42:59 +00:00
Corey Bryant 21357c76ba add python 3.7 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.7.

See ML discussion here [1] for context.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-October/135626.html

Change-Id: I36f641a7c281a7d8e168c507dae7109132bcefde
Story: #2004073
Task: #27433
2019-03-13 10:36:55 -04:00
Zuul 2529ddfbe7 Merge "pass endpoint interface to Ironic client" 2019-03-13 12:08:39 +00:00
zhu.boxiang 8fcf36eb21 Trivialfix for help description of images_type
The file virt.py has been remove from the patch
https://review.openstack.org/#/c/392566/.
So use_cow_images config is now in file compute.py
Change from virt to compute for it.

Change-Id: Id332f6dc3e0aaaab4ff94b810e4a5bf6b7e01874
2019-03-13 10:27:06 +08:00
Zuul 141eb3e814 Merge "Allow utime call to fail on qcow2 image base file" 2019-03-13 00:25:14 +00:00
Matt Riedemann 33cab70e1c Add functional test to delete a server while in VERIFY_RESIZE
This scenario came up while discussing what might be causing
leaked resource allocations in Placement [1].

I fully expected the new test to fail because I couldn't see
from the compute manager where the migration-based allocations
would be cleaned up when deleting the server. It turns out that
when deleting a VERIFY_RESIZE server, the API confirms the resize
which drops the migration-based allocations on the source node
before deleting the server on the target node.

Since this is not obvious, a comment in the compute API
_confirm_resize_on_deleting() method is added.

[1] http://lists.openstack.org/pipermail/openstack-dev/2018-November/136295.html

Change-Id: I4c12502c86c7ac27369d119e0f97768cf41695b5
2019-03-12 21:42:07 +00:00
Zuul 9fa26e439b Merge "Revert "Fixes race condition with privsep utime"" 2019-03-12 21:35:05 +00:00
Guang Yee e082bdc166 pass endpoint interface to Ironic client
Via change [1], ironicclient began to use endpoint_filter in the
version negotiation code path, whereas it was previously unused if a
fully-qualified endpoint had already been determined. Suddenly it was
important that the `interface` part of this endpoint_filter be correct.

Prior to ironicclient change [2], there was no way to pass an
appropriate `interface` value through ironicclient's initialization, so
the ironicclient used from nova would always end up with the default
value, `public`, in the endpoint_filter. This would break in clouds
lacking a public ironic API endpoint (see the referenced bug).

With this change, we pass the value of the (standard, per ksa)
`valid_interfaces` ironic config option into the ironicclient
initialization, where (if and only if the ironicclient fix [2] is also
present) it eventually gets passed through to the ksa Adapter
initialization (which is set up to accept values from exactly that conf
option) to wind up in the endpoint_filter.

The effect is that nova's ironicclient will actually be using the
interface from nova.conf throughout. (Because `valid_interfaces` is also
used in recommended configuration setups - i.e. those that use the
service catalog to determine API endpoints - to construct the
endpoint_override used to initialize the ironicclient, the value used
during version negotiation should be in sync with that used for regular
API calls.)

[1] I42b66daea1f4397273a3f4eb1638abafb3bb28ce
[2] I610836e5038774621690aca88b2aee25670f0262

Change-Id: I5f78d21c39ed2fd58d2a0f3649116e39883d5a2c
closes-bug: 1818295
2019-03-12 19:08:38 +00:00
Zuul a5e3054e1d Merge "Share snapshot image membership with instance owner" 2019-03-12 18:43:12 +00:00
Neil Jerram 362bba9011 Allow utime call to fail on qcow2 image base file
This utime call sometimes fails, with EACCES (Permission Denied), when
the base file is on an NFS client filesystem.  I don't understand why,
but wonder if it's a similar problem as the one that motivated using
touch instead of utime in ec9d5e375e.  In any case, IIUC, timing
isn't the primary thing that the image cache manager uses to determine
when the base file is in use.  The primary mechanism for that is
whether there is a matching disk file for a current instance.  The
timestamp on the base file is only used when deciding whether to
delete a base file that is _not_ in use; so it is not a big deal if
that deletion happens slightly earlier, for an unused base file,
because of one of these preceding utime calls having failed.

Closes-Bug: #1809123
Co-Authored-By: Matthew Booth <mbooth@redhat.com>
Change-Id: Idc131ff426f1707150867030fa5a69b77a7fc832
2019-03-12 10:40:45 -04:00
Zuul e608568518 Merge "Remove fake_libvirt_utils from the cache concurrency tests." 2019-03-12 00:12:32 +00:00
Takashi NATSUME 61973bafad Update compute rpc version alias for stein
This adds a compute rpc version alias for the named release stein.

Change-Id: I09da8b9c0cb00755f6f21658f2494b147026e57a
2019-03-12 08:46:28 +09:00
Zuul 9942649546 Merge "Handle templated cell mappings in nova-status" 2019-03-11 23:33:19 +00:00
Zuul a2d7ffba32 Merge "fix race in test_interface_detach_with_port_with_bandwidth_request" 2019-03-11 16:58:35 +00:00
Balazs Gibizer d52c8fea06 fix race in test_interface_detach_with_port_with_bandwidth_request
During port detach the unbind towards neutron happens before the
port allocation is removed from placement. The functional test only
waited for the port unbind before asserted the remaining allocations and
therefore it was racy.

Fortunately the instance.interface_detach.end is emitted after the both
the unbind and the allocation shrink. So the test is changed to wait for
this notification instead.

Change-Id: I53d76d6353ae634e387672e14943f518955b221e
Closes-Bug: #1819374
2019-03-11 15:38:29 +01:00
Takashi NATSUME 892ead1438 doc: Fix a typo
Replace 'listeing' with 'listening'.

TrivialFix
Change-Id: I0fe3b75c5005e3ca83b3e6bcc2998327595635ab
2019-03-11 17:45:25 +09:00
Michael Still 28f2baca02 Remove fake_libvirt_utils from the cache concurrency tests.
These tests weren't even calling libvirt.utils methods.

Change-Id: I2377e45dba8fdfaa2ef52be6738aafcba3fde705
2019-03-11 06:54:37 +00:00
Zuul f853e04cd2 Merge "Add online data migration for populating user_id" 2019-03-11 02:33:11 +00:00
Zuul b577b73555 Merge "Populate InstanceMapping.user_id during migrations and schedules" 2019-03-11 02:33:05 +00:00