Commit Graph

53533 Commits

Author SHA1 Message Date
Matt Riedemann 7ce265ebc5 Convert driver supported capabilities to compute node provider traits
This builds on the ProviderTree work in the compute driver and
resource tracker to take the supported capabilities from a driver and
turn those into standard traits on the compute node resource provider.

This is a simple way to expose in a REST API (Placement in this case)
what a compute node, via its driver, supports.

This is also something easy that we can do in lieu of a full-blown
compute capabilities REST API in nova, which we've talked about for
years but never actually done anything about.

We can later build on this to add a request filter which will mark
certain types of boot-from-volume requests as requiring specific
capabilities, like for volume multiattach and tagged devices.

Any traits provided by the driver will be automatically added during
startup or a periodic update of a compute node:

    https://pasteboard.co/I3iqqNm.jpg

Similarly any traits later retracted by the driver will be
automatically removed.

However any traits associated with capabilities which are
inappropriately added to or removed from the resource provider by the
admin via the Placement API will not be reverted until the compute
service's provider cache is reset.

The new call graph is shown in this sequence diagram:

    https://pasteboard.co/I25qICd.png

Co-Authored-By: Adam Spiers <aspiers@suse.com>

Related to blueprint placement-req-filter
Related to blueprint expose-host-capabilities

Change-Id: I15364d37fb7426f4eec00ca4eaf99bec50e964b6
2019-02-28 23:28:19 +00:00
Zuul a8c065dea9 Merge "ironic: partition compute services by conductor group" 2019-02-28 18:18:46 +00:00
Zuul 42d8118337 Merge "docs: ComputeDriver.update_provider_tree in nova" 2019-02-28 16:52:28 +00:00
Zuul 23444c26f8 Merge "conf: Call out where pci.alias should be set" 2019-02-28 15:35:46 +00:00
Zuul 4515913efa Merge "conf: Deprecated 'config_drive_format'" 2019-02-28 12:12:42 +00:00
Stephen Finucane b4ce2d9f12 conf: Call out where pci.alias should be set
We could probably do with a more concrete way to specify what services
use a given configuration value, but this is a start.

Change-Id: I23051a48754f2d43867ae9efc28691f766e6c6f3
2019-02-28 10:44:42 +00:00
Zuul 1948ce59c0 Merge "Use the correct mdev allocated from the pGPU" 2019-02-28 06:55:43 +00:00
Zuul eb93d0cffd Merge "Fix the api sample docs for microversion 2.68" 2019-02-27 20:31:22 +00:00
Zuul 9c024e45bb Merge "remove deprecated os_brick import from ScaleIO driver" 2019-02-27 18:42:49 +00:00
Zuul 3f1c3d286a Merge "Change LibvirtDriver.capabilities to an instance variable" 2019-02-27 18:33:37 +00:00
Zuul dc4de16784 Merge "Fup for the bandwidth series" 2019-02-27 17:13:04 +00:00
Jim Rollenhagen 2728dec51a ironic: partition compute services by conductor group
This uses ironic’s conductor group feature to limit the subset of nodes
which a nova-compute service will manage. This allows for partitioning
nova-compute services to a particular location (building, aisle, rack,
etc), and provides a way for operators to manage the failure domain of a
given nova-compute service.

This adds two config options to the [ironic] config group:
* partition_key: the key to match with the conductor_group property on
  ironic nodes to limit the subset of nodes which can be managed.
* peer_list: a list of other compute service hostnames which manage the
  same partition_key, used when building the hash ring.

Change-Id: I1b184ff37948dc403fe38874613cd4d870c644fd
Implements: blueprint ironic-conductor-groups
2019-02-27 15:57:36 +00:00
Surya Seetharaman ba48942c55 Fix the api sample docs for microversion 2.68
This patch adds the following files:

1) doc/api_samples/os-evacuate/v2.68/server-evacuate-find-host-req.json
2) doc/api_samples/os-evacuate/v2.68/server-evacuate-req.json

which were missing in https://review.openstack.org/#/c/634600/
so that the "tox -e api_samples" can run without errors.

Change-Id: I248b7e172698a9bee155e72215c231da9033540a
Closes-bug: #1817915
2019-02-27 16:25:16 +01:00
Balazs Gibizer 33644fbc8e Fup for the bandwidth series
This patch fixes comments in the following patches:
* Ie5ea45484a632da77c41bfe2613fa5f1dfbf19ea
* If8a13f74d2b3c99f05365eb49dcfa01d9042fefa
* Ia2e6a65690a1d7f89af0bc32fa8be30ca09472e2
* Ic28ffe9268cb7a94214b029af66ccf9af40a3a78

Change-Id: Ic11d4b002d21f1ddd321b452502e05b152f0ce09
blueprint: bandwidth-resource-provider
2019-02-27 10:23:15 +01:00
Zuul 6efa3861a5 Merge "Avoid BadRequest error log on volume attachment" 2019-02-27 05:13:20 +00:00
Zuul 1a155847a5 Merge "Mention SR-IOV cold migration limitation in admin docs" 2019-02-27 01:47:44 +00:00
Adam Spiers 3314e6bd9c Change LibvirtDriver.capabilities to an instance variable
Since at least one libvirt capability is already dynamic due to
depending on support being present in QEMU and libvirt, change the
LibvirtDriver.capabilities dictionary from a class variable to an
instance variable.  This prevents the risk of one test setting a
capability which bleeds over into other tests, in the same way it was
already done in the PowerVM driver:

    https://github.com/openstack/nova-powervm/commit/cc7564549a90a59f2ef27cca14862c33b9a07c25

Change-Id: Ic4c16b23834b43a258be5073e32bcdb9c0421f02
2019-02-26 22:34:54 +00:00
Zuul 563004fdac Merge "[Doc] Best practices for effectively tolerating down cells" 2019-02-26 17:36:04 +00:00
Zuul dd05291d45 Merge "Dump config options on wsgi startup earlier" 2019-02-26 17:16:24 +00:00
Surya Seetharaman 57eb9424b9 [Doc] Best practices for effectively tolerating down cells
Adds a section in the admin guide with the config options related to
down cells.

Related to blueprint handling-down-cell

Change-Id: I6a6cc71e83896aaccd5dd98bc2ea024d6f22d528
2019-02-26 15:54:49 +01:00
Zuul f7fd6cb58b Merge "quota: remove defaults kwarg in get_project_quotas" 2019-02-26 13:26:24 +00:00
Sylvain Bauza 2d00da78d5 Use the correct mdev allocated from the pGPU
In the next change in the series, we will use nested resource providers
for pGPUs. Accordingly, the allocation will be made on a child RP, not the
root RP.
This change aims to prepare this by allocating the right mediated device from the
same physical device.

Note that given we don't pass allocations when initializing the virt driver, in
case some mdevs are missing, we will recreate them blindly. Next change will
fix it.

Part of blueprint reshape-provider-tree
Part of blueprint vgpu-stein

Change-Id: Ia8f43199f70da9c5867acd9a76c43ca8c2c11c80
2019-02-26 14:06:20 +01:00
Yury Kulazhenkov b0ce5094ba remove deprecated os_brick import from ScaleIO driver
os_brick drops support for direct connector classes imports from
os_brick.initiator.connector module.
Remove such imports from ScaleIO driver tests.

Change-Id: I0f809069a46f0084b6ad779b27c88246f8ceef00
2019-02-26 11:24:18 +00:00
Zuul 33f367ec2f Merge "Move create_tap_dev into privsep." 2019-02-26 03:51:57 +00:00
Zuul 66da8b8bfe Merge "Create specialist set_macaddr_and_vlan helper." 2019-02-26 03:51:08 +00:00
Zuul 92d3f3a60a Merge "Add unit tests for missing VirtualInterface in 2.70 os-interface" 2019-02-26 01:37:58 +00:00
Zuul c7f0d160e4 Merge "Use placement.inventory.inuse in report client" 2019-02-25 22:47:34 +00:00
Zuul 7f6d01a5dc Merge "Test boot with more ports with bandwidth request" 2019-02-25 22:44:12 +00:00
Zuul cb580047f8 Merge "Send RP uuid in the port binding" 2019-02-25 22:43:56 +00:00
Zuul 29e5b0ad7b Merge "conf: Deprecated 'defer_iptables_apply'" 2019-02-25 21:13:03 +00:00
Zuul 7524a21527 Merge "quota: remove QuotaEngine.register_resources()" 2019-02-25 20:04:09 +00:00
Zuul 84a4cff928 Merge "Replace ansible --sudo with --become in live_migration/hooks scripts" 2019-02-25 18:36:50 +00:00
Zuul 21c6b2def7 Merge "api-ref: mark os-cells as deprecated" 2019-02-25 18:36:40 +00:00
Zuul 88aa23c353 Merge "Add microversion to expose virtual device tags" 2019-02-25 18:36:27 +00:00
Zuul 8e5ef12f9f Merge "Recalculate request group - RP mapping during re-schedule" 2019-02-25 18:36:17 +00:00
Zuul d45728f0bb Merge "Pass resource provider mapping to neutronv2 api" 2019-02-25 18:36:09 +00:00
Zuul d5bde60e56 Merge "Refactor "networks" processing in ServersController.create" 2019-02-25 16:25:31 +00:00
Matt Riedemann 0d4f3f41ee Add unit tests for missing VirtualInterface in 2.70 os-interface
This adds some simple unit tests for showing and listing attached
port interfaces where the corresponding VirtualInterface record
does not exist - which is possible for very old port attachments
since we started creating the VirtualInterface record for neutron
ports in the Newton release.

This is a follow up to I09420ff7134874dfe4dc399931c7740e81ecc2d0.

Part of blueprint expose-virtual-device-tags-in-rest-api

Change-Id: If14c4d6e97870de875b5dcd6bf68bd1b56ffad74
2019-02-25 10:57:37 -05:00
Stephen Finucane 5a00272043 conf: Deprecated 'defer_iptables_apply'
This is *mostly* used for nova-network and therefore can be deprecated.
There is one corner case where we could conceivably use this with
neutron and the libvirt driver, but it's only ever going to work with
with Linux bridge, is probably broken and should just be removed in
favour of neutron variants of this functionality. A note is included
detailing this, just in case people do want to spend the time getting to
the bottom of this, but I wouldn't recommend that.

The help text for this option is improved based on information I found
while researching the option and mostly taken from the commit message
for commit 8f1c54ce.

Change-Id: I33607453b3174192a33d9d56e203227bc9237f31
2019-02-25 15:51:39 +00:00
Zuul a90c8e1a35 Merge "Remove misleading code from _move_operation_alloc_request()" 2019-02-24 00:26:59 +00:00
Zuul 82da85b0a1 Merge "Log why rescheduling is disabled" 2019-02-24 00:13:46 +00:00
Zuul cfde2c8086 Merge "Cleanup return_reservation_id in ServersController.create" 2019-02-23 20:36:39 +00:00
Matt Riedemann 12d0d3a1cc Refactor "networks" processing in ServersController.create
In an effort to try and de-clutter the create() method this
change refactors the code that processes the "networks"
request parameter to a separate method.

Change-Id: I419336ea845bdd11d02ba098d8a6521a730906fd
2019-02-23 20:06:53 +00:00
Zuul 1f703a1719 Merge "Move finish_resize.(start|end) notifications to helper method" 2019-02-23 14:59:10 +00:00
Zuul 79cfd23dc2 Merge "Refactor bdm handling in ServersController.create method" 2019-02-23 14:59:02 +00:00
Zuul fdc973fcd4 Merge "Fix a typo in configuration description" 2019-02-23 14:58:54 +00:00
Zuul 991b2bde39 Merge "libvirt: Drop MIN_LIBVIRT_PARALLELS_SET_ADMIN_PASSWD" 2019-02-23 09:22:40 +00:00
Zuul ab3acd56b1 Merge "libvirt: Rewrite _create_pty_device() to be clearer" 2019-02-23 09:22:23 +00:00
Zuul 5852bae034 Merge "Fix race in test_volume_swap_server_with_error" 2019-02-23 06:33:07 +00:00
Zuul 8eac4a1fc3 Merge "Remove deprecated 'flavors' policy" 2019-02-23 06:13:00 +00:00