Commit Graph

1652 Commits

Author SHA1 Message Date
naichuans 2dbe8d2cba XenAPI: update the document related to vdi streaming
non-FS based Storage Repository will be supported after vdi streaming
patches finished. Remove SR limitation in the document.

Change-Id: Idaf461c849ac28b46e8971e5dd2f0e986a9a5c32
2018-06-13 02:00:31 +00:00
jianghua wang f7593ded8f XenAPI: define a new image handler to use vdi streaming
With the new image handler, it creates an image proxy which
will use the vdi streaming function from os-xenapi to
remotely export VHD from XenServer(image upload) or import
VHD to Xenerver(image download).
The existing GlanceStore uses custom functionality to directly
manipulate files on-disk, so it has the restriction that SR's
type must be file system based: e.g. ext or nfs. The new
image handler invokes APIs formally supported by XenServer
to export/import VDI remotely, it can support other SR
types also e.g. lvm, iscsi, etc.

Note:
vdi streaming would be supported by XenServer 6.5 or above.
The function of image handler depends on os-xenapi 0.3.3 or
above, so bump os-xenapi's version to 0.3.3 and also declare
depends on the patch which bump version in openstack/requirements.

Blueprint: xenapi-image-handler-option-improvement
Change-Id: I0ad8e34808401ace9b85e1b937a542f4c4e61690
Depends-On: Ib8bc0f837c55839dc85df1d1f0c76b320b9d97b8
2018-06-13 01:59:07 +00:00
jichen e3c5bd43cc doc follow https://review.openstack.org/#/c/572195
some doc need to be updated as well.

Change-Id: Id69535f2f520db074b9171aaf68d8d6f7fc1c9be
2018-06-11 15:06:33 +08:00
Zuul b31b94d64a Merge "Fix bug to doc:nova-status" 2018-06-07 21:26:38 +00:00
Zuul daff899966 Merge "Fix issues in nova-show-usage-statistics-for-hosts-instances.rst" 2018-06-07 21:26:31 +00:00
tianhui 98c503337a Fix bug to doc:nova-status
There is a wrong format in the doc and correct it

Change-Id: Ib171ca43e648a02c933f0cbefe6ca2186b2794ef
2018-06-07 19:37:18 +08:00
Zuul f7e6d721f5 Merge "Change consecutive build failure limit to a weigher" 2018-06-07 05:22:20 +00:00
Chen 6027b33425 Fix issues in nova-show-usage-statistics-for-hosts-instances.rst
1. url for `Ceilometer` doc is not correct
2. nova-cert has been removed
   (change I2c78a0c6599b92040146cf9f0042cff8fd2509c3)
   and should no appear in the example
3. phrasing issue in explanation for "used_now" of host resource
   usage
4. 'opensack server list' repsonse is different from that of 'nova list'
5. add info about diagnostic statistics format


Change-Id: I6a2a7b396fee2a5cbae633d5c259f5f0961b9b60
2018-06-07 03:48:34 +00:00
Dan Smith 91e29079a0 Change consecutive build failure limit to a weigher
There is concern over the ability for compute nodes to reasonably
determine which events should count against its consecutive build
failures. Since the compute may erronenously disable itself in
response to mundane or otherwise intentional user-triggered events,
this patch adds a scheduler weigher that considers the build failure
counter and can negatively weigh hosts with recent failures. This
avoids taking computes fully out of rotation, rather treating them as
less likely to be picked for a subsequent scheduling
operation.

This introduces a new conf option to control this weight. The default
is set high to maintain the existing behavior of picking nodes that
are not experiencing high failure rates, and resetting the counter as
soon as a single successful build occurs. This is minimal visible
change from the existing behavior with default configuration.

The rationale behind the default value for this weigher comes from the
values likely to be generated by its peer weighers. The RAM and Disk
weighers will increase the score by number of available megabytes of
memory (range in thousands) and disk (range in millions). The default
value of 1000000 for the build failure weigher will cause competing
nodes with similar amounts of available disk and a small (less than ten)
number of failures to become less desirable than those without, even
with many terabytes of available disk.

Change-Id: I71c56fe770f8c3f66db97fa542fdfdf2b9865fb8
Related-Bug: #1742102
2018-06-06 15:18:50 -07:00
Zuul 2d3b204d38 Merge "Add contributor docs on deprecating and removing compute REST APIs" 2018-06-06 21:01:04 +00:00
Zuul 07652b8bab Merge "Add nova-manage placement heal_allocations CLI" 2018-06-06 20:32:18 +00:00
Zuul 0f80b76e7e Merge "Fix doc nit" 2018-06-06 16:02:19 +00:00
Zuul e6f8349a72 Merge "Fix some inconsistencies in doc" 2018-06-06 08:48:34 +00:00
jichen 47423dfb7f Fix doc nit
use openstack hypervisor list instead nova hypervisor-list
to sync with sample given

Change-Id: Ib2224d317745738dd0bde62ac832d8308b369164
2018-06-06 14:52:36 +08:00
Zuul e093eea01d Merge "Fix some wrong urls in doc" 2018-06-05 23:01:15 +00:00
tianhui 098051d224 Fix some wrong urls in doc
The url in the doc is wrong and need change it to the correct

Change-Id: Ifd56d5b9f4e111997779e633b0f484f3cb08e421
2018-06-05 08:39:33 +00:00
tianhui dd713a04ff Fix bug to doc
There is a wrong url in the doc and turn it right

Change-Id: I0af13090525ca7c2f1fd6e7d3cc3c7c578d398f7
2018-06-05 14:44:17 +08:00
tianhui 8fce9f474b Fix bug for hypervisors
There are some wrong formats in the doc, it causes a wrong url.

Change-Id: Id85ec752bccec462936346ae546c8069242f20e8
2018-06-05 09:30:46 +08:00
Chen 900558dc42 Fix some inconsistencies in doc
It's more common to format words like "nova-compute" with "``"
instead of "`", and there is no need to format words like "RPC".
This patch also fixes a few syntax and typo issues.

And as requested, some typos in aggregates.rst are corrected to
improve readability.

Change-Id: I4d9c184e1448c8ea9973302f53e1773a7b66cd1e
2018-06-04 21:41:07 +08:00
Matt Riedemann 95106d2fa1 Add nova-manage placement heal_allocations CLI
This adds a new CLI which will iterate all non-cell0
cells looking for instances that (1) have a host,
(2) aren't undergoing a task state transition and
(3) don't have allocations in placement and try
to allocate resources, based on the instance embedded
flavor, against the compute node resource provider
on which the instance is currently running.

This is meant as a way to help migrate CachingScheduler
users off the CachingScheduler by first shoring up
instance allocations in placement for any instances
created after Pike, when the nova-compute resource
tracker code stopped creating allocations in placement
since the FilterScheduler does it at the time of
scheduling (but the CachingScheduler doesn't).

This will be useful beyond just getting deployments
off the CachingScheduler, however, since operators
will be able to use it to fix incorrect allocations
resulting from failed operations.

There are several TODOs and NOTEs inline about things
we could build on top of this or improve, but for now
this is the basic idea.

Change-Id: Iab67fd56ab4845f8ee19ca36e7353730638efb21
2018-06-01 18:45:10 -04:00
Zuul 40a0b579c4 Merge "Implement granular policy rules for placement" 2018-06-01 21:06:42 +00:00
Zuul 8247c50708 Merge "libvirt: place emulator threads on CONF.compute.cpu_shared_set" 2018-06-01 17:25:12 +00:00
Zuul 54da5bc683 Merge "metadata: add vf_trusted field to device metadata" 2018-06-01 12:16:05 +00:00
Zuul b30a34a8b6 Merge "PowerVM Driver: vSCSI Fibre Channel volume adapter" 2018-05-31 20:46:45 +00:00
Sahid Orentino Ferdjaoui f9ddddc358 metadata: add vf_trusted field to device metadata
The trusted vf attribute will be exposed to the instance through the
metadata API and on the config drive.

Note the logic when dealing with NetworkInterfaceMetadata devices was
refactored slightly in order to handle the existing cases where these
types of devices are skipped.

Implements blueprint sriov-trusted-vfs
Change-Id: Icbac4f11b2383b3d8295ec3362db0fc60b9c35a9
Signed-off-by: Sahid Orentino Ferdjaoui <sahid.ferdjaoui@redhat.com>
2018-05-31 13:55:10 -04:00
Zuul dd87118acc Merge "mirror nova host aggregate members to placement" 2018-05-31 00:45:41 +00:00
Jay Pipes 5eda1fab85 mirror nova host aggregate members to placement
This patch is the first step in syncing the nova host aggregate
information with the placement service. The scheduler report client gets
a couple new public methods -- aggregate_add_host() and
aggregate_remove_host(). Both of these methods do **NOT** impact the
provider tree cache that the scheduler reportclient keeps when
instantiated inside the compute resource tracker.

Instead, these two new reportclient methods look up a resource provider
by *name* (not UUID) since that is what is supplied by the
os-aggregates Compute API when adding or removing a "host" to/from a
nova host aggregate.

Change-Id: Ibd7aa4f8c4ea787774becece324d9051521c44b6
blueprint: placement-mirror-host-aggregates
2018-05-30 12:45:20 -04:00
Zuul d741f624c8 Merge "doc: Start using openstackdoctheme's extlink extension" 2018-05-30 15:21:12 +00:00
Zuul 465051809c Merge "doc: Don't use single backticks in man pages" 2018-05-30 13:41:50 +00:00
smartu3 c0c2cbfe51 Fix doc mistakes
Change-Id: I8000aa98e09f8eea382f85fff9c2431b9390502b
2018-05-29 18:44:35 +08:00
Zuul e2b0b469be Merge "Honor availability_zone hint via placement" 2018-05-24 06:54:56 +00:00
esberglu e997ca68b3 PowerVM Driver: vSCSI Fibre Channel volume adapter
This change adds vSCSI Fibre Channel volume support via cinder for the
PowerVM virt driver. Attach, detach, and extend are the supported
volume operations by the PowerVM vSCSI FC adapter. PowerVM CI volume
tests are run on-demand only which can be done by leaving a comment
with "powervm:volume-check".

Blueprint: powervm-vscsi
Change-Id: I632993abe70f9f98a032a35891b690db15ded6a0
2018-05-22 11:39:32 -05:00
Dan Smith 96f1071166 Honor availability_zone hint via placement
This adds a request filter that, if enabled, allows us to use placement
to select hosts in the desired availability zone by looking up the uuid
of the associated host aggregate and using that in our query for
allocation candidates. The deployer needs the same sort of mirrored
aggregate setup as the tenant filter, and documentation is added here to
make that clear.

Related to blueprint placement-req-filter

Change-Id: I7eb6de435e10793f5445724d847a8f1bf25ec6e3
2018-05-22 08:56:50 -07:00
Zuul 6bc136efcc Merge "Update placement upgrade docs for nova-api dependency on placement" 2018-05-19 01:55:38 +00:00
Zuul 777182c742 Merge "Update nova-status and docs for required placement 1.24" 2018-05-19 01:55:33 +00:00
Matt Riedemann 3abd5f5797 Update placement upgrade docs for nova-api dependency on placement
Change If507e23f0b7e5fa417041c3870d77786498f741d makes nova-api
dependent on placement for deleting an instance when the nova-compute
service on which that instance is running is down, also known as
"local delete".

Change I7b8622b178d5043ed1556d7bdceaf60f47e5ac80 makes nova-api
dependent on placement for deleting a nova-compute service record.

Both changes are idempotent if nova-api isn't configured to use
placement, but warnings will show up in the logs.

This change updates the upgrade docs to mention the new dependency.

Change-Id: I941a8f4b321e4c90a45f7d9fccb74489fae0d62d
Related-Bug: #1679750
Related-Bug: #1756179
2018-05-18 23:06:43 +00:00
Matthew Edmonds 30c87c5a9d Update PowerVM hypervisor docs
This refreshes the PowerVM hypervisor docs with a clearer flow and
additional information.

Change-Id: I0b33200b710960e4e8df7333d06c98456c4b0c00
2018-05-18 22:00:22 +00:00
Matt Riedemann 216e232def Update nova-status and docs for required placement 1.24
Change Id7eecbfe53f3a973d828122cf0149b2e10b8833f made
nova-scheduler require placement >= 1.24 so this change
updates the minimum required version checked in the
nova-status upgrade check command along with the upgrade
docs.

Change-Id: I4369f7fb1453e896864222fa407437982be8f6b5
2018-05-18 21:46:25 +00:00
esberglu 026c2a61d0 PowerVM Driver: Localdisk
Add PowerVM Driver support for local ephemeral disk.

Change-Id: I9251287451bc2f800ef4a230c3c01598f37b5ad3
Blueprint: powervm-localdisk
2018-05-18 21:38:09 +00:00
Zuul 0f70337718 Merge "Fix typo in NUMATopologyFilter docs" 2018-05-18 18:18:18 +00:00
Zuul c8fd5ce108 Merge "Fix inconsistency in docs" 2018-05-18 16:30:51 +00:00
chenxing d163fb6d69 Update the deprecate os_region_name option
Option "os_region_name" from group "placement" is deprecated. Use
option "region_name" from group "placement".

Change-Id: Id44d456bb1bdb0c5564ad4f5d9cdee2f41226052
Related-Bug: #1762106
2018-05-18 15:35:31 +00:00
Sahid Orentino Ferdjaoui 9724ec118b libvirt: place emulator threads on CONF.compute.cpu_shared_set
Some workloads run best when the hypervisor overhead processes
(emulator threads in libvirt/QEMU) can be placed on different physical
host CPUs than other guest CPU resources. This allows those workloads
to prevent latency spikes for guest vCPU threads.

To ensure emulator threads are placed on a different set of physical
CPUs than those running guest dedicated vCPUs, set the
``CONF.compute.cpu_shared_set`` configuration option to the set of host
CPUs that should be used for best-effort CPU resources. Then set a
flavor extra spec to ``hw:emulator_threads_policy=share`` to instruct
nova to place that workload's emulator threads on that set of host CPUs.

implement: bp/overhead-pin-set
Signed-off-by: Sahid Orentino Ferdjaoui <sahid.ferdjaoui@redhat.com>
Change-Id: I0e63ab37d584ee3d7fde6553efaa61bfc866e67d
2018-05-18 08:52:25 +00:00
Robin Naundorf dd1dea22f2 Fix inconsistency in docs
* Make the `True` lowercase to reflect examples in config and
    other parameters in docs

TrivialFix

Change-Id: I259d36bc15e034c248ec39b2c5c97ff95986b31b
2018-05-18 09:37:02 +02:00
Zuul de52fefa1f Merge "Deduplicate config/policy reference docs from main index" 2018-05-17 20:07:09 +00:00
Matt Riedemann 0a461979df Implement granular policy rules for placement
This adds a granular policy checking framework for
placement based on nova.policy but with a lot of
the legacy cruft removed, like the is_admin and
context_is_admin rules.

A new PlacementPolicyFixture is added along with
a new configuration option, [placement]/policy_file,
which is needed because the default policy file
that gets used in config is from [oslo_policy]/policy_file
which is being used as the nova policy file. As
far as I can tell, oslo.policy doesn't allow for
multiple policy files with different names unless
I'm misunderstanding how the policy_dirs option works.

With these changes, we can have something like:

  /etc/nova/policy.json - for nova policy rules
  /etc/nova/placement-policy.yaml - for placement rules

The docs are also updated to include the placement
policy sample along with a tox builder for the sample.

This starts by adding granular rules for CRUD operations
on the /resource_providers and /resource_providers/{uuid}
routes which use the same descriptions from the placement
API reference. Subsequent patches will add new granular
rules for the other routes.

Part of blueprint granular-placement-policy

Change-Id: I17573f5210314341c332fdcb1ce462a989c21940
2018-05-17 11:12:16 -04:00
Matt Riedemann ccc02de36c Deduplicate config/policy reference docs from main index
The top level index (home page) was duplicating the
configuration/index content, so this simply changes
the home page into a table of contents for the configuration
sub-tree and leaves the config/policy content in the
sub-tree. This will be needed when we add docs about
placement policy.

The hidden configuration toc tree items are moved
into the sub-tree configuration/index to be closer
to the actual documents we're hiding from the toc tree.

Related to blueprint granular-placement-policy

Change-Id: Iad87dc339278ee7e7cf8de5eea252bbb7a5f75c2
2018-05-17 11:11:25 -04:00
Takashi NATSUME 18a018033c Fix auth_url example in hypervisor-hyper-v.rst
The url path should be 'v3' instead of 'v3.0'
in the 'auth_url'.

TrivialFix
Change-Id: I91528d61bbadc1b30c27985de9511e51ad71e771
2018-05-17 08:30:42 +09:00
Zuul 18332d0353 Merge "PowerVM Driver: Snapshot" 2018-05-16 15:47:19 +00:00
caoyuan 17105cce3a Update auth_url in install docs
1. Beginning with the Queens release, the keystone install guide
recommends running all interfaces on the same port. This patch
updates the install guide to reflect that change.
2. update the deprecated neutron auth options

Change-Id: I5c0a6389b759153bae06fa43846f03ac083c3db4
2018-05-15 13:06:07 +00:00