Commit Graph

52935 Commits

Author SHA1 Message Date
Zuul 99e7df0795 Merge "Remove placement perf check" 2018-12-08 04:56:56 +00:00
Zuul 06d5fee65a Merge "Add secret=true to fixed_key configuration parameter" 2018-12-08 03:38:15 +00:00
Zuul 4f6bc29659 Merge "Add functional regression test for bug 1806064" 2018-12-08 01:11:00 +00:00
Zuul 4d8baef8dc Merge "Update compute API.get() stubs in test_access_ips" 2018-12-07 14:49:46 +00:00
Zuul 8927a990f7 Merge "Update compute API.get() stubs for test_disk_config" 2018-12-07 14:49:37 +00:00
Zuul f41e4ff692 Merge "Update compute API.get() stubs for test_*security_groups" 2018-12-07 14:49:24 +00:00
Zuul 1554d35834 Merge "Use tempest [compute]/build_timeout in evacuate tests" 2018-12-07 13:39:37 +00:00
Zuul 152cdd6396 Merge "libvirt: Refactor handling of PCIe root ports" 2018-12-07 05:20:09 +00:00
Zuul 61cd9ccc45 Merge "Change the default values of XXX_allocation_ratio" 2018-12-06 23:44:42 +00:00
Zuul ff37d50c06 Merge "Remove ironic/pike note from *_allocation_ratio help" 2018-12-06 23:44:32 +00:00
Zuul c9dca64fa6 Merge "Delete NeutronLinuxBridgeInterfaceDriver" 2018-12-06 11:28:58 +00:00
Zuul 66a030528f Merge "Clean up cpu_shared_set config docs" 2018-12-06 11:28:53 +00:00
Zuul 363415a8a8 Merge "modify the avaliable link" 2018-12-06 07:41:34 +00:00
Zuul 6ddc903a41 Merge "Update mailinglist from dev to discuss" 2018-12-06 07:41:24 +00:00
Zuul aed3e24013 Merge "Add a bug tag for nova doc" 2018-12-05 17:59:27 +00:00
Matt Riedemann 3b1463b968 Use tempest [compute]/build_timeout in evacuate tests
Waiting 30 seconds for an evacuate to complete is not enough
time on some slower CI test nodes. This change uses the
same build timeout configuration from tempest to determine
the overall evacuate timeout in our evacuate tests.

Change-Id: Ie5935ae54d2cbf1a4272e93815ee5f67d3ffe2eb
Closes-Bug: #1806925
2018-12-05 10:46:06 -05:00
Zuul 5bf6f6304e Merge "Deprecate the nova-xvpvncproxy service" 2018-12-05 13:18:41 +00:00
Zuul e26ac8f24a Merge "Deprecate the nova-console service" 2018-12-05 13:05:06 +00:00
Zuul 3a8dd02c81 Merge "Always read-deleted=yes on lazy-load" 2018-12-05 10:54:45 +00:00
Zuul 4a688c3387 Merge "Remove utils.execute() calls from xenapi." 2018-12-05 03:21:24 +00:00
ZhongShengping ba0502182e Update mailinglist from dev to discuss
openstack-dev was decomissioned this night in https://review.openstack.org/621258
Update openstack-dev to openstack-discuss

Change-Id: If51f5d5eb710e06216f6d6981a70d70b6b5783cc
2018-12-05 09:44:35 +08:00
Zuul 5f648dda49 Merge "Refactor TestEvacuateDeleteServerRestartOriginalCompute" 2018-12-04 07:49:27 +00:00
Michael Still 38343cb1b2 Remove utils.execute() calls from xenapi.
They do not please me.

Change-Id: Ibe2f478288db42f8168b52dfc14d85ab92ace74b
2018-12-04 16:04:30 +11:00
Zuul 3ce9aa0192 Merge "Fix InstanceNotFound during _destroy_evacuated_instances" 2018-12-04 03:34:40 +00:00
Zuul 33c3759b85 Merge "SIGHUP n-cpu to clear provider tree cache" 2018-12-04 02:23:39 +00:00
David Hill 37a036672e Add secret=true to fixed_key configuration parameter
Add secret=true to fixed_key configuration parameter as that value
shouldn't be logged.

Change-Id: Ie6da21e8680b2deb6b1da3add31cd725ba855c1c
Closes-Bug: #1806471
2018-12-03 14:39:51 -05:00
Matt Riedemann 5d514b33e2 Add functional regression test for bug 1806064
Change I9269ffa2b80e48db96c622d0dc0817738854f602 in Pike
introduced a race condition where creating multiple
servers concurrently can fail the second instances quota
check which happens in conductor after the instance record
is created in the cell database but its related BDMs and
tags are not stored in the cell DB. When deleting the
server from the API, since the BDMs are not in the cell
database with the instance, they are not "seen" and thus
the volume attachments are not deleted and the volume is
orphaned. As for tags, you should be able to see the tags
on the server in ERROR status from the API before deleting
it.

This change adds a functional regression test to show both
the volume attachment and tag issue when we fail the quota
check in conductor.

Change-Id: I21c2189cc1de6b8e4857de77acd9f1ef8b6ea9f6
Related-Bug: #1806064
2018-12-03 12:55:11 -05:00
Michael Still 1e8c2c0dcb Fix sloppy initialization of the new disk ops semaphore.
Some tests weren't calling init_host, so the semaphore was None.
This caused the smoke to come out of nova's tests in ways that
would be less confusing if they'd failed during the testing of
the implementing patch.

Instead, set the semaphore to being unbounded, and then override
that later if the user has in fact specified a limit. This relies
on init_host being called very early, but that should be true
already.

Change-Id: If144be253f78b14cef60200a46aefc02c0e19ced
Closes-Bug: #1806123
2018-12-03 10:19:22 +11:00
Zuul 288c537fcd Merge "Revert "Add regression test for bug 1550919"" 2018-12-01 05:23:43 +00:00
Zuul 3c4018d37d Merge "Fix misuse of assertTrue" 2018-12-01 05:07:18 +00:00
Matt Riedemann 90d16c270a Revert "Add regression test for bug 1550919"
This reverts commit bbe88786fc.

The new tests are racy and causing a modest amount of
failures in the gate since the change merged, so it is
probably best to just revert the tests so they can be
robustified.

Change-Id: I18bd68ba6e59aba4c450eb85e6f4450d7044b1e9
Related-Bug: #1806126
2018-11-30 21:15:33 +00:00
Chris Dent 84182d0aa2 Remove placement perf check
gate/post_test_perf_check.sh did some simplistic performance testing of
placement. With the extraction of placement we want it to happen during
openstack/placement CI changes so we remove it here.

The depends-on is to the placement change that turns it on there, using
an independent (and very small) job.

Depends-On: I93875e3ce1f77fdb237e339b7b3e38abe3dad8f7
Change-Id: I30a7bc9a0148fd3ed15ddd997d8dab11e4fb1fe1
2018-11-30 15:12:48 +00:00
Zuul 8446a1e58d Merge "Add I/O Semaphore to limit concurrent disk ops" 2018-11-30 03:25:18 +00:00
Eric Fried bbc2fcb8fb SIGHUP n-cpu to clear provider tree cache
An earlier change [1] allowed
[compute]resource_provider_association_refresh to be set to zero to
disable the resource tracker's periodic refresh of its local copy of
provider traits and aggregates. To allow for out-of-band changes to
placement (e.g. via the CLI) to be picked up by the resource tracker in
this configuration (or a configuration where the timer is set to a high
value) this change clears the provider tree cache when SIGHUP is sent to
the compute service. The next periodic will repopulate it afresh from
placement.

[1] Iec33e656491848b26686fbf6fb5db4a4c94b9ea8

Change-Id: I65a7ee565ca5b3ec6c33a2fd9e39d461f7d90ed2
2018-11-29 15:42:08 -06:00
Kashyap Chamarthy b65246ab4d libvirt: Refactor handling of PCIe root ports
Add a separate method, _guest_needs_pcie(), to check for the
prerequisites for adding PCIe root port entries.  And simplify the
monster 'if' conditional into multiple readable ones.

While at it, add a TODO note about an assumption (which can become
invalid in the future) we're making about QEMU machine types.

Change-Id: I05c9168569c4c3eeeb83695a053b2fd94240157c
Suggested-by: Andrea Bolognani <abologna@redhat.com>
Signed-off-by: Kashyap Chamarthy <kchamart@redhat.com>
2018-11-29 11:09:06 +01:00
Takashi NATSUME 96b5ef3456 Fix misuse of assertTrue
If the first argument of assertTrue is True,
the assertion is always passed.
Fix it because it is useless.

Change-Id: Ie954fc770c61956a80d472190e97646a39b7420f
Closes-Bug: #1805800
2018-11-29 09:52:19 +00:00
Eric Fried 8c318d0fb2 Remove get_node_uuid
get_node_uuid was added in [1] and it was used [2], but that code was
removed in Stein [3].

[1] I982b211e0315bdb9a816f346fafffd0f70e46d07
[2] https://github.com/openstack/nova/blob/76136bfb01076da37351aaf11751dd557cb97ca4/nova/compute/manager.py#L3939
[3] I0851e2d54a1fdc82fe3291fb7e286e790f121e92

Change-Id: I3cd3565b6651677552d8a27c9f7054b0322055fb
2018-11-28 16:24:05 -06:00
Zuul 3b2e42f371 Merge "Give drop_move_claim() correct docstring" 2018-11-28 18:50:50 +00:00
Yikun Jiang 212eff600a Change the default values of XXX_allocation_ratio
This patch including 2 changes:
1. Change the default values for
CONF.(cpu|ram|disk)_allocation_ratio to ``None``

2. Change the resource tracker to overwrite the compute node's
allocations ratios to the value of the XXX_allocation_ratio if
the value of these options is NOT ``None`` or ``0.0``.

The "0.0" condition is for upgrade impact, and it will be
removed in the next version (T version).

Change-Id: I6893d63dc5f29bc2eb348fe0aa9fbc8490e6eb40
blueprint: initial-allocation-ratios
2018-11-28 16:30:14 +08:00
Zuul 62245235bc Merge "Add regression test for bug 1550919" 2018-11-28 00:05:06 +00:00
Dan Smith 604819b29c Always read-deleted=yes on lazy-load
For some reason we were only reading deleted instances when loading generic
fields and not things like flavor. That weird behavior isn't very helpful,
so this makes us always read deleted for that case. Some of the fields, like
tags, will short-circuit that and just immediately lazy-load an empty set.
But for anything else, we should allow reading that data if it's still there.

With this change, we are able to remove a specific read_deleted='yes' usage
from ComputeManager._destroy_evacuated_instances() which is handled with
the generic solution. TestEvacuateDeleteServerRestartOriginalCompute asserts
that the evacuate scenario is still fixed.

Related-Bug: #1794996
Related-Bug: #1745977

Change-Id: I8ec3a3a697e55941ee447d0b52d29785717e4bf0
2018-11-27 12:42:48 -05:00
Matt Riedemann 92dbeae1d4 Refactor TestEvacuateDeleteServerRestartOriginalCompute
This moves _check_allocation_during_evacuate into the
ProviderUsageBaseTestCase base class and drops the
overridden methods from TestEvacuateDeleteServerRestartOriginalCompute.

Change-Id: I6a084031c1d3ffa72b09d2194c44cdd80cc875fa
2018-11-27 12:42:48 -05:00
Matt Riedemann 05cd8d1282 Fix InstanceNotFound during _destroy_evacuated_instances
The _destroy_evacuated_instances method on compute
startup tries to cleanup guests on the hypervisor and
allocations held against that compute node resource
provider by evacuated instances, but doesn't take into
account that those evacuated instances could have been
deleted in the meantime which leads to a lazy-load
InstanceNotFound error that kills the startup of the
compute service.

This change does two things in the _destroy_evacuated_instances
method:

1. Loads the evacuated instances with a read_deleted='yes'
   context when calling _get_instances_on_driver(). This
   should be fine since _get_instances_on_driver() is already
   returning deleted instances anyway (InstanceList.get_by_filters
   defaults to read deleted instances unless the filters tell
   it otherwise - which we don't in this case). This is needed
   so that things like driver.destroy() don't raise
   InstanceNotFound while lazy-loading fields on the instance.

2. Skips the call to remove_allocation_from_compute() if the
   evacuated instance is already deleted. If the instance is
   already deleted, its allocations should have been cleaned
   up by its hosting compute service (or the API).

The functional regression test is updated to show the bug is
now fixed.

Change-Id: I1f4b3540dd453650f94333b36d7504ba164192f7
Closes-Bug: #1794996
2018-11-27 12:42:48 -05:00
Artom Lifshitz 3e32e76d83 Give drop_move_claim() correct docstring
Previously, there was a just a comment about removing usage on the
destination node. This is incorrect: usage is removed on the compute
host specified by the nodename parameter to the method. This patch
corrects this in a proper docstring.

Change-Id: I2f676966136a78bb9600626852584f838cb08c5b
2018-11-26 19:34:09 -05:00
zhufl 8545ba2af7 Add missing ws seperator between words
This is to add missing ws seperator between words, usually
in log messages.

Change-Id: I71bf4c5b5be4dbc89a28bf243b7d11cf1d612ab4
2018-11-26 23:42:18 +00:00
Zuul c1de096098 Merge "Add debug logs when doubling-up allocations during scheduling" 2018-11-26 22:14:06 +00:00
Matt Riedemann 5d536b0d3a Remove ironic/pike note from *_allocation_ratio help
The note in the cpu/ram/disk allocation ratio config
option help was referring to commit e7840cdf1 from Pike
when the ironic driver reported allocation_ratio=1.0
for VCPU/MEMORY_MB/DISK_GB resource inventory.

That code was removed in commit a985e34cd so we can
remove the related note from the config option help as
it no longer applies.

Change-Id: Ifd9dba0c24fde25d54761077c1374313019af1d8
2018-11-26 15:56:58 -05:00
Takashi NATSUME 168704349b Add a bug tag for nova doc
Add a default bug tag for nova doc in doc/source/conf.py.
The 'doc' tag(*) should be set for document bug
in bug reports by default.

*: https://wiki.openstack.org/wiki/Nova/BugTriage#Tag_Owner_List

TrivialFix
Change-Id: Ib2de207d368d248464770fd0a9452e325f0a0596
2018-11-26 04:10:44 +00:00
Zuul 594c653dc1 Merge "Add HPET timer support for x86 guests" 2018-11-24 16:50:57 +00:00
Zuul 1a1ea8e2aa Merge "Use long_rpc_timeout in select_destinations RPC call" 2018-11-21 23:51:14 +00:00