Commit Graph

51937 Commits

Author SHA1 Message Date
Chen d12449a91b Update ssh configuration doc
The main idea of this update is to make the configuration process
easier to read and follow.

Change-Id: I73cf811415900eaf99673de16f83ea7c9da16045
2018-08-09 10:37:19 +08:00
Zuul 372f624893 Merge "Delete orphan compute nodes before updating resources" 2018-08-01 01:41:40 +00:00
Zuul c90553b388 Merge "libvirt: Remove usage of migrateToURI{2} APIs" 2018-08-01 01:27:16 +00:00
Zuul 2cdc622799 Merge "Delete checking a bool opt of None condition" 2018-08-01 01:22:21 +00:00
Zuul 882a66427c Merge "Remove unnecessary PlacementFixture setups" 2018-07-31 23:00:34 +00:00
Zuul 5164517ce7 Merge "Don't poison Host._init_events if it's already mocked" 2018-07-31 18:28:54 +00:00
Zuul c90d6101f4 Merge "Remove redundant join in _anchors_for_sharing_providers" 2018-07-31 18:28:39 +00:00
Zuul 4456da5ad7 Merge "[placement] Retry allocation writes server side" 2018-07-31 18:28:30 +00:00
Kashyap Chamarthy 4b3e877210 libvirt: Remove usage of migrateToURI{2} APIs
The recently updated minimum required libvirt version (1.3.1; in commit
403320b -- libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION for "Rocky") brings
in the newer libvirt migration API, migrateToURI3().  The newer API was
explicitly designed[*] to be backward compatible with the older variant.

So remove the usage of the older variants:

    migrateToURI()
    migrateToURI2()

And just stick to the newer API -- migrateToURI3().

Clean up the following:

 - Add the 'migrate_disks' and 'destination_xml' paramters, and remove
   the no longer needed 'domain_xml' from the Nova migrate() method.

 - Remove or fix various unit tests to use migrateToURI3().

 - Stub nova.virt.libvirt.guest.Guest.migrate() correctly in
   nova/tests/unit/virt/test_virt_drivers.py.

[*] https://libvirt.org/git/?p=libvirt.git;a=commit;h=4bf62f4 --
    Extensible migration APIs

Change-Id: Id9ee1feeadf612fa79c3d280cee3a614a74a00a7
Signed-off-by: Kashyap Chamarthy <kchamart@redhat.com>
2018-07-31 18:57:28 +02:00
Zuul 7b3a90f545 Merge "[placement] api-ref: add traits parameter" 2018-07-31 15:13:22 +00:00
Zuul 965eb3ff9a Merge "Fix formatting for vcpu_pin_set and reserved_huge_pages" 2018-07-31 15:13:14 +00:00
Zuul 2d0f0c64e9 Merge "Remove superfluous network stubbing in func test" 2018-07-31 14:54:39 +00:00
Balazs Gibizer 06e854bc0c Remove unnecessary PlacementFixture setups
The _IntegratedTestBase functional test base class sets up the
PlacementFixture unconditionally so the deriver test class doesn't need
to do that. This patch removes the extra setups.

Change-Id: I68b939f09fdecc59ccd258595a9b80e6f42a5df1
2018-07-31 16:31:59 +02:00
Matthew Booth 2c9fe11e8d Don't poison Host._init_events if it's already mocked
PoisonFunctions poisons Host._init_events without checking if it's
already mocked. This creates a proper headscratcher when you try to
use FakeLibvirtFixture with ServersTestBase: if you use
FakeLibvirtFixture before calling super.setUp() PoisonFunctions will
poison the function we already mocked, if we call it in the other
order setUp() will fail when it tries to start nova-compute.

Change-Id: I6d8214c75a67c87ec5a7406f3cc2e8b923aa4d84
2018-07-31 12:17:15 +00:00
Zuul 03ccb1f933 Merge "Update install guide for placement database configuration" 2018-07-31 10:32:49 +00:00
Zuul 7f9cdb5d6d Merge "Fix being able to hard reboot a pausing instance" 2018-07-31 10:32:41 +00:00
Yikun Jiang 1c66a4b029 Remove redundant join in _anchors_for_sharing_providers
There is a redundant join when we want to get id from
_anchors_for_sharing_providers. The last outerjoin is used to get the
rp.UUID according rp.id, if we set get_id=True, we no longer need this
outer join.

So, we remove the redundant join in this patch.

Change-Id: Ib5fc6e4efae29dd88ce92df834700d2121ed8076
Closes-bug: #1784604
2018-07-31 18:27:39 +08:00
Chris Dent 72e4c4c8d7 [placement] Retry allocation writes server side
This change adds a fast retry loop around
AllocationList._set_allocations if a resource provider generation
conflict happens. It turns out that under high concurrency of allocation
claims being made on the same resource provider conflicts can be quite
common and client side retries are insufficient.

Because both consumer generation and resource provider generations had
raised the same exception there was no way to distinguish between the
two so a child of ConcurrentUpdateDetected has been created as
ResourceProviderConcurrentUpdateDetected. In the future this will allow
us to send different error codes to the client as well, but that change
is not done here.

When the conflict is detected, all the resource providers in the
AllocationList are reloaded and the list objects refreshed.

Logging is provided to indicate:

* at debug that a retry is going to happen
* at warning that all the retries failed and the client is going to
  see the conflict

The tests for this are a bit funky: Some mocks are used to cause the
conflicts, then the real actions after a couple of iterations.

Change-Id: Id614d609fc8f3ed2d2ff29a2b52143f53b3b1b9a
Closes-Bug: #1719933
2018-07-31 10:57:16 +01:00
Takashi NATSUME cc7d5f836f [placement] api-ref: add traits parameter
In the "List allocation candidates" API,
the 'traits' parameter is missing.
So add it and update examples.

Change-Id: I4a307759f9e8fa80d003d92142f8e99b2c09c9fe
Partial-Bug: #1778670
2018-07-31 14:36:44 +09:00
Zuul 3ce7fa51e9 Merge "Set default of oslo.privsep.daemon logging to INFO level" 2018-07-31 02:01:17 +00:00
Zuul f6ce98749a Merge "Retry decorator fix for instances which go into ERROR state during bulk delete" 2018-07-31 01:20:01 +00:00
Zuul 4370aa9c5e Merge "Updated AggregateImagePropertiesIsolation filter illustration" 2018-07-30 21:21:53 +00:00
MultipleCrashes c6dda9f806 Retry decorator fix for instances which go into ERROR state during bulk delete
During bulk delete, some of the machines go into ERROR state
rather than being deleted. This happens once in a while during
deletion of huge number of machines concurrently. The failure occurs
during deallocation of network. At a later point in time the ERROR
state gets cleared if the user deletes the instance manually later
on. This fix proposes for retries for certain number of
time with variable delay to allow proper deallocation of network.

Change-Id: I32212b4d8180e947fdc958449aebd822f50e97fd
Closes-Bug: #1765942
2018-07-30 16:56:47 -04:00
Zuul 849ccb4bc5 Merge "Add description for placement 1.26" 2018-07-30 20:53:52 +00:00
Matt Riedemann f53d28f9be Fix formatting for vcpu_pin_set and reserved_huge_pages
This just fixes the rst formatting for the help on
each option. I'm sure there are tons more like this,
but this change isn't an attempt to fix all of the
formatting issues in our config options.

Change-Id: If52cbfc44234ce94427bd2ba78b79270c3a873d3
2018-07-30 15:36:00 -04:00
karimull a9083d13b0 Updated AggregateImagePropertiesIsolation filter illustration
The example given in this section was not matching the explanation
of how the filter works.
Updated the example with right properties and aggregate name

Change-Id: Ieadeb0d736cc83a41093e6f4dfeb75d2396976ec
Closes-Bug: #1684261
2018-07-30 12:31:35 -07:00
Zuul d7a87fad35 Merge "Add additional functional tests for NUMA networks" 2018-07-30 17:55:13 +00:00
Dan Smith 86a8aac0d7 Set default of oslo.privsep.daemon logging to INFO level
This avoids us logging the output of potentially-sensitive operations
performed with privilege.

Change-Id: I706fbd883f7640bebb3ba0b5848b863a157a9794
Closes-Bug: #1784062
2018-07-30 17:06:10 +00:00
Balazs Gibizer 25b3e2d69b Remove superfluous network stubbing in func test
The fake_network.set_stub_network_methods has been called in
ServersTestBase.setUp() and then in the derived test class
NUMAServersTest._run_build_test() method. The second call is
not needed.

Change-Id: I68d5b062c6963a37a30e0cd7520f658b1fbccd12
2018-07-30 18:40:32 +02:00
Zuul 3c6f0eb49e Merge "tox: Reuse envdirs" 2018-07-30 15:02:21 +00:00
Stephen Finucane 45662d77a2 Add additional functional tests for NUMA networks
Cover the move and move-like operations through cold migration and
rebuild tests. This requires extensive filling of gaps in the
NeutronFixture and fake libvirt driver.

Part of blueprint numa-aware-vswitches

Change-Id: I18acbda74dd8ac4e9a5d439f1393765a9a6a60f3
Co-Authored-By: Sean Mooney <work@seanmooney.info>
Co-Authored-By: Dan Smith <dms@danplanet.com>
2018-07-30 07:46:57 -07:00
Takashi NATSUME eec172a017 Add description for placement 1.26
Add description for placement microversion 1.26
in the following APIs in the placement API reference.

* PUT /resource_providers/{uuid}/inventories
* PUT /resource_providers/{uuid}/inventories/{resource_class}

Up to microversion 1.25, the value of 'reserved' has to be less
than the value of 'total' in the request.
Starting from microversion 1.26, it has to be less than or
equal to the value of 'total'.

Change-Id: Id1857abf323c9776ab8fe957202848ff7ab3fbd2
Closes-Bug: #1783380
2018-07-30 22:55:30 +09:00
Zuul e276db98f1 Merge "Add documentation for emulator threads policy" 2018-07-30 13:50:03 +00:00
Zuul 8c91a5b72d Merge "doc: link to AZ talk from the Rocky summit" 2018-07-30 12:54:11 +00:00
Zuul 9e99595366 Merge "doc: link to CERN summit video about upgrading from cells v1 to v2" 2018-07-30 12:54:04 +00:00
Zuul 38c57695a7 Merge "tox: Silence psycopg2 warnings" 2018-07-30 12:53:53 +00:00
Zuul 46607fe6d6 Merge "Use vif.vif_name in _set_config_VIFGeneric" 2018-07-30 12:53:46 +00:00
Zuul bb5ff6f6c3 Merge "api-ref: document user_data length restriction" 2018-07-30 07:48:25 +00:00
Zuul bd5867f5ed Merge "Fix signature of _FakeImageService.download" 2018-07-30 07:48:18 +00:00
Zuul dd6d752966 Merge "Fix ServerMigrationSampleJsonTests to use sample files from version dir" 2018-07-29 06:36:43 +00:00
Zuul c9b7c3577f Merge "Assorted cleanups from numa-aware-vswitches series" 2018-07-29 03:41:15 +00:00
Zuul 7eda21891b Merge "scheduler: Start utilizing RequestSpec.network_metadata" 2018-07-29 02:42:31 +00:00
Zuul 4d19b1779c Merge "Fix accumulated nits from port binding for live migration series" 2018-07-28 16:51:52 +00:00
Zuul 5755e708d2 Merge "Consider network NUMA affinity for move operations" 2018-07-28 12:50:42 +00:00
Zuul b68010dd8c Merge "Add functional tests for numa-aware-vswitches" 2018-07-28 12:50:33 +00:00
Zuul 48ab6a3c00 Merge "libvirt: Start populating NUMACell.network_metadata field" 2018-07-28 12:50:27 +00:00
Zuul 04b83e7013 Merge "libvirt: Revert non-reporting DISK_GB if sharing" 2018-07-28 04:41:44 +00:00
Zuul e3d9c506e5 Merge "Fix create_all() to replace_all() in comments" 2018-07-28 03:54:51 +00:00
Zuul 63c1f9a17a Merge "Add nova-status upgrade check for request spec migrations" 2018-07-28 02:39:19 +00:00
Zuul 3e0b17b1e1 Merge "Update queued-for-delete from the ComputeAPI during deletion/restoration" 2018-07-27 23:27:17 +00:00