Commit Graph

317 Commits

Author SHA1 Message Date
Jenkins 600a3bd10d Merge "xenapi: reduce polling interval for agent" 2012-08-09 04:48:46 +00:00
Johannes Erdfelt fbb7944851 xenapi: reduce polling interval for agent
Communicating with the agent requires polling for a response. The
operation uses xenstore, which is lightweight, yet the interval
in between polls was 3 seconds. This would cause longer than necessary
sleeps when an instance was booting making the overall boot slower.

Change-Id: I560c05887128f1a0e29228e859cca25ded4eceec
2012-08-07 23:25:57 +00:00
Johannes Erdfelt 31f3383ae4 xenapi: wait for agent resetnetwork response
Unlike every other agent command, the resetnetwork command would not
wait for a response. All failures were silently ignored. Change this
to at least log a message if an error occurs.

Change-Id: I40e323607b2ce50869f3bf11e4582ff83cbed1c0
2012-08-07 23:19:04 +00:00
Jenkins 56a5ba1170 Merge "XenAPI: Fix race-condition with cached images." 2012-08-01 15:49:59 +00:00
Jenkins 794a673b05 Merge "Fix ip6tables support in xenapi bug 934603" 2012-08-01 07:19:11 +00:00
Rick Harris 4f3291e379 XenAPI: Fix race-condition with cached images.
The core problem is that XenServer's `VDI.copy` call drops the
destination file directly into the SR. This means that half-completed
files are visible with no way to distinguish these from fully-copied
files.

We had some code that attempted to mitigate this issue by checking
physical_utilisation against an expected value. The problem with this
code is that it didn't account for VDI chaining where the
physical_utilisation would not necessarily match the parent.

The net effect of this was that 'cloned' VDIs would never be found
because their physical_utilisation was far below what was expected.

The work around is to create our own `_safe_copy_vdi` which is isolated
and atomic. Long term, `VDI.copy` should be fixed so that half-completed
files are never stored in the SR.

Change-Id: I6eb3cb5259f9ee1c7394e58f76105a8b39bfc720
2012-08-01 04:49:37 +00:00
Rick Harris 40a84de65a Xen: VHD sequence validation should handle swap.
The VHD sequence validation code was erroneously counting `swap.vhd`,
which caused it to raise an exception when a corresponding numbered VHD
was not found.

The fix is to simply ignore the `swap.vhd` file.

Other unknown VHDs will generate an exception, but from a
sanity-checking perspective, this is a Good Thing(tm).

Fixes bug 1030939

Change-Id: Ic82ae27a4af7ea8f7669fd006aea1a310b691218
2012-07-30 15:49:02 +00:00
Mate Lakat cdc5a6a237 Fix ip6tables support in xenapi bug 934603
Change-Id: Id7c4b0c4f8710652249b5c4fcb82abd5cccde6dd
2012-07-27 14:41:56 +01:00
Rick Harris dd54a15a7f Xen: Validate VHD footer timestamps.
This is a sanity check to ensure the footer timestamps on a VHD are
reasonable (e.g. not in the future). This condition can occur if the
local time for the source and destination machines in a migration are
not in agreement, requiring an adjustment to /etc/localtime and/or NTP
reconfiguration.

Without this check there is a risk of importing a corrupt VHD into the
SR causing the entire SR to become corrupted.

Change-Id: I17228e50d6f54632f3bfc32a682e511f876517ec
2012-07-24 18:26:57 +00:00
Jenkins 075cd48847 Merge "Adds logging for renaming and hardlinking." 2012-07-20 20:11:52 +00:00
Rick Harris d42f44f1e4 Adds logging for renaming and hardlinking.
This will provide a bit more visibility into what's happening when dom0
plugin generates an exception.

Change-Id: Ia529956ee4fc56e49efdcf2cca4f42fc8ebcc3ea
2012-07-20 17:34:43 +00:00
Rick Harris 4881ccf017 Ensure VHDs in staging area are sequenced properly.
This adds a check to raise a sensible error if the VHDs in the staging
area are not sequence numbered properly, meaning 0 to n-1 with no gaps.

The previous error was an UnboundLookupError which made it difficult to
pinpoint the root cause.

Change-Id: I6b9e4f854c271bf73711480568be384ba883775d
2012-07-19 22:52:30 +00:00
Rick Harris f5583a7840 Remove VDI chain limit for migrations.
The strategy for removing the limit is to refactor migration so that
they work nearly identically to snapshots, meaning sequence-numbered
VHDs are rsynced over into a staging-area and then imported into the SR
using the `import_vhds` function.

Change-Id: Ibf5c82c52ae7d505ea9e54d64fcc8b8fdce4d05d
2012-07-16 11:49:15 -04:00
Jenkins e4ac606dd5 Merge "Use explicit destination user in xenapi rsync call" 2012-07-13 20:05:31 +00:00
Johannes Erdfelt d906692f78 Use explicit destination user in xenapi rsync call
Recent versions of xenserver use a newer, but buggy, version of rsync
that will attempt to parse out the username and fail if it isn't in
the destination. So, add it to the destination to ensure this works
with both older and newer versions of rsync.

Change-Id: I9b7f05a8ea5cf5b7fae1a55a2b8557b2bfe5b865
2012-07-13 16:52:29 +00:00
Rick Harris 45f8aefcd3 Remove VDI chain limit for snapshots.
Snapshots and migrations were coded with a simplifying assumption that
the maximum length of a VDI chain would be 3. Now that fast-cloning has
been added, this assumption no longer holds.

The goal of this patch is to remove the restriction for snapshots. A
follow-on patch will remove the restriction for migrations.

This patch changes the image-format for XenAPI images. Instead of naming
the VHDs, 'base', 'image', and 'snap', they are now numbered staring
with 0 as the leaf and going to N as the base-copy (root).

Old-style images are still supported.

Change-Id: Ieb073b42dc25db7cee4dfca7ff6525f7e7f46e8e
2012-07-12 18:02:32 -05:00
Johannes Erdfelt a44fbea083 Ignore failure to delete kernel/ramdisk in xenapi driver
Fixes bug 1022681

If deleting the kernel/ramdisk fails because the files don't exist
anymore, then ignore the error and continue. This will ensure that the
instance will get destroyed properly even if the files were deleted
outside of nova.

Change-Id: I5d1f95ea2a6f552c48efbb9e92bb36767df19e34
2012-07-09 18:18:30 +00:00
Jenkins efa69b44cc Merge "Get hypervisor uptime." 2012-07-05 22:20:58 +00:00
Jenkins 1a7d6a0740 Merge "Run hacking tests as part of the gate." 2012-07-03 15:32:15 +00:00
Monty Taylor 8d8d3b4296 Run hacking tests as part of the gate.
Nova has additional pep8 "plugins" that they expect to run as part of the
gate. This patch will run tools/hacking.py instead of pep8 directly. Also,
it fixes the hacking violaions in contrib, plugins and smoketests.

Fixes bug 1010136

Change-Id: I86d8789218c197d5d4a43d1201465d340646a395
2012-07-02 08:50:41 -04:00
Kevin L. Mitchell 6222385d83 Get hypervisor uptime.
Adds a call to retrieve the current uptime on a specific hypervisor.
This version of the patch only adds the XenAPI variant; other virt
drivers will raise a NotImplementedError until they implement the
get_host_uptime() method.

Change-Id: Ie259589757a460fcd91a49a8dd8099e4d91524e7
2012-06-29 17:17:51 -05:00
Rick Harris 1dea34fa1a Refactoring code to kernel Dom0 plugin.
The kernel and ramdisk VDI manipulation code really has nothing to do
with Glance so it doesn't make a lot of sense for it to exist in the
Glance Dom0 plugin.

This patch refactors the code out to its own plugin and then applies a
few misc cleanups.

Change-Id: I363d54ea3c2d51aa6a6c1635b4fb59ebb9ce1fc0
2012-06-29 21:36:54 +00:00
Rick Harris 27f23001d7 Dom0 plugin now returns data in proper format.
The virt-layer code was refactored so that a dict was used to pass
around which VDIs are present. This code makes the Dom0 plugin return
that same data structure so we don't have to perform an extra conversion
step.

Change-Id: Ib4f1b0082138d233eb0c3873bbc553395510bc8d
2012-06-29 00:21:01 +00:00
Rick Harris d01e0bc661 Add missing utils declaration to RPM spec.
`utils.py` was added by the Dom0 plugin refactoring but the
corresponding declaration in the SPEC file was forgotten.

Change-Id: If12d7389a51928b1f741063e12b3b5a9015d0656
2012-06-28 22:38:53 +00:00
Rick Harris 169e601c8c Refactor Dom0 Glance plugin.
Moves shareable code out to a new utils file where future Dom0 plugins
can make use of it.

Change-Id: I57eb20b4ca308fdda424599d36d94f120d99ec0d
2012-06-28 17:07:31 +00:00
Zhongyue Luo 61c5597a09 Backslash continuation removal (Nova folsom-2)
Fixes bug #938588

Backslash continuations removal for scripts in bin/, plugin/, and etc.

Change-Id: Idd17048b6e8db6e939946968e011e68da8585b8d
2012-05-31 11:26:37 +08:00
Antony Messerli bbdbd1b87b Bump XenServer plugin version
Change-Id: I7a9389a8b07b78dec083f2a39c0ca6d9f3705ad3
2012-05-16 12:06:24 -05:00
Chris Behrens 584917cce5 Fix XenServer windows agent issue
Windows agent requires an argument of either 'agent' or 'xentools' to
the 'version' command.  All we care about is 'agent', so add it.  The
unix agent happily ignores the arg.

Fixes bug 997805

Change-Id: Ic369c8a2850173057da9d3175a02b5864d7a6514
2012-05-10 21:17:16 +00:00
Paul McMillan 1513cc178e Improve grammar throughout nova.
Fixes some "its" and "it's" mistakes, and unifies the tense of
some documentation.

Change-Id: I9b83aba535b554e80b2cf1e048bb3a4e5cac0e5e
2012-04-10 11:15:07 -07:00
Johannes Erdfelt 93874bacf7 Use 'root' instead of 'os' in XenAPI driver
Instance types define disk names as root, swap and ephemeral. The
XenAPI driver however uses os, swap and ephemeral. Standardize on
calling them 'root' disks instead of 'os' disks.

Change-Id: Ia34346d463d06cb971537c305602926ceb0dc175
2012-04-09 18:20:21 +00:00
Jenkins edca430b52 Merge "Fixes bug 954833 By adding the execute bit to the xenhost xenapi plugin" 2012-03-14 18:47:07 +00:00
Dan Prince a236fdd380 Update transfer_vhd to handle unicode correctly.
Python 2.4's shlex implementation doesn't seem to like unicode.
This updates the XenServer migration plugin so it converts to
ascii before shlex'ing the rsync args.

Fixes OSAPI resizes when using XenServer.

Fixes LP Bug #955064.

Change-Id: I7f2681bfe64ccde449a87c68b9739866a381a213
2012-03-14 10:53:36 -04:00
John Garbutt 722c54a069 Fixes bug 954833
By adding the execute bit to the xenhost xenapi plugin

Change-Id: Id1e12b84ef5c9a286d86a32b3ea1c7f3c83be47c
2012-03-14 09:36:11 +00:00
Alex Meade 00592cfa0b Use cPickle and not just pickle.
Fixes bug 953423

cPickle is up to 1000 times faster than pickle. We should use it instead.

Change-Id: I1facbdcf60d88c9fba56687abf75524498d2502e
2012-03-12 21:50:15 +00:00
Mark Washenberger e6b70b5c37 Increase logging for xenapi plugin glance uploads
Without this change, the glance plugin is pretty quiet about image
uploads. But it can definitely be helpful to debugging to have
information such as which glance server is handling the upload, how much
data was sent, and more information about the glance server response if
it was something other than 200 OK.

Change-Id: I0269478ad1061fc2021ef4b5d9c3c1dea9b2f6cb
2012-03-08 14:02:49 -05:00
Rick Harris 1da6a00a3b Validate VDI chain before moving into SR.
Fixes bug 949477

Change-Id: Ia3f283d82f189e680c5c8dd4fcf71bf5fe5f9889
2012-03-08 03:43:22 +00:00
Yuriy Taraday 01a938f7fe HACKING fixes, all but sqlalchemy.
Looks like this fixes all HACKING problems that were around.
Thanks to Dina Belova and Alexander Kovalev for this work.

Change-Id: I8157f0d4890184c1216aab63ef7180ee8b7a184d
2012-03-07 12:51:39 +04:00
Jenkins a231acabb6 Merge "Fixes bug 942556 and bug 944105" 2012-03-06 19:37:21 +00:00
Johannes Erdfelt c4a2e17dcf Retry download_vhd with different glance host each time
Fixes bug 944096

Change-Id: I33aa3774ba7f266e85f09c6c569fdd0f895478b4
2012-03-02 19:14:13 +00:00
John Garbutt 37a392dc4c Fixes bug 942556 and bug 944105
Ensures the calls in the xenhost plugin work when the host is in
a xenserver pool managed by the host aggregates feature.

Change-Id: I51ca6b9f6d0e8d86d53afde5bf46cfabde17a44e
2012-03-02 16:03:56 +00:00
Mark Washenberger 0d487d4f23 Copy data when migration dst is on a different FS
Fixes bug 939916

Change-Id: I678e15a13f99b59b16bd446f566b2c48dcba6057
2012-02-23 20:01:14 -05:00
Armando Migliaccio 939f082cc2 blueprint host-aggregates: host maintenance - xenapi implementation
this changeset introduces the following:

- refactoring around host-related operations for xenapi
- increased test coverage
- first cut at implementing host evacuation for a XS/XCP host

Change-Id: I8509cdde95f6777ecfa928663b0c4bedbccf5d38
2012-02-23 13:28:21 +00:00
Jenkins 60cec0a7f5 Merge "blueprint host-aggregates: improvements and clean-up" 2012-02-22 17:20:24 +00:00
Jenkins be56fd77ad Merge "Clarify use of Use of deprecated md5 library" 2012-02-22 16:53:11 +00:00
Armando Migliaccio 424de7eea2 blueprint host-aggregates: improvements and clean-up
This changeset addresses a number of issues found during testing:

- avoid name conflicts during aggregate creation (see db/* changes)
- avoid masking of XenAPI.Failure if pool-join fails (see plugins/* changes)
- preserve VM placement decisions made during scheduling (see xenapi/vmops.py)
- ensure plugins are called on the right hosts in XS pools (see xenapi_con.py)
- stores master uuid in aggregate metadata for use in VM live migration and
  raise InvalidAction rather than Aggregate error if we attempt to remove
  a mster (see xenapi/pool.py and compute/manager.py)
- clean-up of unit tests

Change-Id: I881a94d87efe1e81bd4f86667e75f5cbee50ce91
2012-02-22 10:40:09 +00:00
Jenkins c4ff7ef07c Merge "blueprint host-aggregates: xenapi implementation" 2012-02-22 03:22:30 +00:00
Armando Migliaccio 424f32f04d blueprint host-aggregates: xenapi implementation
This commit introduces some clean-up/improvements on the current model
and api for host aggregates. It also introduces a first version of the
xenapi implementation. More precisely:

- it lays out the structure of the virt driver,
- it introduces compute and xenapi unit tests coverage,
- it deals with join/eject of pool master and slaves,
- it fixes xenapi_conn, when used in resource pool configurations

More commits to follow (to ensure that VM placement, networking setup,
performance metrics work just as well in cases where resource pools
are present). However, these may be outside the scope of this blueprint
and considered as ad-hoc bug fixes.

Change-Id: Ib3cff71160264c5547e1c060d3fd566ad87337cb
2012-02-21 22:43:49 +00:00
Rick Harris 043347267b Avoid copying file if dst is a directory.
Fixes bug 938153

`shutil.move` in Python 2.4 will fallback to copying the file if dst is
a directory. See http://bugs.python.org/issue1577.

Change-Id: I2390337d82db5a72fef0e63877401134b1dcca55
2012-02-21 22:00:03 +00:00
Joe Gordon 1fc7c0c534 Clarify use of Use of deprecated md5 library
See Invalid bug 937463 for more details
Also change run_tests.sh to ignore more '*.pyc' files

Change-Id: I8c8ded902833fe4268966ff7a9630daaaad43a19
2012-02-21 09:06:08 -08:00
Johannes Erdfelt 3a95d451ed Catch httplib.HTTPException as well
Fixes bug 932927

None of the httplib exceptions will get converted into urllib2 exceptions

Change-Id: Iad72821fa1ed54fdb213b371223e94e183dec334
2012-02-15 18:52:40 +00:00