Commit Graph

124 Commits

Author SHA1 Message Date
Gary Kotton 4cbf1f379c Support for scheduler hints for VM groups
This is part of the blueprint vm-ensembles. The patch introduces the
group as a scheduler hint.

The patch set adds group support for multi-VM deployment. This is achieved
as follows:
1. A new hint is added: group. This will contain the name and type for the
   group. At the moment only anti-affinity is supported. In the future
   we will add network proximity. It will be extended to <name>:<type>
2. In order to ensure that group policy will be honored for future VM
   deployments, the group is stored as system_metadata.
3. The anti affinity is implemented by a new filter called
   GroupAntiAffinityFilter.

DocImpact

Change-Id: I6ea2af5770b5ac4ff082b2a021d323ee38282205
2013-02-08 03:16:44 +00:00
Pádraig Brady f379db545c fix misspellings in logs, comments and tests
Flagged with: https://github.com/lyda/misspell-check
Run with: git ls-files | misspellings -f -

Fixes bug: 1100083
Change-Id: Icf1f844fea8ad0a1101d1dc64b9a126608e9536e
2013-01-21 23:14:13 +00:00
Matt Joyce 0651e60e4e correcting for proper use of the word 'an'.
Change-Id: Ib6180284d806a00c520df378e651fba947e2397a
2013-01-16 11:50:01 -08:00
Sunil Thaha 35217e5fd7 Updates prerequisite packages for fedora
Adds gcc, libxslt-devel (has dependency on libxml2-devel) and mysql-devel to
the list of prerequisites

Change-Id: I9c27868b30ef17d73adf8ad2e72b3d0e76fe76d1
2013-01-17 00:40:15 +10:00
Jenkins 0e17114aac Merge "Update command on devref doc" 2012-12-19 12:28:11 +00:00
Sulochan Acharya 694bcb7f7c Update command on devref doc
Update the apt-get command to build mysql dependency for ubuntu.
It currenly says apt-get install build-dep python-mysqldb
which should just be apt-get build-dep python-mysqldb

Change-Id: I541f7b80802a6b7191f2fe0338965ef425e7c2fd
2012-12-14 11:40:22 -06:00
Xiangyang Chu 461a966d75 Add the missing replacement text in devref doc.
Add AggregateInstanceExtraSpecsFilter's replacement text in
doc/source/devref/filter_scheduler.rst

Change-Id: I5b74c5f51eb85f79f79a2d2c556d6522d97f1497
2012-12-14 09:47:32 +08:00
Brian Elliott e937a53065 Add generic customization hooks via decorator.
Hooks add the ability to insert custom code around operations that
declare a named hook:

e.g.

@hooks.add_hooks('create_instance')
def create_instance(....):
   ....

The above hook allows Hook objects to be run 'pre' and 'post' the
execution of create_instance()

Hook objects are discovered via the setuptools entry point group
'nova.hooks'.

Change-Id: I3961df12ef415085de7459438967edacc34500c2
2012-11-30 20:47:53 +00:00
Yunhong, Jiang 8ce8e4b6c0 Enhance compute capability filter to check multi-level
Host state capabilities include multi-level information, like
cpu features are presented in capabilities:cpu_info:features, cpu
core number in capabilities:cpu_info:topology:cores.
    Multi-level capability check maybe helpful in some situation, like
user want to make sure host support SSE3 instructions or AES-NI, or
user want to make sure the host has >4 cores for SMP instance. Current
capability filter does not support these requirements.
    To support multi-level check, also add scope to capability filter,
so, now capability filter will handle no-scope extra_specs, or scope-format
as "capabilities:xxx:xxx" etc.

    Related to bp hw-feature-to-vm

Change-Id: Id714f99b4babbdb328b8e47f5a270be517b528d2
Signed-off-by: Yunhong, Jiang <yunhong.jiang@intel.com>
2012-11-14 18:10:08 +08:00
Joe Gordon 58373748ac Remove nova-volume scheduling support
Continuation of I0b540e54dbabd26901a7530035a38583bb521fda

* delete scheduler.simple
* modify scheduler.multi instead of delete to continue supporting
  I753e87fc8979fd0b62529974f00cf11fa55b3d63
* update scheduler.multi docstring
* scheduler.rpcapi bumped to 2.3
* change default scheduler to scheduler.filter_scheduler

DocImpact

part of bp delete-nova-volume

Change-Id: Ie9d9b46742b2d92cd1e9ffe982ef658907a1d411
2012-10-31 23:10:11 +00:00
Jenkins f3d2669280 Merge "Addtional 2 packages for dev environment on ubuntu" 2012-10-29 18:26:21 +00:00
Vishvananda Ishaya 7e2b93acc5 removes the nova-volume code from nova
This removes the majority of the nova-volume code from the codebase.
It updates relevent config options to default to cinder. It updates a
number of existing tests that were depending on code that was removed.

A few things still need to be removed:

 * volume/driver.py & volume/iscsi.py
   These files are used by the libvirt volume driver tests. These
   tests should be updated to mock the relevant calls.

 * scheduler/simple.py & scheduler/multi.py
   These files should no longer be necessary so they can be removed
   in a subsequent patch

 * exception.py cleanup
   Once the above files are removed there are a number of unused
   exceptions which can be removed

 * database calls and database tables
   The database calls have not been removed and the tables have not
   been dropped. This can be done in a separate migration

 * additional config options and nova.conf.sample
   There may be a few extra config options that can be removed and the
   conf sample can be regenerated

Implements bp delete-nova-volume

Change-Id: I0b540e54dbabd26901a7530035a38583bb521fda
2012-10-28 11:34:05 -07:00
Jolyon Brown 73f56fa819 Addtional 2 packages for dev environment on ubuntu
In file doc/source/devref/development.environment.rst added packages
build-dep and python-mysqldb which I have had to add on ubuntu 12.04
to enable the dev environment to be setup. Without these run_tests.sh
fails with error 'mysql_config not found' when setting up the virtual env.

Change-Id: I4af775386469deecf122a9e165457f241339b20b
2012-10-25 12:51:16 +01:00
Michael Still 0d4e6dbe6f Migrate to fileutils and lockutils.
Migrate nova to using openstack-common's file and lock utilities.
Resolves bug 1063230.

Change-Id: I1a4c87856bc08cd33b61d7098ed856baa4583654
2012-10-25 09:20:46 +11:00
Tom Fifield 43bc7d6996 Remove refs to ATAoE from nova docs
fixes bug 912108

Nova volumes' ATAoE is long gone. This patch merely removes the
remaining comments about it from the nova devref documentation.

Change-Id: Ic5586c0d596acae05cdee4ba9cb5ec453315b773
2012-09-23 14:12:42 +10:00
Jinwoo 'Joseph' Suh 611ee3b213 Added description of operators for extra_specs
There are several new operators added for extra_specs that are used
in compute capability filter and aggregate filter. These are
described in document in this patch. Fixed bug 1047036.

Change-Id: Id86c6672d7bda458ecb918f1900d6f8a9526ad41
2012-09-11 12:13:14 -04:00
Joe Gordon 847fb38c5b Add documentation for scheduler filters scope
Add documentation for bug 1039386

Fix other devref typos

Change-Id: Ife19ee5feb72dd75b91a03c4167d8f4e578a4a04
2012-09-10 11:01:15 -07:00
Tom Fifield 5f529511c6 Add two prereq pkgs to nova devref env guide
fixes bug 1024903

As noted in the bug report, without libxml2-dev and libxslt-dev
installed on ubuntu 12.04, the virtualenv creation will fail.

This fix simply adds the packages to the first
"Install the prerequisite packages." line

Change-Id: I588ce14f63fa75d54405562f83d202d05c8a05c6
2012-08-23 09:18:34 +10:00
Jenkins b090bdd088 Merge "Introduce ImagePropertiesFilter scheduler filter" 2012-08-22 07:02:45 +00:00
Jim Fehlig 5ea7db9b71 Introduce ImagePropertiesFilter scheduler filter
Commit d39137fa added functionality to the ComputeFilter to filter on
architecture, hypervisor_type, and vm_mode. The existing ArchFilter
already filtered on architecture. This patch merges the ComputeFilter
functionality introduced in d39137fa with the ArchFilter to create the
ImagePropertiesFilter.  The ImagePropertiesFilter uses image properties
specified in the request_spec to filter hosts.

This patch also adds the ImagePropertiesFilter to the list of default
filters specified by the scheduler_default_filters FLAG.

Fixes LP Bug #1037339

DocImpact

Change-Id: Ifa6fccf2db266b0fe3457d58fc81fdb50ffcbc0f
2012-08-17 22:25:54 -06:00
Joe Gordon b0392d3017 OpenStack capitalization added to HACKING.rst
Along with capitalization fixes to comments in code

Change-Id: I72ddc582001f80d954ca5a121903c689f40d08d1
2012-08-17 15:59:32 -05:00
Jim Fehlig 460ba0416e Update FilterScheduler doc
The FilterScheduler doc was overlooked when new filters were added
or existing filters were changed.  This change updates the doc with
information skimmed from the individual filters.

nova.conf.sample is updated as well with the current list of default
filters.

Change-Id: I48af75c472195ded89b34db76a22947614ffb99b
2012-08-17 10:41:33 -06:00
Yun Mao 65255ae22b Allow stop API to be called in Error
We already allow the stop API to be called when the VM is in Error
state. This is to update the diagram in devref doc.

Change-Id: I792028dc6f851f66d42b852c27505c479eab4df7
2012-08-14 10:27:14 -04:00
Joe Gordon 0e6fc4f4dd Update devref for general host aggregates
Update devref to explain the new definition of host aggregates.
part of blueprint general-host-aggregates

Change-Id: I5d46c4c4253a4d9e74a52192d1e6244843d11711
2012-08-07 14:20:21 -07:00
Joe Gordon 8ba14de31f Remove unused testing.fake
Change-Id: If86a65a6908b53e6f467d0e7a36c2ea941bf5040
2012-07-18 14:04:37 -07:00
Brian Waldon 3ff63d029b Remove deprecated auth docs
Related to bp remove-deprecated-auth

Change-Id: I2637188e75e1881e6cc5af09d86eaf45581b3e9e
2012-07-10 11:09:37 -07:00
Jenkins aa802e0204 Merge "vm state and task state management" 2012-06-25 18:24:30 +00:00
Joe Gordon 1b40708287 Fixes ram_allocation_ratio based over subscription
Fix for bug 1016273

Change-Id: I7f7b227e71e93b4bcded150791fb0b9e9df98e4c
2012-06-21 17:49:16 -07:00
Yun Mao 129b87e17d vm state and task state management
partially implements bp task-management
fixes bug 997867

also see http://wiki.openstack.org/VMState

Refactored the following API/state:
* rebuild
* migrate
* resize
* start
* stop
* delete
* soft delete
* rework sync_power_state in compute/manager.

fix broken tests, add transition diagram in dot

Change-Id: I3c5a97508a6dad7175fba12828bd3fa6ef1e50ee
2012-06-21 15:34:53 -04:00
daisy-ycguo 664723bde9 bug #1006094 correct typo in addmethod.openstackapi.rst
Change-Id: Ic03996357aacb6f135b95fc1e5810066b776b980
2012-06-04 10:35:31 +08:00
Matt Joyce d5cc5fd2f0 Grammar fixes.
Change-Id: Iff3f5765193e0bc98dfc377ee5a9b6f47ae11859
2012-05-29 13:01:57 -07:00
Jenkins 0598ec2d36 Merge "Docs for vm/task state transitions." 2012-05-11 15:46:44 +00:00
Jenkins 36a810e545 Merge "Mistake with the documentation about cost function's weight corrected." 2012-05-09 19:12:06 +00:00
Joe Gordon fa02377645 Fix devref docs
Fix filter_scheduler namespace (no more distributed_scheduler)

Change-Id: I03ae3403a670ba3fdc33983da8df9e97c728080a
2012-05-07 15:07:45 -07:00
Sandy Walsh 42b09d91f7 Docs for vm/task state transitions.
Added diagrams to RST docs that show  required vm_state / task_state
transitions for compute api operations.

(Set Sandy Walsh as author since he created the diagrams)

Change-Id: Ie6a9cd4b54321a98fea5429ee52eb781f57f31a4
2012-05-06 19:36:15 -04:00
Dina Belova 8c938d3f7e Mistake with the documentation about cost function's weight corrected.
Change-Id: I131d6abc100682ae78c7ac2edfffadc491b9d437
2012-05-05 13:24:13 +04:00
Dina Belova c1e397b746 Information about DifferentHostFilter and SameHostFilter added.
Change-Id: Ice5f03db5f3d24455c43af86bf5722b863cbe959
2012-04-09 19:18:38 +04:00
Dina Belova 6ca171810e Extend FilterScheduler documentation.
Added more specific information on filters and weight functions.

Change-Id: If0463cd9d29568dfe44c6e5ce3f2e42af5ffe240
2012-04-04 19:40:16 +04:00
Hengqing Hu 9a042d3c50 Remove trailing whitespaces in regular file
Fixes bug #945346

Change-Id: I07a303c2e503e50d7138585c683e0d1310339276
2012-03-07 13:43:37 +08:00
Jenkins 0bd3b47032 Merge "Bug #943178: aggregate extension lacks documentation" 2012-03-07 00:03:33 +00:00
Jenkins 31b0e17d7b Merge "Rename files/dirs from 'rabbit' to 'rpc'." 2012-03-06 20:50:59 +00:00
Jenkins 40f541270c Merge "Change references to RabbitMQ to include Qpid." 2012-03-06 20:39:58 +00:00
Jenkins ce016b2772 Merge "Rename DistributedScheduler as FilterScheduler" 2012-03-06 20:10:21 +00:00
Armando Migliaccio 21c779dd1e Bug #943178: aggregate extension lacks documentation
add rst docs for this extension.

Change-Id: I74080c240a0a6911271674177ac08a113b4c50d1
2012-03-06 17:45:28 +00:00
Russell Bryant 2511341840 Rename files/dirs from 'rabbit' to 'rpc'.
Now that the rpc API includes more than RabbitMQ, update a filename and
directory name to be 'rpc' instead of 'rabbit'.

Change-Id: Ib7fcccdd77fae128b6de3ee490fee3d6325ca7c5
2012-03-06 12:34:08 -05:00
Russell Bryant b6f6e1b7f4 Change references to RabbitMQ to include Qpid.
Update the documentation that referred to RabbitMQ to clarify that Qpid
can be used, as well.

Change-Id: I3abe32c2074bfdd3b5129ea65e9ca36cc9555c27
2012-03-06 12:32:02 -05:00
Doug Hellmann c16cd04cf6 Fix rst formatting and cross-references
blueprint sphinx-doc-cleanup
bug 944385

- Fix formatting and markup issues that produce error messages
- Update TOC lists for missing/new files
- Fix a few links
- Update instructions with dependencies for building the documentation
- Updated base on review comments from oubiwann to fix trailing whitespace in modified files

Change-Id: I589152bfab9c543d2b11fa8bed2344259aa90675
2012-03-06 08:08:25 -05:00
Joe Gordon a81130b1a9 Rename DistributedScheduler as FilterScheduler
Change-Id: I1091609d5997c4ba9c26a3f2426496ff7f1e64fa
2012-03-05 17:53:57 -08:00
Lorin Hochstein d304d828d0 Added docs on MySQL queries blocking main thread.
Added to the RST docs to describe how queries to MySQL will block a nova
service.

Change-Id: I4ae209e2827978cc5469162d386197f2e46b342d
2012-03-03 20:56:24 -05:00
Brian Waldon fe332168ae Remove old ratelimiting code
This code hasn't been modified in 8 months and isn't used anywhere.

Change-Id: I55d641095fb9a8541a1e86939a33b4d0e9c492a5
2012-02-29 09:53:59 -08:00