Commit Graph

116 Commits

Author SHA1 Message Date
Yunhong, Jiang 8ce8e4b6c0 Enhance compute capability filter to check multi-level
Host state capabilities include multi-level information, like
cpu features are presented in capabilities:cpu_info:features, cpu
core number in capabilities:cpu_info:topology:cores.
    Multi-level capability check maybe helpful in some situation, like
user want to make sure host support SSE3 instructions or AES-NI, or
user want to make sure the host has >4 cores for SMP instance. Current
capability filter does not support these requirements.
    To support multi-level check, also add scope to capability filter,
so, now capability filter will handle no-scope extra_specs, or scope-format
as "capabilities:xxx:xxx" etc.

    Related to bp hw-feature-to-vm

Change-Id: Id714f99b4babbdb328b8e47f5a270be517b528d2
Signed-off-by: Yunhong, Jiang <yunhong.jiang@intel.com>
2012-11-14 18:10:08 +08:00
Joe Gordon 58373748ac Remove nova-volume scheduling support
Continuation of I0b540e54dbabd26901a7530035a38583bb521fda

* delete scheduler.simple
* modify scheduler.multi instead of delete to continue supporting
  I753e87fc8979fd0b62529974f00cf11fa55b3d63
* update scheduler.multi docstring
* scheduler.rpcapi bumped to 2.3
* change default scheduler to scheduler.filter_scheduler

DocImpact

part of bp delete-nova-volume

Change-Id: Ie9d9b46742b2d92cd1e9ffe982ef658907a1d411
2012-10-31 23:10:11 +00:00
Jenkins f3d2669280 Merge "Addtional 2 packages for dev environment on ubuntu" 2012-10-29 18:26:21 +00:00
Vishvananda Ishaya 7e2b93acc5 removes the nova-volume code from nova
This removes the majority of the nova-volume code from the codebase.
It updates relevent config options to default to cinder. It updates a
number of existing tests that were depending on code that was removed.

A few things still need to be removed:

 * volume/driver.py & volume/iscsi.py
   These files are used by the libvirt volume driver tests. These
   tests should be updated to mock the relevant calls.

 * scheduler/simple.py & scheduler/multi.py
   These files should no longer be necessary so they can be removed
   in a subsequent patch

 * exception.py cleanup
   Once the above files are removed there are a number of unused
   exceptions which can be removed

 * database calls and database tables
   The database calls have not been removed and the tables have not
   been dropped. This can be done in a separate migration

 * additional config options and nova.conf.sample
   There may be a few extra config options that can be removed and the
   conf sample can be regenerated

Implements bp delete-nova-volume

Change-Id: I0b540e54dbabd26901a7530035a38583bb521fda
2012-10-28 11:34:05 -07:00
Jolyon Brown 73f56fa819 Addtional 2 packages for dev environment on ubuntu
In file doc/source/devref/development.environment.rst added packages
build-dep and python-mysqldb which I have had to add on ubuntu 12.04
to enable the dev environment to be setup. Without these run_tests.sh
fails with error 'mysql_config not found' when setting up the virtual env.

Change-Id: I4af775386469deecf122a9e165457f241339b20b
2012-10-25 12:51:16 +01:00
Michael Still 0d4e6dbe6f Migrate to fileutils and lockutils.
Migrate nova to using openstack-common's file and lock utilities.
Resolves bug 1063230.

Change-Id: I1a4c87856bc08cd33b61d7098ed856baa4583654
2012-10-25 09:20:46 +11:00
Tom Fifield 43bc7d6996 Remove refs to ATAoE from nova docs
fixes bug 912108

Nova volumes' ATAoE is long gone. This patch merely removes the
remaining comments about it from the nova devref documentation.

Change-Id: Ic5586c0d596acae05cdee4ba9cb5ec453315b773
2012-09-23 14:12:42 +10:00
Jinwoo 'Joseph' Suh 611ee3b213 Added description of operators for extra_specs
There are several new operators added for extra_specs that are used
in compute capability filter and aggregate filter. These are
described in document in this patch. Fixed bug 1047036.

Change-Id: Id86c6672d7bda458ecb918f1900d6f8a9526ad41
2012-09-11 12:13:14 -04:00
Joe Gordon 847fb38c5b Add documentation for scheduler filters scope
Add documentation for bug 1039386

Fix other devref typos

Change-Id: Ife19ee5feb72dd75b91a03c4167d8f4e578a4a04
2012-09-10 11:01:15 -07:00
Tom Fifield 5f529511c6 Add two prereq pkgs to nova devref env guide
fixes bug 1024903

As noted in the bug report, without libxml2-dev and libxslt-dev
installed on ubuntu 12.04, the virtualenv creation will fail.

This fix simply adds the packages to the first
"Install the prerequisite packages." line

Change-Id: I588ce14f63fa75d54405562f83d202d05c8a05c6
2012-08-23 09:18:34 +10:00
Jenkins b090bdd088 Merge "Introduce ImagePropertiesFilter scheduler filter" 2012-08-22 07:02:45 +00:00
Jim Fehlig 5ea7db9b71 Introduce ImagePropertiesFilter scheduler filter
Commit d39137fa added functionality to the ComputeFilter to filter on
architecture, hypervisor_type, and vm_mode. The existing ArchFilter
already filtered on architecture. This patch merges the ComputeFilter
functionality introduced in d39137fa with the ArchFilter to create the
ImagePropertiesFilter.  The ImagePropertiesFilter uses image properties
specified in the request_spec to filter hosts.

This patch also adds the ImagePropertiesFilter to the list of default
filters specified by the scheduler_default_filters FLAG.

Fixes LP Bug #1037339

DocImpact

Change-Id: Ifa6fccf2db266b0fe3457d58fc81fdb50ffcbc0f
2012-08-17 22:25:54 -06:00
Joe Gordon b0392d3017 OpenStack capitalization added to HACKING.rst
Along with capitalization fixes to comments in code

Change-Id: I72ddc582001f80d954ca5a121903c689f40d08d1
2012-08-17 15:59:32 -05:00
Jim Fehlig 460ba0416e Update FilterScheduler doc
The FilterScheduler doc was overlooked when new filters were added
or existing filters were changed.  This change updates the doc with
information skimmed from the individual filters.

nova.conf.sample is updated as well with the current list of default
filters.

Change-Id: I48af75c472195ded89b34db76a22947614ffb99b
2012-08-17 10:41:33 -06:00
Yun Mao 65255ae22b Allow stop API to be called in Error
We already allow the stop API to be called when the VM is in Error
state. This is to update the diagram in devref doc.

Change-Id: I792028dc6f851f66d42b852c27505c479eab4df7
2012-08-14 10:27:14 -04:00
Joe Gordon 0e6fc4f4dd Update devref for general host aggregates
Update devref to explain the new definition of host aggregates.
part of blueprint general-host-aggregates

Change-Id: I5d46c4c4253a4d9e74a52192d1e6244843d11711
2012-08-07 14:20:21 -07:00
Joe Gordon 8ba14de31f Remove unused testing.fake
Change-Id: If86a65a6908b53e6f467d0e7a36c2ea941bf5040
2012-07-18 14:04:37 -07:00
Brian Waldon 3ff63d029b Remove deprecated auth docs
Related to bp remove-deprecated-auth

Change-Id: I2637188e75e1881e6cc5af09d86eaf45581b3e9e
2012-07-10 11:09:37 -07:00
Jenkins aa802e0204 Merge "vm state and task state management" 2012-06-25 18:24:30 +00:00
Joe Gordon 1b40708287 Fixes ram_allocation_ratio based over subscription
Fix for bug 1016273

Change-Id: I7f7b227e71e93b4bcded150791fb0b9e9df98e4c
2012-06-21 17:49:16 -07:00
Yun Mao 129b87e17d vm state and task state management
partially implements bp task-management
fixes bug 997867

also see http://wiki.openstack.org/VMState

Refactored the following API/state:
* rebuild
* migrate
* resize
* start
* stop
* delete
* soft delete
* rework sync_power_state in compute/manager.

fix broken tests, add transition diagram in dot

Change-Id: I3c5a97508a6dad7175fba12828bd3fa6ef1e50ee
2012-06-21 15:34:53 -04:00
daisy-ycguo 664723bde9 bug #1006094 correct typo in addmethod.openstackapi.rst
Change-Id: Ic03996357aacb6f135b95fc1e5810066b776b980
2012-06-04 10:35:31 +08:00
Matt Joyce d5cc5fd2f0 Grammar fixes.
Change-Id: Iff3f5765193e0bc98dfc377ee5a9b6f47ae11859
2012-05-29 13:01:57 -07:00
Jenkins 0598ec2d36 Merge "Docs for vm/task state transitions." 2012-05-11 15:46:44 +00:00
Jenkins 36a810e545 Merge "Mistake with the documentation about cost function's weight corrected." 2012-05-09 19:12:06 +00:00
Joe Gordon fa02377645 Fix devref docs
Fix filter_scheduler namespace (no more distributed_scheduler)

Change-Id: I03ae3403a670ba3fdc33983da8df9e97c728080a
2012-05-07 15:07:45 -07:00
Sandy Walsh 42b09d91f7 Docs for vm/task state transitions.
Added diagrams to RST docs that show  required vm_state / task_state
transitions for compute api operations.

(Set Sandy Walsh as author since he created the diagrams)

Change-Id: Ie6a9cd4b54321a98fea5429ee52eb781f57f31a4
2012-05-06 19:36:15 -04:00
Dina Belova 8c938d3f7e Mistake with the documentation about cost function's weight corrected.
Change-Id: I131d6abc100682ae78c7ac2edfffadc491b9d437
2012-05-05 13:24:13 +04:00
Dina Belova c1e397b746 Information about DifferentHostFilter and SameHostFilter added.
Change-Id: Ice5f03db5f3d24455c43af86bf5722b863cbe959
2012-04-09 19:18:38 +04:00
Dina Belova 6ca171810e Extend FilterScheduler documentation.
Added more specific information on filters and weight functions.

Change-Id: If0463cd9d29568dfe44c6e5ce3f2e42af5ffe240
2012-04-04 19:40:16 +04:00
Hengqing Hu 9a042d3c50 Remove trailing whitespaces in regular file
Fixes bug #945346

Change-Id: I07a303c2e503e50d7138585c683e0d1310339276
2012-03-07 13:43:37 +08:00
Jenkins 0bd3b47032 Merge "Bug #943178: aggregate extension lacks documentation" 2012-03-07 00:03:33 +00:00
Jenkins 31b0e17d7b Merge "Rename files/dirs from 'rabbit' to 'rpc'." 2012-03-06 20:50:59 +00:00
Jenkins 40f541270c Merge "Change references to RabbitMQ to include Qpid." 2012-03-06 20:39:58 +00:00
Jenkins ce016b2772 Merge "Rename DistributedScheduler as FilterScheduler" 2012-03-06 20:10:21 +00:00
Armando Migliaccio 21c779dd1e Bug #943178: aggregate extension lacks documentation
add rst docs for this extension.

Change-Id: I74080c240a0a6911271674177ac08a113b4c50d1
2012-03-06 17:45:28 +00:00
Russell Bryant 2511341840 Rename files/dirs from 'rabbit' to 'rpc'.
Now that the rpc API includes more than RabbitMQ, update a filename and
directory name to be 'rpc' instead of 'rabbit'.

Change-Id: Ib7fcccdd77fae128b6de3ee490fee3d6325ca7c5
2012-03-06 12:34:08 -05:00
Russell Bryant b6f6e1b7f4 Change references to RabbitMQ to include Qpid.
Update the documentation that referred to RabbitMQ to clarify that Qpid
can be used, as well.

Change-Id: I3abe32c2074bfdd3b5129ea65e9ca36cc9555c27
2012-03-06 12:32:02 -05:00
Doug Hellmann c16cd04cf6 Fix rst formatting and cross-references
blueprint sphinx-doc-cleanup
bug 944385

- Fix formatting and markup issues that produce error messages
- Update TOC lists for missing/new files
- Fix a few links
- Update instructions with dependencies for building the documentation
- Updated base on review comments from oubiwann to fix trailing whitespace in modified files

Change-Id: I589152bfab9c543d2b11fa8bed2344259aa90675
2012-03-06 08:08:25 -05:00
Joe Gordon a81130b1a9 Rename DistributedScheduler as FilterScheduler
Change-Id: I1091609d5997c4ba9c26a3f2426496ff7f1e64fa
2012-03-05 17:53:57 -08:00
Lorin Hochstein d304d828d0 Added docs on MySQL queries blocking main thread.
Added to the RST docs to describe how queries to MySQL will block a nova
service.

Change-Id: I4ae209e2827978cc5469162d386197f2e46b342d
2012-03-03 20:56:24 -05:00
Brian Waldon fe332168ae Remove old ratelimiting code
This code hasn't been modified in 8 months and isn't used anywhere.

Change-Id: I55d641095fb9a8541a1e86939a33b4d0e9c492a5
2012-02-29 09:53:59 -08:00
Chris Behrens 3f42e11ca0 Make scheduler filters more pluggable
Filters are supposed to be pluggable, but they are not, since you have
to modify __init__.py.

This adds a --scheduler_availabile_filters setting which replaces the
hardcoding in __init__.py.  This setting is a MultiStr (a list, which
you can specify more than once) containing the full paths to filter
classes to make available to the scheduler.  Using a value of
'nova.scheduler.filters.standard_filters' maps to all standard filters
included in nova under nova.scheduler.filters.  This is the default
setting and matches what was in __init__.py before.

Also renamed --default_host_filters to --scheduler_default_filters to
make the flag a bit more clear.

Change-Id: I10eb54e9982b6d42316adfb2cc2600b44a9c3bdf
2012-02-27 23:41:06 +00:00
Sandy Walsh 26227b79e9 Removed zones from api and distributed scheduler
There is a new Zones implementation coming that will use AMQP-to-AMQP
channels vs. the public API. This is being done for three reasons:
1. remove complications in the OpenStack API (and possibly allow EC2 Zones)
2. remove dependencies on keystone and novaclient
3. faster scheduling (fewer chances for race conditions)

Learn more here:
http://wiki.openstack.org/EssexSchedulerImprovements

Change-Id: I6fe538923dd5ae19276afac2ac3311a285fd5c99
2012-02-16 17:53:00 +00:00
Brian Waldon 3759bcf3fc Excise M2Crypto!
This required rewriting our Diffie-Hellman-Merkle implementation for
set_admin_password in xen. Fixes bug 917851.

Change-Id: Ic4cdcc06221f003aec2dcd5ba05a1a9ad19d39c9
2012-02-02 10:12:58 -08:00
Jesse Andrews 62d5fae8d1 remove unsupported ec2 extensions
implements blueprint remove-ec2-extensions

* remove deprecated unofficial ec2 admin api
* remove admin api from wsgi/paste
* remove unofficial ec2 call for ajaxterm / update calls
* remove displayName/displayDescription from volumes/instances

Change-Id: If5a5ae26ebb9456a3c7376ff4ff0aa9589be1f5b
2012-01-31 22:07:46 -06:00
Brian Waldon 9cb5f547dc Remove admin_only ext attr in favor of authz
Working on blueprint separate-nova-adminapi. This removes the
admin_only extension attribute and the allow_admin_api flag. The
approach we're going for now is to load all extensions, but
to set an admin-only rule in our policy file for those extensions
that should be limited to just admin users. Now that all of our
admin api code has been moved to extensions, in order to
prevent admin api code from being loaded, simply remove it from
the extension list.

Change-Id: Ic574e06af44922ba764013b769077fc5099fd1a2
2012-01-24 10:30:32 -08:00
James E. Blair 5235106e95 Rename .nova-venv to .venv.
This simplifies a number of Jenkins jobs which currently, other
than directory names, could be the same for all OpenStack
projects. By renaming the virtualenv directory, the redundant
Jenkins virtualenv build and copy jobs can be eliminated.

Change-Id: Ieaf1dac3207ecb34b911c7edcd2086809abdf49e
2011-12-08 15:17:51 -08:00
Duncan McGreggor f845891184 First steps towards consolidating testing infrastructure
This commit begins to implement blueprint consolidate-testing-infrastructure by
adding a 'testing' subpackage and moving some modules into it.

Change-Id: I04bf860bc386bd2016e7dbc5a6f6ef7379a855bb
2011-12-06 09:37:57 -08:00
Jenkins 2f0f27dfd6 Merge "Document nova-tarball Jenkins job." 2011-12-05 21:32:36 +00:00