Add tests for other projects

Registered by David Wilde

Overview
########

Additional tests are needed for gating, smoke and nightly testing. Currently
our gating performs the following scenarios: test_minimum_basic and
test_swift_basic_ops. We need to add at least Neutron which is covered in the
test_basic_network_ops scenario and Heat which is covered in the
orchestration/test_server_cfn_init scenario.

Problem Description
-------------------

In order to more fully flesh out our gating process additional test are needed.
We should implement the full suite of tests for all of the features that we
implement in our product. In order to do this we need to have a fast and
reliable suite of gating tests and a comprehensive nightly test.

Proposed Change
---------------

Add the tests and bits to the tempest play that are needed for full gating and
automated testing.

Playbook Impact
---------------

Additional tests will be added to the tempest playbook.

Alternatives
------------

Leave testing/gating as it is now.

Security Impact
---------------

None known at this time.

Performance Impact
------------------

This will have a performance impact that will primarily be felt in the gating
jobs. We need to be very cognizant of the performance impact of the tests that
we add.

End User Impact
---------------

A more tested product with fewer bugs.

Deployer Impact
---------------

Other than a hopefully more stable product this will not affect the deployers.

Developer Impact
----------------

Gating may take longer for patchsets, but it will be more thorough.

Dependencies
------------

N/A

Documentation Impact
--------------------

Additional documentation about the gating process will be required. This will
be developer documentation.

References
----------

N/A

Blueprint information

Status:
Complete
Approver:
None
Priority:
Essential
Drafter:
David Wilde
Direction:
Approved
Assignee:
Ian Cordasco
Definition:
Drafting
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Ian Cordasco
Completed by
Kevin Carter

Related branches

Sprints

Whiteboard

Review: https://review.openstack.org/#/c/156831/

Gerrit topic: https://review.openstack.org/#q,topic:bug/1419094,n,z

Addressed by: https://review.openstack.org/156831
    Start running heat and nova scenarios against AIOs

Addressed by: https://review.openstack.org/158422
    Start running nova scenarios against AIOs

Addressed by: https://review.openstack.org/158429
    Start running nova scenarios against AIOs

Gerrit topic: https://review.openstack.org/#q,topic:bp/additional-tempest-checks,n,z

Addressed by: https://review.openstack.org/165173
    Rename test sets and include more api tests

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.