Tests for validation of deploying patches feature

Mandatory Design Reviewers: A. Urlapova, I. Kalnitskiy
Developers: T. Leontovich
QA: T. Leontovich

Acceptance tests case to automate will be:

Test 1: - Patch simple environment with nova networking:
1. Deploy simple environment with nova
2. Run ostf
3. Run update
4. Run ostf

Test 2:
1. Deploy HA with neutron and ceph
2. Run ostf
3. Run update
4. Run ostf
5. Run rallback
6. Run ostf

Functional tests:

1. Should use snapshots after successfult tests runs
2. Shoud run in separate job
3. Should provide separate report

Full list of functional tests cases will be placed here:

https://docs.google.com/a/mirantis.com/spreadsheets/d/1njLJt_fO4zSgZf9JskJZ6JitYawObI8p_iEz5FQ9YBA/edit#gid=1436713369

Non-Functional tests:

1. UI tests should be added for verification/ Notification / Actiona tab/ releases list and other UI changes
2. Performance testing. Feature should be verified and certified on big deployments, with meatrics measurement. Also additional Ha checks should be run after successful updates
3. Validation with rally is mandatory on patched deployment

Full list of non - functional testing will be placed here:
https://docs.google.com/a/mirantis.com/spreadsheets/d/1njLJt_fO4zSgZf9JskJZ6JitYawObI8p_iEz5FQ9YBA/edit#gid=1436713369