Create system tests for patching feature

Registered by Artem Panchenko

In 6.1 release we are going to implement new feature "Patching of OpenStack Distro":

https://docs.google.com/a/mirantis.com/document/d/1IKz4ZyPcqE10wzzWs9RK77fdVVzoozHzBkEXpetA1jg/edit

In order to tests its functionality we need to create new system tests:

 - test environment patching (deploy environment, apply patch, verify fix, run OSTF and benchmark tests);
 - test master node patching (deploy environment, apply patch on master node, verify fix, check that old environment works fine, create new environment, run OSTF and benchmark tests)

Blueprint information

Status:
Complete
Approver:
Nastya Urlapova
Priority:
Undefined
Drafter:
Artem Panchenko
Direction:
Needs approval
Assignee:
Fuel QA Team
Definition:
Approved
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Artem Panchenko
Completed by
Artem Panchenko

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/mos-patching-tests,n,z

Addressed by: https://review.openstack.org/159773
    Create tests for patching feature

Gerrit topic: https://review.openstack.org/#q,topic:(detached,n,z

Addressed by: https://review.openstack.org/162141
    Add tests configuration files for packages

Addressed by: https://review.openstack.org/166961
    [WIP] Do not wait for DHCP gateway setting

Addressed by: https://review.openstack.org/169287
    Add decorator to collect packages

Addressed by: https://review.openstack.org/170144
    Align patching tests with Fuel 6.1

Addressed by: https://review.openstack.org/170715
    Don't fail tests if there is no GPG data in repo

Addressed by: https://review.openstack.org/171633
    Revert "Add decorator to collect packages"

Addressed by: https://review.openstack.org/171611
    Add decorator to collect packages

Addressed by: https://review.openstack.org/171576
    Add test for master patching

Addressed by: https://review.openstack.org/176453
    Fix packages upgrade on Ubuntu

Addressed by: https://review.openstack.org/182847
    Compare Rally tests results before/after patching

Addressed by: https://review.openstack.org/187512
    Add test plans for main openstack components

Addressed by: https://review.openstack.org/191082
    Allow to run patching on pre-defined tests

Addressed by: https://review.openstack.org/191676
    Allow to run patching on pre-defined tests

Addressed by: https://review.openstack.org/192136
    Connect RPM repo to master during patching env

Addressed by: https://review.openstack.org/192141
    Connect RPM repo to master during patching env

Addressed by: https://review.openstack.org/192178
    Add possibility to specify few targets for patch

Addressed by: https://review.openstack.org/192200
    Add possibility to specify few targets for patch

Addressed by: https://review.openstack.org/192599
    Add action type 'run_tasks' for patching tests

Addressed by: https://review.openstack.org/192600
    Add action type 'run_tasks' for patching tests

Addressed by: https://review.openstack.org/193013
    Check both master and env repos for packages

Addressed by: https://review.openstack.org/193014
    Check both master and env repos for packages

Addressed by: https://review.openstack.org/193181
    Modify update_packages decorator

Addressed by: https://review.openstack.org/193903
    Save custom repository config to separate file

Addressed by: https://review.openstack.org/193904
    Save custom repository config to separate file

Addressed by: https://review.openstack.org/193907
    Wait for tasks and check their status (patching)

Addressed by: https://review.openstack.org/193908
    Wait for tasks and check their status (patching)

Addressed by: https://review.openstack.org/193964
    Fix errata format for different Linux distros

Addressed by: https://review.openstack.org/193965
    Fix errata format for different Linux distros

Addressed by: https://review.openstack.org/194108
    Add patching tags to tests

Addressed by: https://review.openstack.org/194529
    Add possibility to disable updates repo in tests

Addressed by: https://review.openstack.org/194632
    Fix typos in selecting fixed packages algorithm

Addressed by: https://review.openstack.org/194637
    Fix typos in selecting fixed packages algorithm

Addressed by: https://review.openstack.org/194640
    Add patching tags to tests

Addressed by: https://review.openstack.org/194711
    Add possibility to disable updates repo in tests

Addressed by: https://review.openstack.org/194978
    Use list of 'affected-pkgs' from erratum in tests

Addressed by: https://review.openstack.org/194979
    Use list of 'affected-pkgs' from erratum in tests

Addressed by: https://review.openstack.org/194987
    Modify update_packages decorator

Addressed by: https://review.openstack.org/195636
    Check that verify scenario fails before patching

Addressed by: https://review.openstack.org/195638
    Check that verify scenario fails before patching

Addressed by: https://review.openstack.org/196998
    Compare Rally tests results before/after patching

Addressed by: https://review.openstack.org/182577
    Add Rally benchmark tool to the system tests

Addressed by: https://review.openstack.org/198717
    Replace env for nova-compute packages

Addressed by: https://review.openstack.org/198743
    Add ability to destroy generated images

Addressed by: https://review.openstack.org/199054
    Replace env for nova-compute packages

Addressed by: https://review.openstack.org/199484
    Change the way of adding proposed repos

Addressed by: https://review.openstack.org/199503
    Change the way of adding proposed repos

Addressed by: https://review.openstack.org/201576
    Add and delete all roles from cluster in patching

Addressed by: https://review.openstack.org/204062
    Add downloading artifacts and env images clean

Addressed by: https://review.openstack.org/204069
    Add and delete all roles from cluster in patching

(?)

Work Items

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.