Refstack implementation for Defcore additional properties waiver

Registered by Luz Cazares

Defcore committee approved a waiver that allows vendors who are using the Nova 2.0 API with additional properties to disable strict response checking when testing products for the OpenStack Powered program in 2016.
As a response, Resfstack-client is adding an optional parameter to the test command so that the waiver is applied automatically when needed.
Proposed changes
1. Add “waiver” parameter to test command:
refstack test
--waiver Apply Defcore waiver to disable strict Nova response checking.
2. Modify run method to support waiver option:
Run ostestr with --subunit and –no-pretty flags to get results as a flat subunit stream.
Run find_additional_properties.py (passed result stream) to get non-compliant failed test cases
Patch tempest lib to disable strict validation
Run failed test cases
3. Patch reporter so that when waiver is used, non-compliant failed test cases are identified properly.

Blueprint information

Status:
Not started
Approver:
None
Priority:
Medium
Drafter:
Luz Cazares
Direction:
Needs approval
Assignee:
Luz Cazares
Definition:
Discussion
Series goal:
None
Implementation:
Unknown
Milestone target:
None

Related branches

Sprints

Whiteboard

(?)

Work Items

Work items:
Specification ( https://review.openstack.org/#/c/349213/ ) : INPROGRESS
Refstack-client patch https://review.openstack.org/#/c/370534/ : INPROGRESS

This blueprint contains Public information 
Everyone can see this information.