Testing: call tempest function from tox
Currently, we are deploying tempest into a container and executing tempest by instructing ansible to issue a shell command. This works, and may be appropriate for the AIO and tempest roles, but is not optimal for individual role repository testing.
I propose we install tempest on the local host (via ansible in the usual way), but then have another command in tox that actually executes the tempest check directly. This will produce far better logs for examining tracebacks when tempest fails.
Potential negative impact: There will be more to maintain in each role's tox.ini, but this should be offset by less to maintain in each role's plays.
Alternative: Log tempest results somewhere and cat them out at the end of a failed run.
Blueprint information
- Status:
- Not started
- Approver:
- None
- Priority:
- Undefined
- Drafter:
- Michael Gugino
- Direction:
- Needs approval
- Assignee:
- None
- Definition:
- New
- Series goal:
- None
- Implementation:
-
Unknown
- Milestone target:
- None
- Started by
- Completed by
Related branches
Related bugs
Sprints
Whiteboard
My alternative suggestion is to implement something like https:/
I think uploading the results into logs is a good approach. I think should call tempest from the roles directly, via ansible or otherwise, so we don't have to do too much templating of the tempest role.
Gerrit topic: https:/
Addressed by: https:/
[WIP] Execute tempest using updated method
Gerrit topic: https:/
Addressed by: https:/
Execute tempest using updated method
Addressed by: https:/
Using updated tempest method for neutron.
Addressed by: https:/
Using updated tempest method for ceilometer.
Addressed by: https:/
Using updated tempest method for aodh api.
Addressed by: https:/
Using updated tempest method for cinder.
Addressed by: https:/
Using updated tempest method for keystone.
Addressed by: https:/
Using updated tempest method for trove api.
Addressed by: https:/
Using updated tempest method for horizon.
Addressed by: https:/
Using updated tempest method for designate api.
Addressed by: https:/
[WIP] Add multiple scenarios for testing
Addressed by: https:/
Execute tempest using updated method
Addressed by: https:/
Execute tempest using updated method
Addressed by: https:/
Execute tempest using updated method
