Success critera for the task

Registered by Sergey Skripnick

Add section in task configuration that contains the criteria of success, e.g "less then 5% of failure rate", or "faster then 5 seconds for one iteration"

Add rally subcommand that checks if task succeeded according to criteria.

Blueprint information

Status:
Complete
Approver:
Boris Pavlovic
Priority:
Medium
Drafter:
Sergey Skripnick
Direction:
Approved
Assignee:
Sergey Skripnick
Definition:
Approved
Series goal:
None
Implementation:
Implemented
Milestone target:
None
Started by
Sergey Skripnick
Completed by
Boris Pavlovic

Related branches

Sprints

Whiteboard

Configuration might look like this:

            "runner": {
                "type": "constant",
                "times": 10,
                "concurrency": 2
            },
            "context": {
                "users": {
                    "tenants": 2,
                    "users_per_tenant": 3
                }
            },
            "success_criteria": {
                "max_failure_percent": 1,
                "max_seconds_per_iteration": 60
            }

Subcommand might look like this:

  rally task criteria-check --task %TASK_UUID%

Gerrit topic: https://review.openstack.org/#q,topic:bp/task-success-criteria,n,z

Addressed by: https://review.openstack.org/98158
    Add task success criteria

(?)

Work Items

Work items:
[eyerediskin] config section: INPROGRESS
subcommand: TODO

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.