Gate jobs should fail if ERRORs in logs
Operators and tests need to know if ERRORs are generated in logs. This is only useful if developers call log.error only if operator attention is needed. Currently there are ERRORs in many log files even after successful runs. These need to be fixed and then jobs should fail if new ERRORs appear. Until the bugs are fixed there will be a whitelist of ERRORs that are grandfathered.
Blueprint information
- Status:
- Complete
- Approver:
- David Kranz
- Priority:
- High
- Drafter:
- David Kranz
- Direction:
- Approved
- Assignee:
- David Kranz
- Definition:
- Approved
- Series goal:
- Accepted for icehouse
- Implementation:
- Implemented
- Milestone target:
- icehouse-rc1
- Started by
- David Kranz
- Completed by
- Giulio Fidente
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Initial log check script to be called by devstack-gate
Addressed by: https:/
Script to filter logs for ERRORs based on whitelist
I hope the existing, whitelisted errors can be cleared out by Icehouse release.
We'll have to ensure existing errors from logs are cleaned but the feature is implemented and the BP closed (Dec 2013)
Work Items
Work items:
File bugs for existing reliable log ERRORs: DONE
Create whitelist in a tempest file: DONE
Create logcheck script and call it: DONE
Track flaky errors: DONE
Start failing the gate on errors: DONE
Zero-out white list as bugs are fixed: TODO