Gate jobs should fail if ERRORs in logs

Registered by David Kranz on 2013-09-26

Operators and tests need to know if ERRORs are generated in logs. This is only useful if developers call log.error only if operator attention is needed. Currently there are ERRORs in many log files even after successful runs. These need to be fixed and then jobs should fail if new ERRORs appear. Until the bugs are fixed there will be a whitelist of ERRORs that are grandfathered.

Blueprint information

Status:
Complete
Approver:
David Kranz
Priority:
High
Drafter:
David Kranz
Direction:
Approved
Assignee:
David Kranz
Definition:
Approved
Series goal:
Accepted for icehouse
Implementation:
Implemented
Milestone target:
milestone icon icehouse-rc1
Started by
David Kranz on 2013-10-10
Completed by
Giulio Fidente on 2013-12-19

Related branches

Sprints

Whiteboard

Gerrit topic: https://review.openstack.org/#q,topic:bp/fail-gate-on-log-errors,n,z

Addressed by: https://review.openstack.org/49808
    Initial log check script to be called by devstack-gate

Addressed by: https://review.openstack.org/50795
    Script to filter logs for ERRORs based on whitelist

I hope the existing, whitelisted errors can be cleared out by Icehouse release.

We'll have to ensure existing errors from logs are cleaned but the feature is implemented and the BP closed (Dec 2013)

(?)

Work Items

Work items:
File bugs for existing reliable log ERRORs: DONE
Create whitelist in a tempest file: DONE
Create logcheck script and call it: DONE
Track flaky errors: DONE
Start failing the gate on errors: DONE
Zero-out white list as bugs are fixed: TODO

This blueprint contains Public information 
Everyone can see this information.

Subscribers

No subscribers.