Defect Analyst Bug Review Dashboard

Registered by Brian Murray on 2011-10-19

Defect Analysts have hundreds, if not thousands, of bug reports at which they could be looking. Their dashboard will be a collection of the highest priority bugs to review on a daily basis with links to reports of bugs matching specific criteria.

Blueprint information

Status:
Complete
Approver:
Kate Stewart
Priority:
Medium
Drafter:
Brian Murray
Direction:
Approved
Assignee:
Brian Murray
Definition:
Superseded
Series goal:
Accepted for precise
Implementation:
Started
Milestone target:
None
Started by
Kate Stewart on 2012-01-09
Completed by
Ursula Junque on 2012-05-07

Related branches

Sprints

Whiteboard

This blueprint was superseded by https://blueprints.launchpad.net/ubuntu/+spec/other-q-defects-dashboard. It's impossible to find the blueprint above by regularly trying to "Mark Superseded", so I marked Superseded and added this comment by hand. -- Ursinha (2012-05-06)

Priority List:
1) bugs assigned to the team
2) bugs tagged iso-testing (what about recently tagged?)
3) bugs that have transitioned away from Fix Released
4) bugs that have been set to High or Critical
5) bugs that have been set to Triaged
6) bugs that have been tagged regression-
7) bugs that have been Confirmed
8) bugs that are Incomplete w/ response
9) New bugs sorted by heat (assuming heat is useful)

This for a team of people who want to be involved in bug triaging
http://reports.qa.ubuntu.com/reports/qadashboard/qadashboard.html

Question:
What kinds of information would be useful?
 - Packages "trending": that had reported more bugs
   * http://reports.qa.ubuntu.com/reports/foundations-bugs/recent-package-bugs.html
- Packages receiving new bugs including information about the importance
- The 20? hottest bugs across all the packages (bug heat?)
- Finding bug reports that have been reopened (date_left_closed exists on a
  bug task)
- Bugs that are awaiting SRU verification (watch for comments ... people
  commenting on them and not adding the verification-done tag)
- Bitesize bugs (as an ubuntu-server team member I want to find things I can work on)
 - these appear in harvest (out of scope)
- Old bugs In Progress (both those that are assigned to team members and that
  are not)

Ideas:
 * For which of these priorities can Launchpad reports be used?
  1, 9, 8
  2 is possible if you just want to see the bugs that are tagged iso-testing
not possible to see ones that were recently tagged iso testing (talk to
isotracker people about this?)
  3 to 7 - the field is in the database but it isn't queryable in the web
interface nor API...
   * part of the reason for this is that the results of advanced does't confir that what you searched for is what you got (e.g. if you query for bug_reporter=brian-murray you don't see that in the bug listings)
Data gathering should be separate from report creation.
Dashboard should show link to report and quantity in that report?
Look at http://lpqateam.canonical.com/ as an example of a dashboard
Collecting information across multiple packages
Report creation tools should be easy to access
 - Currently http://launchpad.net/ubuntu-reports
Aggregation of team stats into a overview for the release manager ... a summary at the top level
Search will start from packages / projects to which a team is subscribed
Our reports today (most of them):
  - http://reports.qa.ubuntu.com/reports/

Launchpad issues:
 - not possible to distinguish between a bug confirmed by the janitor and a
   bug not confirmed by the janitor (http://launchpad.net/bugs/274358)
 - date_last_updated changes when someone subscribes to a bug (http://launchpad.net/bugs/879589)

Work Items:
[brian-murray] Talk to stgraber regarding data dump from iso tracker bugs tagged iso-testing with date information (easier than using launchpad): DONE
[brian-murray] File bugs (a separate bug for each) on LP to be able to search given dates when statuses changed (3, 4, 5, 7) - (add that as a search parameter, date_since_somethingchanged): DONE
[brian-murray] Escalate https://bugs.launchpad.net/bugs/879589 (re date_last_updated changes) with stakeholder representative: DONE
[kate.stewart] review the definition of bug heat and determine if it is useful or not and what would be more useful if it isn't: interested people (mtaylor, ttx, kate.stewart, bdmurray, pedro, cgregan, Ursinha, mrevell, sinzui, victorzhou) Existing LP definition is https://help.launchpad.net/Bugs/BugHeat: DONE
File a bug against LP to be able to easily get the activity information of a bug through the api (LP: #929928): DONE
[ursinha] sketch proposals of what the dashboard should look like with some design input - work in progress putting information together, haven't looked for design input yet, though: POSTPONED
[brian-murray] File bugs about the bug_subscriber timeout (LP: #904339): DONE

2012/02 - Bug Heat definition felt to need some adjustment, but is generally useful. Current experiments with Bug Gravity - which is based on elements of the heat.

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.