Benchmark reports in Launch Control

Status: Postponed unfinished items, see below for details

Michael Hope expressed concern that while the use cases are captured faithfully the proposed solution may not be what he indented. He has suggested to offer a query language (it was not stated if it's SQL) and to match the tool to the indented, highly technical audience.

Some additional insight can be found on http://speed.pypy.org/timeline/. The application there is django can be reused to some extent. I talked with developers on #pypy and they suggested to talk to Miquel Torres (tobami at gmail) or (preferred) pypy-dev mailing list. I asked about running tests on various hardware and the difficulties that poses in reporting and pypy developers expressed their interest but mentioned lack of hardware resources to do that in their setup.

[pwlars, Apr 26] I think all of this should be superseded by the new data views/reporting blueprints right? Any reason we shouldn't kill the rest of these work items on those grounds?
[zyga, ^^] Yup, postponing all items. We should leave this blueprint for reference though.

Work items:
Mirror http://builds.linaro.org/toolchain/: DONE
Write prerequisite tools for creating JSON bundles: DONE
Write a tool that imports data from http://builds.linaro.org/toolchain/ using code in lp:tcwg-web and is able to make dashboard bundles: DONE
Talk to speed.pypy.org upstream: POSTPONED
Estimate cost to adapt/extend that codebase: POSTPONED
Work with Michael Hope to incorporate that tool and launch-control-tool (from ppa:linaro-infrastructure/launch-control) to publish data on dashboard.linaro.org as it is being generated: POSTPONED
Design UI elements: DONE
Write a report that shows single test, single board, all variants (group by), all compilers (group by) using hybrid bar chart / scatter plot: POSTPONED
Write a report that shows single test, single board, single variant, all compilers (group by) using hybrid bar chart / scatter plot: POSTPONED
Write a report that shows single test, single board, single variant, single compile, all revision (across time) using line chart with either time or revisions on X axis: POSTPONED
Write a report that shows single test, single board, all variants (separate lines), single compile, all revision (across time) using line chart with either time or revisions on X axis: POSTPONED
Write a report same as above but normalize the results against one of: gcc-4.*, gcc-linaro-201*, gcc-linaro-4.5+bzr*, gcc-cls-*: POSTPONED
Write a report that shows single test, all boards (group by), single variant, single compiler, single revision: POSTPONED
Add an ability to see all charts as raw tables of data: POSTPONED
Add an ability to save charts as images: POSTPONED