Free content traces for benchmarking

Registered by Jesse Barker on 2011-04-21

Part of our benchmarking efforts involve evaluating real application behavior in addition to synthetic tests. However, not all content is suitable for packaging and distribution due to images, sounds or other pieces of data that it is difficult or not possible to get redistribution rights for. It would be good to have more traces that are based on free content, but still exercise the system.

Blueprint information

Status:
Complete
Approver:
Jesse Barker
Priority:
Medium
Drafter:
None
Direction:
Approved
Assignee:
Alexandros Frantzis
Definition:
Approved
Series goal:
Proposed for trunk
Implementation:
Informational Informational
Milestone target:
None
Started by
Alexandros Frantzis on 2011-07-25
Completed by
Alexandros Frantzis on 2011-07-25

Related branches

Sprints

Whiteboard

Summit session notes:

* SVG drawing (eg cairo, qt)
 * Inkscape
 * Websites with svg
* Websites with canvas
 * Qt may need non trivial tracing engine changes

 * GLES2 traces
  * Screensavers? (need porting)
  * Games (need porting too)
  * Example content from GLES2 game engines.
  * use benchmark plugin of compiz to acquire traces
 * Caveats
  * Licensing concerns
  * Memory consumption for playback
   * Improve memory consumption in qt tracing engine
* Tools for automated capture of traces
* Improve documentation regarding trace capture and playback

Work items (tentative)
[ACTION]: Capture inkscape svg drawing traces
[ACTION]: Capture traces from SVG heavy websites
[ACTION]: Investigate qt tracing engine improvements (pixmap draws, memory consumption)
[ACTION]: Investigate if we can use example content from free GLES2 game engines as material
for tracing.
[ACTION]: Write up document describing how to capture and replay traces (cairo, qt. gles2)
[ACTION]: Investigate if/how we can acquire GLES2 data sets from universities to use for traces
[ACTION]: Decide on GLES2 tracing app to use (may need to wait for later in the cycle, after we have made improvements to the tools).
[ACTION]: Check OglPerf benchmark license - chunsang

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.

This blueprint contains Public information 
Everyone can see this information.