Add SPEC 2006
Chris from LLVM prefers SPEC 2006. We don't run it currently as some of the tests require more than 1 GB of RAM and swapping in a test is bad.
We have a license of SPEC 2006. Harness up similar to SPEC 2000, disable the excessive memory benchmarks, add to cbuild, and add to our regular runs.
Blueprint information
- Status:
- Complete
- Approver:
- Michael Hope
- Priority:
- High
- Drafter:
- Michael Hope
- Direction:
- Approved
- Assignee:
- None
- Definition:
- Approved
- Series goal:
- Accepted for trunk
- Implementation:
-
Informational
- Milestone target:
-
backlog
- Started by
- Matthew Gretton-Dann
- Completed by
- Matthew Gretton-Dann
Related branches
Related bugs
Sprints
Whiteboard
From "SPEC CPUint2006 characterization", the SPECINT benchmark versus memory usage is:
400.perlbench: up to 500 MB
401.bzip2: virtual of 900 MB, up to 500 MB resident
403.gcc up to 800 MB
429.mcf: up to 900 MB
445.gobmk: 25 MB
456.hmmer: 30 MB
458.sjeng: 180 MB
462.libquantum: 100 MB
464.h264ref: 70 MB
471.omnetpp: 100 MB
473.astar 300 MB
483.xalancbmk: 350 MB
It seems reasonable to run these on a 1 GB machine and see if they're reproducible.
[2013-08-22 matthew-
Work Items
Work items:
Build the native tools: TODO
Add the cbuild script: TODO
Find and disable tests with high memory use: TODO
Baseline: TODO
