ARM Server Benchmarking and Performance

Registered by Michael Casadevall on 2011-10-11

As actual ARM server hardware begins to enter the marketplace, a standardized way to test and benchmark performance must be developed and run on all active platforms we support for ARM server.

Blueprint information

Status:
Not started
Approver:
David Mandala
Priority:
Undefined
Drafter:
Michael Casadevall
Direction:
Needs approval
Assignee:
None
Definition:
Drafting
Series goal:
None
Implementation:
Unknown
Milestone target:
None

Related branches

Sprints

Whiteboard

As actual ARM server hardware begins to enter the marketplace, a standardized way to test and benchmark performance must be developed and run on all active platforms we support for ARM server.

http://www.phoronix-test-suite.com/

http://openbenchmarking.org/

Upcoming PTS tests: MySQL, TPCC MySQL, various SPEC tests (might not be public), Unixbench, plus others (can also easily add in any others, just ask)

https://wiki.ubuntu.com/ARM/QA/Server

https://blueprints.launchpad.net/ubuntu/+spec/server-o-arm-image-qa

https://blueprints.launchpad.net/ubuntu/+spec/server-o-arm-image-validation

- membase?
- Ensure that multi-system testing setups are standardized
- weekly meeting to reveiw testing on #ubuntu-meeting (Thursdays 15:00 UTC)

ACTIONS:

- Automate testing [explore PTS documentation about batch-run options]
- Find an IPV6 testing tool
- Add a test for Membase
- Add a test for Hadoop and other workloads
- Explore stress/load testing (memtester, stress, kernel build test, netperf, unix bench)
- Test on real hardware when available
- Compare P test results against O.
- AHCI testing
- Investigate PTS logging sensor data [Run any test(s) with "MONITOR=all" environmental variable to see all sensors... or see included HTML/PDF documentation... or run "phoronix-test-suite system-sensors" to see all supported/unsupported sensors. Try latest PTS release for latest sensor coverage.]

(?)

Work Items

Dependency tree

* Blueprints in grey have been implemented.