bL MP Sched: Integrate ARMs functional regression tests
Integrate functional and regression tests for scheduler from ARM, covering HMP patches
Blueprint information
- Status:
- Complete
- Approver:
- Alexander Sack
- Priority:
- High
- Drafter:
- Naresh Kamboju
- Direction:
- Needs approval
- Assignee:
- Naresh Kamboju
- Definition:
- Approved
- Series goal:
- None
- Implementation:
-
Implemented
- Milestone target:
-
2013.04
- Started by
- Naresh Kamboju
- Completed by
- Naresh Kamboju
Related branches
Sprints
Whiteboard
[nkambo Mar 13 2013]
HMP patches test coverage has done in workload-automation tests and scheduler test suite.
big.LITTLE IKS daily builds are integrated with workload-automation test execution as LAVA job [1]. which is not yet integrated with big.LITTLE MP daily build [2] which needs to be addressed in March cycle.
scheduler test integration on to LAVA is not yet done, which needs to be addresses in March cycle.
- Attached bugs on "scheduler test suite execution missing in bL mp test build"
- Attached bugs have been filed against lava-validation-lab "lava: wget: bad address 'people.linaro.org' "
[nkambo Mar 13 2013]
Workload-automation tests have been executed on ikshackbox with big.LITTLE MP image and results have been published as a part of big.LITTLE IKS release task.
[nkambo Mar 31 2013]
Attached bug "scheduler test suite execution missing in bL mp test build" need to be fixed to complete this blueprint. Attached bug has been targeted to 13.04.
[asac Apr 3 2013]
MOve over to 13.04; bump priority; blocked on a bug waiting for android team to come up with the new way to do test suites outside the build; decided to not wait for that anymore and land the test in old style.
[nkambo Apr 24 2013]
We have found an other way to build the test source outside the AOSP. this work is done by Axel Android team.
"scheduler test suite execution missing in bL mp test build"
https:/
the outcome of this idea is this build
https:/
https:/
I will be testing these builds today and confirm the results.
[nkambo Apr 25 2013]
sched-testsuite
https:/
Test produced expected results.
Test log:
https:/
bL-iks-
https:/
This build has MP kernel image and IKS test suite.
If i have to run IKS test suite, then i have to change the kernel image.
We can not release this to members as it is.
Now, I have changed 13.04 IKS release kernel and tested IKS test suite.
https:/
[nkambo Apr 25 2013]
following are accomplished in this blue print:
1. Scheduler test implementation is completed.
2. Building scheduler tests in Android builds are completed.
3. Running tests on TC2 is completed.
4. Results have been publishing weekly in linaro-dev list.
5. Scheduler test suite structure has been changed, new LAVA test case need to be created. which will be addressed in bug 1125983.
6. big.LITTLE MP workload automation test execution is in place. which we are running on Linaro Golden Board (LGB).
7. Planning to add big.LITTLE MP workload automation on LAVA, which will be addressed in other blueprint: "Integrate bL MP configs on workload automation test suite" https:/
Followup work will be done:
1. Scheduler test suite structure has been changed, new LAVA test case need to be created. which will be addressed in bug 1125983.
2. Planning to add big.LITTLE MP workload automation on LAVA, which will be addressed in other blueprint: "Integrate bL MP configs on workload automation test suite" https:/
The work items proposed in this blueprints are completed.
LAVA Integration will be address in followup work.
I would like to propose this blue-print is implemented.
Meta:
Headline: Integrate functional and regression tests for scheduler from ARM, covering HMP patches
Acceptance:
1. The Workload Evaluation System from ARM is integrated into LAVA
2. The tests are run periodically on TC2 to look for regressions on big.LITTLE IKS and MP
Roadmap id: CARD-209
Deliverable :
1. scheduler test suite (linaro private repo)
2. bL MP sched_test_results spread sheet.
+ https:/
3. workload automation results spreadsheet
big.LITTLE Benchmark spread sheet:
+ https:/
Mathieu-
+ https:/
4. scheduler test suite Android build:
+https:/
Work Items
Work items:
Develop new test cases for covering HMP patches: DONE
Test developed Test case on TC2 platform with Android image: DONE
Integrate workload-automation test suite on to big.LITTLE mp test builds: DONE
publish results with bL MP team: DONE
