ARM Sleep/hibernation testing

[asac 18-12-09] ... had to flip the way this is targetted to play nicely with pittis scripts. using alpha-2 as final milestone atm and marking alpha-3 tasks - in this way the items stay on the alpha-2 report.
[asac 18-12-09] at risk for alpha-2; pushing implementation back to alpha-3, keeping documentation, decision making targetted for lucid-alpha-2 though.
[asac 27-11-09] removed "support" from the title as that is better covered in https://blueprints.edge.launchpad.net/ubuntu/+spec/mobile-lucid-arm-per-soc-powermanagement
[asac 28-11-09] drafted summary/rational/design section; implementation and work items next ...
[asac 02-12-09] tentatively targetting alpha-2 ... @plars: feel free to object if that doesnt work ;).
[asac 04-12-09] added work itesm so we can reset burn down chart.
[asac 08-01-10] reviewed all entries with plars and persia; decided on priorities and talked about how to impelement them. all done for alpha-2
[plars 21-01-10] Items under "extra" are ones that I am not targeting due to lack of support, lack of hardware, or prioritization. However if anyone else is interested in implementing these items, please let me know and we can attach your name to the work item, and I will be happy to provide assistance.
[plars 04-02-10] Found a problem with the suspend_test in checkbox (516843) where it does not detect resume on armel. Worked around for now in my branch. Utilizing this script to perform the timed suspend/resume. Wrote a new script that does some consistency checks before/after the suspend.
[plars 24-02-10] The tests for base and std are complete, and in a branch at lp:~pwlars/+junk/checkbox-susres for now if anyone wants to take a look

Work items:
Fill out wiki with implementation details on each item: DONE
Decide and document testcase priorities; sort into three classes; base, standard, extra: DONE
Assign priority to testcase work items: DONE
Review all testcases with asac and decide which one will be automated this cycle: DONE
Fill out Summary or kill/defer all testcases for class "base": DONE

Work items (lucid-alpha-3):
Implement in checkbox or add manual instructions to testplan - memory/ECC: DONE
Implement in checkbox or add manual instructions to testplan - network: DONE
Implement in checkbox or add manual instructions to testplan - graphics: DONE
Implement in checkbox or add manual instructions to testplan - HID devices: DONE
Implement in checkbox or add manual instructions to testplan - cpufreq/voltage: DONE
Fill out Summary or kill/defer all testcases for class "standard": DONE
Implement in checkbox or add manual instructions to testplan - usb/usb otg: DONE
Implement in checkbox or add manual instructions to testplan - media playback: DONE
Implement in checkbox or add manual instructions to testplan - SD card/SDIO: DONE
Implement in checkbox or add manual instructions to testplan - wireless soft switch: DONE
Implement in checkbox or add manual instructions to testplan - keyboard soft switches: DONE
Fill out Summary or kill/defer all testcases for class "extra": DONE
Implement in checkbox or add manual instructions to testplan - v4l: POSTPONED
Implement in checkbox or add manual instructions to testplan - multi-display: POSTPONED
Implement in checkbox or add manual instructions to testplan - bluetooth adapters/devicesb: POSTPONED
Implement in checkbox or add manual instructions to testplan - pcie: POSTPONED
Implement in checkbox or add manual instructions to testplan - PCMCIA: POSTPONED
Implement in checkbox or add manual instructions to testplan - eSATA: POSTPONED
Implement in checkbox or add manual instructions to testplan - network file systems: POSTPONED
Implement in checkbox or add manual instructions to testplan - network block devices (nbd, iSCSI, etc): POSTPONED
Implement in checkbox or add manual instructions to testplan - multicore tests: POSTPONED
Implement in checkbox or add manual instructions to testplan - Mobile radio/telephony devices: POSTPONED
Implement in checkbox or add manual instructions to testplan - fan/cooling: POSTPONED
Implement in checkbox or add manual instructions to testplan - Encryption Engines: POSTPONED
Implement in checkbox or add manual instructions to testplan - NAND/MTD: POSTPONED
Implement in checkbox or add manual instructions to testplan - backlight: POSTPONED

Work items ubuntu-10.04-beta-1:
Propose merge into main checkbox branch: DONE
send announce mail about suspend-resume testing to mailing lists: DONE
establish suspend-resume testing as standard QA procedure: DONE

Status:
done: general suspend resume testing available; todo: implement more device specific tests