Comment 2 for bug 1022531

Revision history for this message
Paul Sokolovsky (pfalcon) wrote :

> Do note that running local development tests should not involve talking to remote machines: it should be possible to do development and run all the tests without a network connection.

Yes, sure that's why there're unit vs integration tests, and they should be clearly separated. The story here is, when starting on linaro-ami in the given timeframe, we understood that we won't have enough time to write complete full-fledged testsuite, and given the choice (well, dilemma), we decided to concentrate on integration tests - we really needed them, because even I didn't know all EC2 API we needed, and only integration tests can prove that the tool really works (because most of problems are in integration domain, not in our code). The plan was to elaborate testsuite later, when time permits. Unfortunately, part of integration tests were replaced with unit tests, instead of being added to.

So, what I'm doing now is recovering most useful old integration tests for RemoteExecutore, and restructure testsuite so unit and integration tests were clearly separated, and it was possible to run each subsuite separately. I also want to make only unittests to run by default, with running full testsuite (incl. integration) requiring explicit user intention.