10 run.py in this directory. |
10 run.py in this directory. |
11 |
11 |
12 run.py drives the execution of our api and cli test suites, and |
12 run.py drives the execution of our api and cli test suites, and |
13 compares the results to a baseline file stored in baseline.txt. |
13 compares the results to a baseline file stored in baseline.txt. |
14 |
14 |
15 run.py can also be run standalone with a variety of options: |
15 run.py can also be run standalone with a variety of options. |
|
16 Use "run.py -h" to see what options are supported. |
16 |
17 |
17 Usage: run.py [-ghptv] [-c format] [-b filename] [-o regexp] |
18 To run subsets of tests or individual tests, use the "-o" or the "-s" |
18 run.py [-hptvx] [-c format] [-b filename] [-s regexp] [-o regexp] |
19 options to select what tests to run. |
19 -a <dir> Archive failed test cases to <dir>/$pid/$testcasename |
20 |
20 -b <filename> Baseline filename |
21 For example: |
21 -c <format> Collect code coverage data in xml or html format |
22 - To run the tests in cli/t_pkg_install.py: |
22 -d Show debug output, including commands run, and outputs |
23 $ run.py -o cli.t_pkg_install |
23 -f Show fail/error information even when test is expected to fail |
24 - To run just the tests in the TestPkgInstallActions class in that file: |
24 -g Generate result baseline |
25 $ run.py -o cli.t_pkg_install.TestPkgInstallActions |
25 -h This help message |
26 - To run just the "test_bad_hardlinks" test: |
26 -j Parallelism |
27 $ run.py -o cli.t_pkg_install.TestPkgInstallActions.test_bad_hardlinks |
27 -o <regexp> Run only tests that match regexp |
|
28 -p Parseable output format |
|
29 -q Quiet output |
|
30 -s <regexp> Run tests starting at regexp |
|
31 -t Generate timing info file |
|
32 -u Enable IPS GUI tests, disabled by default |
|
33 -v Verbose output |
|
34 -x Stop after the first baseline mismatch |
|
35 -z <port> Lowest port the test suite should use |
|
36 |
28 |
37 When adding, removing, or changing the results of test cases, make |
29 When adding, removing, or changing the results of test cases, make |
38 sure to update baseline.txt and check it in. This can be done with the |
30 sure to update baseline.txt and check it in. This can be done with the |
39 -g option to run.py. |
31 -g option to run.py. |
40 |
32 |