Commit graph

62 commits

Author SHA1 Message Date
Ray Speth
85c34049b6 Added support for running single tests with SCons
Run the 'foo' test with 'scons test-foo'.
Also simplified the names for many tests.
2012-01-09 17:35:06 +00:00
Ray Speth
124f8b9f6b Tests now look for elements.xml in the source tree. 2011-12-20 03:06:35 +00:00
Ray Speth
d587c093de Clean up most artifacts of building the tests under Windows 2011-12-14 19:36:40 +00:00
Ray Speth
00fdf5d3f5 SCons now continues over failed tests and prints a summary at the end 2011-12-14 19:36:21 +00:00
Ray Speth
d2eba8e5e0 Fixed ck2cti tests to run under Windows 2011-12-14 19:36:17 +00:00
Ray Speth
b44ebe45a3 SCons now runs all of the Python regression tests 2011-12-14 19:36:12 +00:00
Ray Speth
c3f4972f52 Improvements to the SCons regression test handler
Refactored SCons testing code to handle tests using prebuilt binaries.
Now handles regression tests where the standard output is ignored.
Also, allows regression tests to ignore lines starting with specified
strings.
2011-12-14 19:36:03 +00:00
Ray Speth
be92c4cbc5 Added support for command line options for regression tests 2011-12-14 05:55:40 +00:00
Ray Speth
5c95d30807 Use relative tolerances for comparing csv file in regression tests
Each test can have a different threshold and tolerance, reducing the
need to recreate blessed output files in response to small numerical
changes.
2011-12-14 05:55:35 +00:00
Ray Speth
d7a384e25d Extended SCons testing to be able to handle multiple output files
Extra files to be compared are passed as a list of tuples of
(blessed_output, test_output) using the 'comparisons' keyword
argument.
2011-12-14 05:55:24 +00:00
Ray Speth
70c71b5448 SCons can now run most of the tests in the test_problems directory
Does not yet handle tests with multiple outputs or tests requiring
additional command line arguments.
2011-12-14 05:55:05 +00:00
Ray Speth
a9028d6b77 Added test building and running capabilities to SCons scripts 2011-12-14 05:54:56 +00:00