1.09

General

• Add Code Coverage determination, see here (IP9 Build 38812 or higher)
• Allow analytics of code coverage tracing data, see here
• Add support for multi data and multi-multi data test cases
• Add INFO() function to output more information on failed test assertions, see here
• Add support for test code running in background functions, see also here.
• Add support for checking for free/local wave leaks (IP9 Build 39622 or higher)
• Add UTF_SKIP tag
• Mark test cases with zero sized data generator waves as skipped
• Call data generator only once for MD/MMD test cases
• Enforce that we have at least one assertion in each test case
• Fix hitting the sprintf limit (IP 8 or lower)
• Abort flag does no longer cover runtime errors
• Execute the test cases from top to bottom in each test suite
• Test the basic parts of our testing framework using the very tiny test environment VTTE
• Add generic function to report wrapper results
• Reorganize code and split it into more files
• TestCaseEnd: Silently ignore non-killable working folder
• Output state messages to stdout (IP 8 or higher)
• Enhance output on failed test assertion in test cases
• Tighten the check for test case signatures
• AfterFileOpenHook: Make it more robust
• Execute the builtin hooks also for failing user test hooks
• Always clear runtime errors before AbortOnRTE
• .gitlab.ci.yml: Add CI
• Moved NULL_WAVE flag to major flags for wave comparison in documentation
• Output failure summary at the end
• Allow unsaved experiments in some cases
• Allow fixed log file naming
• New option debugMode for more fine-grained debug control

Test assertions

• *_CLOSE_VAR: Prevent singularity
• *_SMALL_VAR: Change tolerance so that 0 is considered small with zero tolerance
• Add assertions <, <=, >, >= for double arguments, see *_LT_VAR,
  *_LE_VAR, *_GT_VAR, and *_GE_VAR
• *_EQUAL_STR: Make case sensitive comparison the default
• Added assertions for Int64 and UInt64 variables, see *_EQUAL_INT64 and
  *_EQUAL_UINT64

*_WAVE

• Require valid types as arguments
• Make the output more human readable

*_EQUAL_WAVES and *_EQUAL_TEXTWAVES

• Allow to check matching sizes of waves of different types
• Allow identical wave references
• Compare zero sized waves properly with set mode
• Make error reporting for custom mode patterns better
• Output descriptive error messages in WAVE_DATA mode
• Handle invalid mode correctly
• Work around EqualWaves dimension labels bug with certain IP versions
• Complain for unknown modes
• Make modes wave signed thus allowing -1 to be passed in to check all modes

JUNIT output

• Improve accuracy of test case/suite durations
• Remove optional TestSuite attribute disabled
• Add a <failure> tag for each failed assertion
• Handle expected failure test cases as skipped
• Add JUNIT reference and updated JUNIT section in documentation
• Drop timezone information as required by the "standard"
• Nicify properties output

TAP output

• Handle TODO gracefully
• Now also holds skipped testcases

See here for the full changelog.