Up to 12.1, failure to compile a unit test resulted in a job failure:
test1:
[ABLUnit] Could not locate element 'isTue' in class 'OpenEdge.Core.Assert'. (12927)
[ABLUnit] QUIT statement found
BUILD FAILED
Since 12.2, this is not the case anymore, there's just a line in the log output:
test1:
[ABLUnit] Unable to build type info for C:\Users\gquer\projets\pct\testbox\ABLUnit\test8\src\ABLUnitTest.cls: Could not locate element 'isTue' in class 'OpenEdge.Core.Assert'. (12927)
[ABLUnit] QUIT statement found
[ABLUnit] Total tests run: 0, Failures: 0, Errors: 0
BUILD SUCCESSFUL
I'd consider that a potential problem, as I suspect that almost nobody read the output of the unit tests (that's usually buried in a very long log file). Was that done on purpose ? Or is it an unintended side effect ?
Then there's definitely a regression. My test case is here: github.com/.../test8
I expect a build failure to happen, as the .cls file which is tested doesn't compile. Test is failing on 12.2, and only on this version. I've tried the Progress version of ABLunit task, same problem, there's no failure:
test1:
[ablunit] Running C:\Users\gquer\projets\pct\testbox\ABLUnit\test8\src\ABLUnitTest.cls
BUILD SUCCESSFUL
Results.xml is generated, but no mention of the error in the file.
Results.xml is generated, but no mention of the error in the file.