Is it correct that shelved unit tests count as negative?

Continua CI Discussion
1

Just to be sure :slight_smile:

2

The only thing Shelving a unit test does, is stop it from failing a build if the unit test fails or errors. Not sure what you mean by negative?

3

we shelved 13 unit tests and the stage gate failed because it was checking for “= 0”.
hovering over the build item (colored version number) it shows “-13” unit tests in red.

so we changed “= 0” to “<= 0” in the stage gate, so we can continue. Now we are not sure if this is a wanted behavior or not

4

No - that does seem to be right. Which heading is the negative number under? What numbers are you seeing on the Unit Tests tab of the Build view for each heading e.g. total, passed, failed, new failures, errors, not run, skipped. Which unit test runner are you using? Which Continua version are you running?

5



we are running 1.7.0.108 and we use MsTest 2010.

6

hm, image thing does not work … http://ibin.co/2GOOths8L66o

7

That’s definitely not right, however I’m not getting the same result. Can you send us a copy of the *.trx file output from MSTest and I’ll do some more investigation tomorrow.

8

need to configure out build server first to keep the trx file. However, these shelved tests additionally fail (so we shelved them for now). Maybe thats the trick to reproduce it.

9

Hi Christian

Our  test includes shelved tests which fail but we don’t get the same results.

You can register the trx file as an artifact.

Add

  / < /.trx 

to the Workspace Rules, and 

.trx

to the Artifact Rules