Some Junit test results are randomly being dropped

[armaanPy]

Jenkins and plugins versions report

Plugins

JUnit Plugin - v1.29

What Operating System are you using (both controller, and any agents involved in the problem)?

Controller - Linux (amd64)
Agent(s) - Windows 10 (amd64)

Reproduction steps

1. Step 1: Run 14 tests in Jenkins in parallel shared across 9 Windows agents.
2. Step 2: All of the 14 tests generate an XML file which is successfully stashed.
3. Step 3: Post build, unstash the XML files,
4. Step 4: Execute the Junit test archive command with:
   junit allowEmptyResults: false, testResults: '**\\*.xml'

Expected Results

I expect to see 14 test results at all time.

Actual Results

This is random, on some occasions I see all 14 test results output to Jenkins, and on other occasions I only see 13 or 12.

Anything else?

We are currently running JUnit plugin v.129 on Jenkins, I am not certain if my issue is related to https://issues.jenkins.io/browse/JENKINS-48583, therefore I raised this issue.

[timja]

Please provide a minimal reproduce able test case.

A pipeline that can reproduce this would likely be most appropriate

[armaanPy]

@timja Apologies for the formatting, but I am running something like this. We are currently running JUnit plugin v.129 on Jenkins, I am not certain if my issue is related to https://issues.jenkins.io/browse/JENKINS-48583.

pipeline {
agent {
node {
label "Win"
}
}
stages {
stage('Tests') {
parallel {
stage('Test1') {
agent {
node {
label "Windows && aws && r5.2xlarge"
}
}
steps {
dir('TestLab') {
script {
final runTest1 = runSingleTest("Test1", "Test1.xml", "Test1.log")
bat """
${runTest1}
"""
}
stash allowEmpty: false, includes: "Test1.xml", name: "Test1-XML"
cleanWs()
}
}
}
stage('Test2') {
agent {
node {
label "Windows && aws && r5.2xlarge"
}
}
steps {
dir('TestLab') {
script {
final runTest2 = runSingleTest("Test2", "Test2.xml", "Test2.log")
bat """
${runTest2}
"""
}
stash allowEmpty: false, includes: "Test2.xml", name: "Test2-XML"
cleanWs()
}
}
}
stage('Test3') {
agent {
node {
label "Windows && aws && r5.2xlarge"
}
}
steps {
dir('TestLab') {
script {
final runTest3 = runSingleTest("Test3", "Test3.xml", "Test3.log")
bat """
${runTest3}
"""
}
stash allowEmpty: false, includes: "Test3.xml", name: "Test3-XML"
cleanWs()
}
}
}
}
post {
always {
dir('XML_Outputs') {
unstash 'Test1-XML'
unstash 'Test2-XML'
unstash 'Test3-XML'
junit allowEmptyResults: false, testResults: '**\*.xml'
}
cleanWs(
cleanWhenAborted: true,
cleanWhenFailure: true,
cleanWhenSuccess: true,
cleanWhenUnstable: true,
)
}
}
}
}
}