Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 7 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) |
OpenAntEditorTest#testOpenAntEditor1() | - 5.5% [±29.8] | - 5.8% [±35.2] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.7s is not within [0%, 110'%] of 0.6s - 16.4% [±42.0] |
OpenAntEditorTest#testOpenAntEditor2() | - 4.9% [±1.4] | - 6.8% [±3.9] | - 5.6% [±1.4] |
OpenAntEditorTest#testOpenAntEditorNoFolding() | - 5.8% [±1.4] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.25s is not within [0%, 110'%] of 0.22s - 10.2% [±1.9] | - 8.3% [±1.1] |
SeparateVMTests#testBuild() | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 5.5s is not within [0%, 110'%] of 5s - 10.1% [±1.8] | - 0.8% [±1.4] | - 1.2% [±0.5] |
SeparateVMTests#testBuildMinusDebug() | - 4.6% [±0.7] | - 3.9% [±0.3] | - 0.4% [±0.1] |
SeparateVMTests#testBuildNoConsole() | +1.5% [±0.7] | +3.0% [±0.4] | +0.0% [±0.1] |
SeparateVMTests#testBuildWithLotsOfLinks() | n/a | n/a | - 1.4% [±0.1] |