Select which kind of scale you want to use: |
NaN
) or is infinite (happens when the reference value is equals to 0!)(build_test_time - baseline_test_time) / baseline_test_time
)sqrt(build_test_stddev^2 / N + baseline_test_stddev^2 / N) / baseline_test_time
)All 12 scenarios |
SLED 10 Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) | RHEL 5.0 Sun 6.0_04 (2 x 3.00GHz - 3GB RAM) | Win XP Sun 1.5.0_10 (2 x 3.00GHz - 3GB RAM) |
CollatorPerformanceTest#testCollator() | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.83s is not within [0%, 110'%] of 0.18s - 354.1% [±1.5] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.66s is not within [0%, 110'%] of 0.16s - 317.8% [±1.5] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 0.83s is not within [0%, 110'%] of 0.18s - 359.7% [±1.8] |
ComboViewerRefreshTest#testRefreshSmall() | - 2.1% [±0.2] | - 4.0% [±0.2] | - 0.3% [±0.4] |
FastTableViewerRefreshTest#testRefreshMultiple() | +11.0% [±6.7] | +3.5% [±9.8] | - 6.9% [±1.5] |
FastTableViewerRefreshTest#testUpdateMultiple() | +11.4% [±6.8] | - 2.2% [±10.4] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 51ms is not within [0%, 110'%] of 46ms - 10.9% [±1.8] |
FastTreeTest#testAddFiftyTenTimes() | - 1.7% [±0.8] | - 2.7% [±13.6] | +0.0% [±0.8] |
FastTreeTest#testAddHundredTenTimes() | - 1.4% [±0.7] | - 2.9% [±0.9] | - 0.3% [±0.6] |
FastTreeTest#testAddTenTenTimes() | - 0.5% [±3.1] | - 0.3% [±3.0] | - 1.0% [±2.1] |
ListViewerRefreshTest#testRefresh() | - 3.2% [±0.2] | - 3.3% [±0.3] | +0.9% [±1.0] |
ProgressMonitorDialogPerformanceTest#testLongNames() | +0.0% [±2.8] | +0.7% [±3.4] | Performance criteria not met when compared to 'R-3.4-200806172000_200906121800': Elapsed Process= 4ms is not within [0%, 110'%] of 3ms - 33.3% [±31.9] |
ShrinkingTreeTest#testTreeViewerRefresh() | +0.0% [±0.7] | +0.0% [±0.5] | +0.0% [±1.0] |
TreeAddTest#testAddThousand() | - 1.5% [±0.6] | - 4.2% [±0.3] | - 0.3% [±0.7] |
TreeAddTest#testAddThousandPreSort() | - 2.2% [±0.3] | - 5.0% [±0.2] | - 0.8% [±0.8] |