Prediction of Coverage of Expensive Concurrency Metrics Using Cheaper Metrics

Prediction of Coverage of Expensive Concurrency Metrics Using Cheaper Metrics

Paper in proceedings (conference paper)

Testing of concurrent programs is difficult since the scheduling non-determinism requires one to test a huge number of different thread interleavings. Moreover, a simple repetition of test executions will typically examine similar interleavings only. One popular way how to deal with this problem is to use the noise injection approach, which is, however, parametrized with many parameters whose suitable values are difficult to find. To find such values, one needs to run many experiments and use some metric to evaluate them. Measuring the achieved coverage can, however, slow down the experiments. To minimize this problem, we show that there are correlations between metrics of different cost and that one can find a suitable test and noise setting to maximize coverage under a costly metrics by experiments with a cheaper metrics.

Testing of concurrent programs is difficult since the scheduling non-determinism requires one to test a huge number of different thread interleavings. Moreover, a simple repetition of test executions will typically examine similar interleavings only. One popular way how to deal with this problem is to use the noise injection approach, which is, however, parametrized with many parameters whose suitable values are difficult to find. To find such values, one needs to run many experiments and use some metric to evaluate them. Measuring the achieved coverage can, however, slow down the experiments. To minimize this problem, we show that there are correlations between metrics of different cost and that one can find a suitable test and noise setting to maximize coverage under a costly metrics by experiments with a cheaper metrics.

parallel programs, noise-based testing, concurrency metrics, lasso algorithm, prediction

parallel programs, noise-based testing, concurrency metrics, lasso algorithm, prediction

KŘENA, B.; ŠIMKOVÁ, H.; UR, S.; VOJNAR, T.

2019

19.02.2018

Springer International Publishing

Las Palmas

978-3-319-74726-2

Computer Aided Systems Theory - EUROCAST 2017

16th International Conference, Las Palmas de Gran Canaria, Spain, February 19-24, 2017, Revised Selected Papers, Part II

10672

99

108

10

https://www.fit.vut.cz/research/publication/11650/

Prediction of Coverage of Expensive Concurrency Metrics Using Cheaper Metrics