[논문]소프트웨어 신뢰도 평가를 위한 테스트 적용범위에 대한 연구

박중양; 박재흥; 박수진

소프트웨어 신뢰도 평가를 위한 테스트 적용범위에 대한 연구
A Study on Test Coverage for Software Reliability Evaluation 원문보기

정보처리학회논문지. The KIPS transactions. Part D. Part D, v.8D no.4, 2001년, pp.409 - 420

박중양 (경상대학교 수학·통계정보학부 통계정보학전공) , 박재흥 (경상대학교 컴퓨터과학과) , 박수진 (경상대학교 대학원 전자계산학과)

초록
AI-Helper

소프트웨어 신뢰도는 소프트웨어 시스템의 매우 중요한 특성으로 테스팅 하는 동안 소프트웨어 신뢰도를 평가하기 위해 테스트 적용범위 정보를 이용하는 방법이 최근 시도되고 있다. 본 논문은 최근 문헌에 나타난 테스트 적용범위를 이용하는 소프트웨어 신뢰도 성장모델들을 검토하여 이들을 2개 부류로 분류한 다음 각각의 문제점을 논의하고 현실적 타당성을 검토한다. 더불어, 새로운 평균치 함수와 적절한 적용범위를 선택하기 위한 절차를 제안한다.

Abstract ▼ AI-Helper

Recently a new approach to evaluation of software reliability, one of important attributes of a software system, during testing has been devised. This approach utilizes test coverage information. The coverage-based software reliability growth models recently appeared in the literature are first reviewed and classified into two classes. Inherent problems of each of the two classes are then discussed and their validity is empirically investigated. In addition, a new mean value function in coverage and a heuristic procedure for selecting the best coverage are proposed.

주제어

AI 본문요약
AI-Helper

* AI 자동 식별 결과로 적합하지 않은 문장이 있을 수 있으니, 이용에 유의하시기 바랍니다.

문제 정의

The main purpose of this paper is to study some problems related to the current coverage-based SRGMs. All the subsequent sections are subject to the following assumptions on software testing and test coverage.
The new approach takes into account the structural coverage obtained during testing. This paper is concerned with the coverage-based SRGMs, SRGMs incorporating test coverage. The followings are the summary of this paper.

가설 설정

1. New faults are detected only when new coverage units are covered.
2. If goodness of fit of the groups are considerably different, we choose the group with higher goodness of fit.
2. Remaining faults are distributed uniformly over all the uncovered coverage units.
3. If goodness of fit of the groups are not considerably different, we choose the group containing more rigorous coverages.
3. The coverage rate is proportional to the number of uncovered coverage units.
4. Repairs are effected instantly and without introduction of new faults.
4. The mean value function in coverage newly suggested in this paper works well.

제안 방법

1. Implementation of the useful testing effort-based SRGMs requires a study on the relation between the testing effort and the useful testing effort.
[8], Varadan [25] and Wood [28], there is a new approach to the reliability estimation. The new approach is indicative of a general trend to improve the accuracy of reliability estimates through the use of various test coverage measures.
The new approach takes into account the structural coverage obtained during testing. This paper is concerned with the coverage-based SRGMs, SRGMs incorporating test coverage.

대상 데이터

that will be used in this paper. The five test data sets will be respectively referred to as DS1, DS2, DS3, DS4 and DS5. The testing effort, equivalently the testing time, is measured by the number of test cases exercised.
The last test data set DS5 was obtained from Dr. Mathur in Purdue university through personal communication. The data, shown in [Table 3], was collected by testing a software system with 22 injected faults.

이론/모형

A variety of models were attempted to fit the data. The best fit was obtained using the Goel and Okumoto's exponential model. This res나It justifies the coverage growth function of equation (2.
The measurements of the number of test cases, the number of detected faults, and the four coverage measures are reproduced in [Table 1]. The coverage measures were collected using the ATAC tool. The first 1, 240 test cases revealed 28 faults.
The fitting was performed by using the nonlinear least squares procedure of the SAS system. Estimation results are summarized in [Table 4].

성능/효과

2. The coverage growth-based NHPP models are characterized by the mean value function in coverage and the coverage growth function.
It is also possible that they represent dead code of some form. For the 20, 000 test cases, these were the coverage values obtained : block coverage : 82%, branch coverage : 70%, and p-use coverage : 67%. This is to be expected since p-use coverage is the most rigorous coverage measure and block coverage is the least.

후속연구

This is mainly because relation between the testing effort and the useful testing effort is required for practical application and no such study has been published yet. Future research should be directed to development of models relating the useful testing effort to the testing effort.
It should be standard to gather coverage values during testing. More efforts should be devoted to development of new coveragebased SRGMs and improvement of the existing coveragebased SRGMs. Especially, for the coverage growth-based NHPP models, more effective mean value functions in coverage and coverage growth functions are to be developed.

참고문헌 (28)

M. H. Chen, J. R. Horgan, A. P. Mathur, and V. J. Rego, 'A Time/Structure Based Model for Estimating Software Reliability Estimation,' Technical Report SERC-TR-117-P, Purdue University, Dec. 1992
M. H. Chen, M. R. Lyu and W. E. Wong, 'An Empirical Study of the Correlation Between Code Coverage and Reliability Estimation,' Proceedings of the 3rd IEEE Inter-national Symposium on Software Metrics, Berlin, Germeny, March 1996
M. H. Chen, M. R. Lyu and W. E. Wong, 'Incorporating Code Coverage in the Reliability Estimation for Fault-Tolerant Software,' Proceedings of the 16th IEEE Sympo-sium on Reliable Distributed System, pp.45-52, Durham, NC, Oct. 1997
A. L. Goel, 'Software Reliability Model : Assumptions, Limi-tations, and Applicability,' IEEE Transactions on Software Engineering, Vol.SE-11, No.12, pp.1411-1423, 1985
S. S. Gokhale, P. N. Marinos, and K. S. Trivedi, 'Important Milestones in Sotware Reliability Modeling,' Commu-nications in Reliability, Maintainability and Serviceability, 1996
S. S. Gokhale, T. Philip, P. N. Marinos, and K. S. Trivedi, 'Non-Homogeneous Markov Software Reliability Model with Imperfect Repair,' Technical Report TR-96/12, CACC Duke University, 1996
S. S. Gokhale, T. Philip, P. N. Marinos, and K. S. Trivedi, 'Unification of Finite Failure Non-Homogeneous Poisson Process Models Through Test Coverage,' Technical Report TR-96/36, CACC Duke University, 1996
J. R. Horgan, A. P. Mathur, A. Pasquini, and V. J. Rego, 'Perils of Software Reliability Modeling,' Technical Report SERC-TR-160-p, Software Engineering Research Center, Purdue University, 1995
N. Li and Y. K. Malaiya, 'Fault Exposure Ratio Estimation and Application,' Technical Report CS-96-130, Colorado State University, 1996
M. N. Li and Y. K. Malaiya, and J. Denton, 'Estimating the Number of Defects : A simplified Intuitive Approach, 'Proceedings of International Symposium of Software Engineering, Paderborn, Germany, Nov. 1998
Y. K. Malaiya, 'Estimating The Number of Residual Defects,' Proceedings of the 3rd IEEE International High-Assurance Systems Engineering Symposium, Washington, DC, pp.98-105, Nov. 1998
Y. K. Malaiya and J. Denton, 'What Do the Software Reliability Growth Model Parameters Represent?' Proceed-ings of the 8th International Symosium on Software Reliability Engineering, Albuquerque, NM, pp.124-135, Nov. 1997
Y. K. Malaiya and J. Denton, 'Estimating Defect Density Using Test Coverage,' Technical Report CS-98-104, Colorado State University, 1998
Y. K. Malaiya, N. Li, J. Bieman, R. Karcich, and R. Skibbe, 'The Relationship Between Test Coverage and Reliability,' Proceedings of the 5th International Symposium on Soft-ware Reliability Engineering. pp.186-195, Monterey, CA, Nov. 1994
Y. K. Malaiya, N. Li, J. Bieman, R. Karcich, and R. Skibbe, 'Software Test Coverage and Reliability,' Technical Report CS-96-128, Colorado State University, 1996
Y. K. Malaiya, N. Karunanithi, and P. Verma, 'Predicta-bility of Software Reliability Models,' IEEE Transactions on Reliability, pp.539-546, 1992

상세보기
J. D. Musa, A. Iannino, and K. Okumoto, Software Reliabil-ity : Measurement, Prediction, Application, McGraq-Hill, 1987
J. D. Musa and K. Okumoto, 'A Logarithmic Poisson Execution Time Model for Software Reliability Mea-surement,' Proceedings of the 7th International Confer-ence on Software Engineering, pp.230-238, Orlando, 1984
A. Pasquini, A. N. Crespo and P. Matrella, 'Sensitivity of Reloability-Growth Models to Operational Profile Errors vs Testing Accuracy,' IEEE Transactions on Reliability, Vol. 45, No.4, pp.531-540, 1996

상세보기
T. Philip, P. N. Marinos, K. S. Trivedi, and J. Lala, 'A Multiphase Software Reliability Model : From Testing to Operational Phase,' Technical Report TR-96-01, CACC Duke University, 1996
P. Piwowarski, M. Ohba and J. Caruso, 'Coverage Mea-surement Experience During Function Test,' Proceedings of the 15th International Conference on Software Engineer-ing, pp.287-300, Baltimore, MD, May 1993
C.V. Ramamoorthy and F.B. Bastani, 'Software Reliability-Status and Perspective,' IEEE Transactions on Software Engineering, Vol.SE-8, No.8, pp.354-371, 1982
J. Ramsey and V. R .Basili, 'Analyzing the Test Process Using Structural Coverage,' Proceedings of the 8th Inter-national Conference on Software Engineering, pp.306-312, Aug. 1985
J. G. Shanthikumar, 'Software Reliability Model : A Re-view,' Microelectronics and Reliability, Vol.23, No.5, pp.903-943, 1983

상세보기
G. S. Varadan, 'Trends in Reliability and Test Strategies,' IEEE Software, Vol.12, No.3, pp.10, 1995

상세보기
W. E. Wong, 'On Mutation and Data Flow,' PhD Thesis, Department of Computer Science, Prudue University, W. Lafayette, IN, Dec. 1993
W. E. Wong, J. R. Horgan, S. London, and A. P. Mathur, 'Effect of Test Set Size and Block Coverage on the Fault Detection Effectiveness,' Proceedings of the 5th IEEE International Symposium on Software Reliability Engi-neering, pp.230-238, Monterey, CA. Nov, 1994
A. Wood, 'Software Reliability Growth Models : Assump-tions vs. Reality,' Proceedings of the 8th International Symposium on Software Reliability Engineering, pp.136-141, Albuquerque, New Mexico, Nov. 1997

저자의 다른 논문 :

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증