Statistics, testing, and defense acquisition : background papers / Michael L. Cohen, Duane L. Steffey, and John E. Rolph, editors ; Panel on Statistical Methods for Testing and Evaluating Defense Systems, Committee on National Statistics, Commission on Behavioral and Social Sciences and Education, National Research Council.

Format:

Book

Author/Creator:

National Research Council (U.S.), Corporate Author.

Contributor:

Cohen, Michael L.

Steffey, Duane L.

Rolph, John E.

Language:

English

Subjects (All):

Defensive (Military science).

United States--Armed Forces--Weapons systems--Testing--Statistical methods.

United States.

Physical Description:

x, 170 p. : ill.

Edition:

1st ed.

Place of Publication:

Washington, D.C. : National Academy Press, c1999.

Language Note:

English

Summary:

The Panel on Statistical Methods for Testing and Evaluating Defense Systems had a broad mandate-to examine the use of statistics in conjunction with defense testing. This involved examining methods for software testing, reliability test planning and estimation, validation of modeling and simulation, and use of modem techniques for experimental design. Given the breadth of these areas, including the great variety of applications and special issues that arise, making a contribution in each of these areas required that the Panel's work and recommendations be at a relatively general level. However, a variety of more specific research issues were either brought to the Panel's attention by members of the test and acquisition community, e.g., what was referred to as Dubin's challenge (addressed in the Panel's interim report), or were identified by members of the panel. In many of these cases the panel thought that a more in-depth analysis or a more detailed application of suggestions or recommendations made by the Panel would either be useful as input to its deliberations or could be used to help communicate more individual views of members of the Panel to the defense test community. This resulted in several research efforts. Given various criteria, especially immediate relevance to the test and acquisition community, the Panel has decided to make available three technical or background papers, each authored by a Panel member jointly with a colleague. These papers are individual contributions and are not a consensus product of the Panel; however, the Panel has drawn from these papers in preparation of its final report: Statistics, Testing, and Defense Acquisition. The Panel has found each of these papers to be extremely useful and they are strongly recommended to readers of the Panel's final report.

Contents:

Statistics, Testing, and Defense Acquisition

Copyright

Contents

Preface

1 Strategic Information Generation and Transmission: the Evolution of Institutions in DoD Operational Testing

1. INTRODUCTION

2. HISTORICAL EVOLUTION OF OT&amp

E

3. RELATED LITERATURE

4. THE MODELING FRAMEWORK

5. DECISION PROBLEMS AND GAMES

Decision Problem 1

Decision Problem 2

Game 3

Game 4

Game 5

6. WELFARE RESULTS

7. QUALITATIVE TESTING RESULTS

8. CONCLUSION

Appendix A: Proposition Proofs

Appendix B: Second Order Conditions

REFERENCES

2 On the Performance of Weibull Life Tests Based on Exponential Life Testing Designs

1. EXPONENTIAL LIFE TESTING

2. WEIBULL CONSIDERATIONS

3. WEIBULL LIFE TESTING-PART I

4. WEIBULL LIFE TESTING-PART 2

5. DISCUSSION

3 Application of Statistical Science to Testing and Evaluating Software Intensive Systems

2. FAILURES IN THE FIELD

3. UNDERSTANDING THE SOFTWARE INTENSIVE SYSTEM AND ITS USE

First Principles

Statistical Testing Process

Building Usage Models

Software Architecture

Assigning Transition Probabilities

4. MODEL VALIDATION WITH CUSTOMER AND USER

Operational Profiles

Operational Realism

Source Entropy

Specification Complexity

Simulation

Model Revision and Revalidation

5. REPRESENTING USAGE MODELS WITH CONSTRAINTS

Structural Constraints

Usage Constraints

Test Management Constraints

Objective Functions

6. THE BENEFITS OF USAGE MODELING

Testing Scripts

Recording Testing Experience

Support for Experimental Design

Guiding Special Test Situations

Generating Random Samples of Test Cases

Importance Sampling

Test Automation

Testing

7. PRODUCT AND PROCESS IMPROVEMENT

Certification

Incremental Development.

Reliability Growth Modeling

Combining Testing Information

Development

Reuse

Reengineering

Maintenance

Porting

CONCLUSION

REFERENCES.

Notes:

Bibliographic Level Mode of Issuance: Monograph

ISBN:

9786610185788

9780309184083

0309184088

9781280185786

1280185783

9780309557108

0309557100

9780585144924

0585144923

OCLC:

923266868