Improved Software Testing for Open Architecture

Report Number: NPS-AM-10-027

Series: Acquisition Management

Category: Open Architecture (OA)

Report Series: Proceedings Paper

Authors: Valdis Berzins, Paul Dailey

Title: Improved Software Testing for Open Architecture

Published: 2010-04-01

Sponsored By: Acquisition Research Program

Status: Published--Unlimited Distribution

Research Type: NPS Faculty

Full Text URL:

Keywords: Software Testing, Software Reliability, Operational Profile, Software Reuse, Open Architecture


Applying traditional manual US Navy testing practices to OA systems will limit many benefits of OA, such as system scalability, rapid configuration changes, and effective component reuse. Pairing profile-driven automated software testing with test reduction techniques should enable these benefits and keep resource requirements at feasible levels. Test cases generated by operational profiles have been shown to be more effective than those developed by other methods, such as random or selective testing, and more resource-efficient than exhaustive approaches. This research effort increases the fidelity of the operational profile, creating an environment model referred to as a High-Fidelity Profile Model (HFPM) that can statistically describe individual software inputs. Samples from the HFPM