Evaluation and synthesis of methods for measuring system engineering efficacy with a project and organization

Abstract

The need for robust systems engineering in product development has been understood by those developing product in the aerospace and defense industries since the days of the Atlas ballistic missile program. In recent times industries developing systems of similar complexity have come to respect the value of systems engineering. Systems engineering is the glue which binds a large technical team and focuses the engineering effort towards satisfying a set of realizable customer needs. EIA/IS-632 definition of systems engineering is as follows; "Systems engineering is an interdisciplinary approach encompassing the entire technical effort to evolve and verify an integrated and life-cycle balanced set of system people, product and process solutions that satisfy customer needs."To control and improve a process a viable set of measures must be in place. Existing measures of the strength of the systems engineering process in a specific project address only project execution (e.g. earned value) and technical performance. When applied properly these metrics provide valuable insight into the status (cost and schedule) of a project and a products ability to meet customer needs. However, few of these existing measures are progressive in nature and as such fail to provide early warnings of systems engineering process failure. What are needed are prognostics for the systems engineering effort; gauges to provide predictions of future events which impact product cost, schedule and/or performance. The Lean Aerospace Initiative (LAI), working with the International Council on Systems Engineering (INCOSE), released a guide (in Beta form) in December of 2005 outlining a progressive set of thirteen leading indicators to address this need. This set of metrics has yet to be been verified against an active or historical project but provides a starting ground for additional research.