Performance Validation

Phase 4


Key Considerations and Methodologies for Performance Validation of a Design Solution


  1. Introduction to Performance Validation
  2. Identify Performance Validation Requirements
    1. Requirements driven by  the design requirements (i.e. metrics and targets)
    2. Ultimately, test results need to clearly prove performance targets have been met
    3. Prototype must be testable and facilitate the collection of sufficient (credible) results to draw meaningful conclusions regarding performance.
  3. Prototype Development
    1. Proof-of-concept prototype vs. partially or fully functional working solution
    2. Scale issues
    3. Products
    4. Processes

                                                               i.      Operating or manufacturing processes

                                                             ii.      Test systems and processes

    1. Fabrication and assembly
  1. Developing a Test Plan
  2. Measurements, Instrumentation and Testing
    1. Measurement techniques
    2. Component and Sub-system evaluation
    3. Testing system-level prototypes
    4. Evaluating processes
    5. Gage repeatability and reproducibility
    6. Identifying and reporting experimental errors
  3. Design of Experiments
    1. Nomenclature
    2. Identification of key variables
    3. Linking test variables to design metrics
    4. Screening experiments
    5. Experimental designs
    6. Sponsor in-house methodologies
  4. Interpretation of Test Results and Statistical Analysis
    1. Establishing the relationship between factors and responses
    2. Statistical techniques

                                                               i.      Correlations

                                                             ii.      Regressions

                                                            iii.      ANOVA

  1. Connecting Test Results and Analysis to Design Requirements
    1. Prove targets have been met
    2. Compute and included statistical certainty
    3. Dealing with time limitations when demonstrating the accuracy, repeatability, and/or reliability of a system or process
    4. Contingencies should be formulated in the event some targets are not met (e.g. modify, redesign, new concept, terminate project, etc.)
  2. Failure Analysis Methods Lecture
    1. Common methods for analyzing product and process failures, and the consequences of those failures.
    2. Template for peforming Failure Modes Effects Analysis (FMEA):  Excel Template Link
  3. Transitioning Project to Sponsor Business
    1. Need for communicating project status
    2. Identify key next steps
    3. Appropriate documentation (Final report, Procedures, Manuals, Demonstration/Training)
    4. Safety considerations
    5. Presentation and training by the design team for the sponsor personnel