Select Factors Affecting Outcomes
Kelly Avery

Identifying factors that can influence the outcome of a test is a critical part of the test planning process. Testers should brainstorm potential factors thoroughly and then figure out how to handle them using a structured factor management scheme. This lesson will discuss qualities that make a good factor and outline the process for deciding whether to vary, fix, or record a factor. The video will also address a common misconception that adding factors necessarily increases the size of the test.


  1. Montgomery, D. C. (2017). Design and analysis of experiments (Ninth ed.): Hoboken, NJ: John Wiley & Sons, Inc.
  2. Director, Operational Test & Evaluation (2010). Guidance on the use of Design of Experiments (DOE) in Operational Test and Evaluation.
  3. Director, Operational Test & Evaluation (2013). Best Practices for Assessing the Statistical Adequacy of Experimental Designs Used in Operational Test and Evaluation.
  4. Office of the Director, Operational Test & Evaluation, Action Officer Training (2016). Testing Planning Foundations.
  5. Freeman, L. J., Johnson, T., Avery, M., Lillard, V. B., & Clutter, J. (2018). Testing Defense Systems. Analytic Methods in Systems and Software Testing, 441.