Best Practices Analyze & Evaluate

Once the test is conducted we must know what to do with the data and how to handle it so we can gather as much information as possible without spending extra time or resources. Consequently, best practices are provided below for analyzing and evaluating the data. These strategies range from managing the data to interpreting the results in the reports.

Best Practices: Analyze

Collect and store data in a systematic way

Consider using advanced analysis methods when appropriate

Adjust by covariates

Provide a summary of the analysis approach taken

Best Practices: Analyze & Evaluate

Be consistent

Best Practices: Evaluate

Remind the audience about the DOE when summarizing the results

Report conditions that might have affected the results

Include figures and tables

Include raw data when appropriate

Use the correct terminology

Use other information to reinforce the results of a p-value

Consider both, practical and statistical significance

 

Above all, remember that you are working in a team. In order to maximize the team’s effort, communication among experts is important. For example, the test might not go as planned. In this case, communication between operational testers, users, and analysis experts is key in order to properly interpret the results and to understand what information is lost or affected by changes in test execution.