Our tools come in many forms, ranging from webbased software applications to Excel spreadsheets and PowerPoint presentations, among other types of materials. You can search for the resources featured in the Planning, Designing, and Analyzing sections, or browse additional resources that evaluators commonly consult.
Name: Link(s)  Description  Application  

Bayesian Binomial Credible Intervals  This app computes the Bayesian posterior central interval for binomially distributed data (e.g., hit/miss, success/fail outcomes). We offer three approaches for computing the posterior central interval. Two approaches are based on the use of objective, or noninformative priors. A third approach allows the user to enter a subjective prior based on historical data.  Analysis


Availability Exponential Confidence Intervals Calculator (.XLSX)  This tool calculates an 80% confidence interval for operational availability assuming both uptimes and downtimes are exponentially distributed.  Analysis


Binomial Confidence Intervals  Calculates multiple confidence intervals for binomial (pass/fail) data.  Analysis


Lognormal Confidence Intervals  Calculates Wald Confidence Intervals about the mean, median, and percentiles for a single sample where the data best follow a lognormal distribution.  Analysis


Bootstrap Estimates  Performs a low sample size bootstrap analysis (1000s). It provides means, medians, and standard deviations resulting from bootstrapping of a test data sample.  Analysis  
Two Sample KolmogorovSmirnov Test  This application computes the KolmogorovSmirnov test statistic for comparing two distributions, provides reportready visualizations of the probability density and empirical cumulative density functions, and generates a paragraph explaining the meaning of the test statistic and its associated pvalue.  Analysis 

Lognormal Confidence Intervals  Calculates Wald Confidence Intervals about the mean and percentiles for a single sample analysis where the data best follow a lognormal distribution.  Analysis


Duration Based Operating Characteristic Curves  Generates OC curves for exponential data after calculating maximum allowed failures given inputs of test length, reliability requirement, and desired level of confidence.  Planning


Binomial Operating Characteristic Curves  Generates OC curves for binary reliability. Given consumer risk (beta), the maximum acceptable proportion of failures (requirement), and number of trials, this spreadsheet calculates the maximum number of failures which still results in acceptance of the system.  Planning


Parametric Reliability Models  This application fits three statistical distributions to censored or uncensored univariate reliability data and plots the failure probability, reliability, hazard, and probability density functions for each model. It provides comparison criteria for model selection and allows the user to download highresolution images of the model graphs. The application also accommodates users who merely want to plot graphs based on existing parameter estimates from previously fitted reliability models.  Analysis  
NASATLX Scoring Sheet  Calculates raw and weighted individual and samplelevel workload scores given raw responses to the NASATLX questionnaire.  Analysis


Comparing Reliability Tests  This tool generates plots comparing the likelihood of different outcomes for reliability tests. It is applicable for any continuous measure of reliability, including time (e.g., hours) and distance (e.g., miles). It can also be used with discrete measures of reliability (e.g., rounds fired between failure) provided the numbers are sufficiently large. (Hundreds or thousands between failure are probably sufficient.)  Design


System Usability Scale (SUS) Scoring Sheet Coming Soon: Calculator (.XLSX)  Calculates overall usability scores given raw responses to the SUS questionnaire.  Analysis


Distribution Visualization  Plots probability density functions of distributions with useradjustable parameters to aid comparison and understanding of "shape".  Analysis  
One Sample ttest Power  Estimates power and plots power by sample size for a one sample ttest.  Design


Two Sample ttest Power  Estimates power and plots power by sample size for a two sample ttest.  Design


One Sample Proportion Test Power  Estimates power and plots power by sample size for a one sample proportion test.  Design


Categorical Analysis Power  Estimates power and plots power by sample size for a multifactor categorical test.  Design


JEDIS JMP AddIn  JEDIS is an addin for the JMP statistical software program that helps automate the Design of Experiments (DOE) process within JMP in a userfriendly manner. JEDIS builds multiple test designs in JMP over userspecified ranges of sample sizes, SignaltoNoise Ratios (SNR), and alpha (1confidence) levels. It then automatically calculates the statistical power to detect an effect due to each factor and any specified interactions for each design. When finished, JEDIS presents the statistical power vs. design metrics in interactive plots and stores the data in an easy to use format.  Design


GLM Power for Categorical Factors  Approximates power for effects in a generalized linear model for experiments with categorical factors. Currently supports Logit, Poisson, and linear regression.  Design


Reliability Confidence Intervals  Calculates exact confidence intervals for the mean time between failures when failures follow an exponential distribution.  Analysis


Fishbone Diagram  Documents initial list and sorting of factors that could affect test outcomes.  Planning


InputProcessOutput Diagram  Groups factors according to management strategy to assist in downselection and design.  Planning


System Usability Scale (SUS) Documentation  Documents development of the SUS and provides questions, scoring and administration guidelines.  Planning


General Survey Questions  Provides generic wording for common questions in test and evaluation that can be tailored to specific systems.  Planning


NASATask Load Index (TLX) Administration and Scoring Manual  Provides instructions for administering and scoring the NASATLX. Originally hosted at NASA's TLX web archive.  Planning


NASATLX Survey Questions  Includes original NASATLX question wording, rating scale, and wordpairs for optional choice task.  Planning


Survey Design Best Practices Checklist  Lists best practices for writing and formatting custom surveys.  Planning


Power in JMP Tutorial  Provides an overview of power calculations and detailed instructions for calculating power for Designed Experiments across a variety of software packages.  Design


Top N Pareto Front Search  JMP AddIn, video demonstration of installation and use, and introduction document and video lecture on Top N Pareto Front Search.  Analysis


Survey Exploratory Data Analysis  This web application analyzes Likertscale survey data. Users upload .csvformatted data tables, and the application produces customizable tables of statistics and plots of survey responses. Tables and plots can be downloaded for reporting or further analysis.  Analysis
