Interactive Tools – Test Science

Analysis

Availability Exponential Confidence Intervals

This tool calculates an 80% confidence interval for operational availability assuming both uptimes and downtimes are exponentially distributed.Spreadsheet-XLSX

Contributed by: IDA Staff
Sep-17-2019

Confidence Intervals

Analysis

Bayesian Binomial Credible Intervals

This app computes the Bayesian posterior central interval for binomially distributed data (e.g., hit/miss, success/fail outcomes). We offer three approaches for computing the posterior central interval. Two approaches are based on the use of objective, or noninformative priors. A third approach allows the user to enter a subjective prior based on historical data.Interactive Shiny App

Contributed by: IDA Staff
Aug-16-2019

Confidence Intervals

Analysis

Binomial Confidence Intervals

This app computes confidence intervals for binomially distributed data, such as success/fail, hit/no hit outcomes. Three approaches are presented.Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Confidence Intervals

Planning

Binomial Operating Characteristic Curves

Generates OC curves for binary reliability. Given consumer risk (beta), the maximum acceptable proportion of failures (requirement), and number of trials, this spreadsheet calculates the maximum number of failures which still results in acceptance of the system.Calculator-XLS

Contributed by: IDA Staff
Oct-28-2019

Reliability

Analysis

Bootstrap Estimates

This spreadsheet allows you to perform bootstrap analysis. Output: Mean, Median, Standard deviation, HistogramsSpreadsheet-XLSX

Contributed by: IDA Staff
Oct-28-2019

Bootstrap

Design

Categorical Analysis Power

Estimates power and plots power by sample size for a multi-factor categorical test.Interactive Shiny App

Contributed by: IDA Staff
Sep-17-2019

Power

Design, Analysis

Comparing Reliability Tests

This tool generates plots comparing the likelihood of different outcomes for reliability tests. It is applicable for any continuous measure of reliability, including time and distance. It can also be used with discrete measures of reliability provided the numbers are sufficiently large.Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Reliability

Analysis

Distribution Visualization

Plots probability density functions of distributions with user-adjustable parameters to aid comparison and understanding of "shape".Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Visualization

Planning

Duration Based Operating Characteristic Curves

Generates OC curves for exponential data after calculating maximum allowed failures given inputs of test length, reliability requirement, and desired level of confidence.Calculator-XLS

Contributed by: IDA Staff
Oct-28-2019

Reliability

Planning

Fishbone Diagram

Documents initial list and sorting of factors that could affect test outcomes.Document-PDF

Contributed by: IDA Staff
Oct-28-2019

Factor Management

Planning

General Survey Questions

Provides generic wording for common questions in test and evaluation that can be tailored to specific systems.Calculator-XLS

Contributed by: IDA Staff
Oct-28-2019

Survey, Custom Surveys

Design

GLM Power for Categorical Factors

Approximates power for effects in a generalized linear model for experiments with categorical factors. Currently supports Logit, Poisson, and linear regression.Interactive Shiny App

Contributed by: IDA Staff
Sep-17-2019

Power

Planning

Input-Process-Output Diagram

Groups factors according to management strategy to assist in down-selection and design.Document-PDF

Contributed by: IDA Staff
Oct-28-2019

Factor Management

Design

JEDIS JMP AddIn

JEDIS is an add-in for the JMP statistical software program that helps automate the Design of Experiments (DOE) process within JMP in a user-friendly manner.Interactive Shiny App

Contributed by: IDA Staff
Oct-29-2019

Power

Analysis

Logistic Regression

This application fits a logistic regression model to binary response data with one or two independent variables. It produces downloadable plots and statistics of the resulting model for reporting or further analysis.Interactive Shiny App

Contributed by: IDA Staff
Nov-06-2019

Binary Data, Logistic Regression

Analysis

Lognormal Confidence Intervals

Calculates Wald Confidence Intervals about the mean, median, and percentiles for a single sample where the data best follow a lognormal distribution.Interactive Shiny App

Contributed by: IDA Staff
Aug-16-2019

Confidence Intervals

Planning

OC Curve (Acceptance Sampling by Attribute)

This application generates operating characteristic curves for single or double sampling test plans, and highlights the risk for each sampling plan.Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Reliability

Design, Analysis

One Sample Proportion Test and Power

Estimates power and plots power by sample size for a one sample proportion test.Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Power

Design, Analysis

One Sample t-test and Power

Estimates power and plots power by sample size for a one sample t-test.Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2019

Power

Analysis

Parametric Reliability Models

This application fits three statistical distributions to censored or un-censored univariate reliability data and plots the failure probability, reliability, hazard, and probability density functions for each model. It provides comparison criteria for model selection and allows the user to download high-resolution images of the model graphs.Interactive Shiny App

Contributed by: IDA Staff
Jun-17-2020

Reliability

Design

Power in JMP Tutorial

Provides an overview of power calculations and detailed instructions for calculating power for Designed Experiments across a variety of software packages.Document-PDF

Contributed by: IDA Staff
Aug-22-2019

Power

Analysis

Reliability Confidence Intervals

Calculates exact confidence intervals for the mean time between failures when failures follow an exponential distribution.Calculator-XLS

Contributed by: IDA Staff
Oct-29-2019

Reliability, Confidence Intervals

Planning

Survey Design Best Practices Checklist

Lists best practices for writing and formatting custom surveys.Calculator-XLS

Contributed by: IDA Staff
Oct-29-2019

Survey, Custom Surveys

Analysis

Survey Exploratory Data Analysis

This web application analyzes Likert-scale survey data. Users upload .csv-formatted data tables, and the application produces customizable tables of statistics and plots of survey responses. Tables and plots can be downloaded for reporting or further analysis.Interactive Shiny App

Contributed by: IDA Staff
Sep-17-2019

Survey Results

Analysis

System Usability Scale (SUS)

This application analyzes system usability scale (SUS) data and produces downloadable histograms and box plots of the SUS score distributions.Interactive Shiny App

Contributed by: IDA Staff
Mar-26-2020

System Usability Scale, Surveys

Analysis

Top N Pareto Front Search

JMP Add-In, video demonstration of installation and use, and introduction document and video lecture on Top N Pareto Front Search.JMP Add-In

Contributed by: IDA Staff
Oct-31-2019

Solution Reduction

Analysis

Two Sample Kolmogorov-Smirnov Test

This application computes the Kolmogorov-Smirnov test statistic for comparing two distributions, provides report-ready visualizations of the probability density and empirical cumulative density functions, and generates a paragraph explaining the meaning of the test statistic and its associated p-value.Interactive Shiny App

Contributed by: IDA Staff
Sep-17-2019

Design

Two Sample t-test Power

Estimates power and plots power by sample size for a two sample t-test.Interactive Shiny App

Contributed by: IDA Staff
Oct-29-2019

Power

Analysis

Validated Scales Repository

Provides an overview of the validated scales approved by DOT&E for use in operational test and evaluation.Other

Contributed by: IDA Staff
Dec-02-2019

Tool: Survey Exploratory Data Analysis Status: Draft
Tool: System Usability Scale (SUS) Documentation Status: Draft
Tool: NASA-TLX Administration and Scoring Manual Status: Draft
Tool: NASA-TLX Survey Questions Status: Draft
Tool: NASA-TLX Scoring Sheet Status: Draft
Tool: System Usability Scale (SUS) Scoring Sheet Status: Draft