Interactive Tools

Analysis

This tool calculates an 80% confidence interval for operational availability assuming both uptimes and downtimes are exponentially distributed.

Availability Exponential Confidence Intervals

Spreadsheet-XLSX

Contributed by: IDA Staff
Dec-03-2020

Confidence Intervals

Analysis

This app computes the Bayesian posterior central interval for binomially distributed data (e.g., hit/miss, success/fail outcomes). We offer three approaches for computing the posterior central interval. Two approaches are based on the use of objective, or noninformative priors. A third approach allows the user to enter a subjective prior based on historical data.

Bayesian Binomial Credible Intervals

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Confidence Intervals

Planning, Design, Analysis

This planning tool sizes a binomial test, provides confidence intervals and acceptance/rejection regions, and discusses why fixed sample size tests should not be used in a sequential manner.

Binomial Confidence Interval Planning Tool

Interactive Shiny App

Contributed by: IDA Staff
Aug-01-2022

Confidence Intervals, Binomial, Sample Size

Analysis

This app computes confidence intervals for binomially distributed data, such as success/fail, hit/no hit outcomes. Three approaches are presented.

Binomial Confidence Intervals

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Confidence Intervals

Planning

Generates OC curves for binary reliability. Given consumer risk (beta), the maximum acceptable proportion of failures (requirement), and number of trials, this spreadsheet calculates the maximum number of failures which still results in acceptance of the system.

Binomial Operating Characteristic Curves

Calculator-XLS

Contributed by: IDA Staff
Dec-03-2020

Reliability

Analysis

This spreadsheet allows you to perform bootstrap analysis. Output: Mean, Median, Standard deviation, Histograms

Bootstrap Estimates

Spreadsheet-XLSX

Contributed by: IDA Staff
Dec-03-2020

Bootstrap

Design

|code|

Estimates power and plots power by sample size for a multi-factor categorical test.

Categorical Analysis Power

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Power

Design, Analysis

This tool generates plots comparing the likelihood of different outcomes for reliability tests. It is applicable for any continuous measure of reliability, including time and distance. It can also be used with discrete measures of reliability provided the numbers are sufficiently large.

Comparing Reliability Tests

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Reliability

Analysis

This application enables users to visualize statistics pertaining to the COVID-19 pandemic. Users can plot COVID-19 cases and deaths over time and tabulate related statistics by nation, U.S. state, and U.S. county. Figures and statistics are downloadable.

COVID-19 Tracker

Interactive Shiny App

Contributed by: IDA Staff
Apr-12-2021

Analysis

Plots probability density functions of distributions with user-adjustable parameters to aid comparison and understanding of “shape”.

Distribution Visualization

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Visualization

Planning

Generates OC curves for exponential data after calculating maximum allowed failures given inputs of test length, reliability requirement, and desired level of confidence.

Duration Based Operating Characteristic Curves

Calculator-XLS

Contributed by: IDA Staff
Dec-03-2020

Reliability

Planning

Documents initial list and sorting of factors that could affect test outcomes.

Fishbone Diagram

Document-PDF

Contributed by: IDA Staff
Dec-03-2020

Factor Management

Planning

Provides generic wording for common questions in test and evaluation that can be tailored to specific systems.

General Survey Questions

Calculator-XLS

Contributed by: IDA Staff
Dec-03-2020

Survey, Custom Surveys

Design

Approximates power for effects in a generalized linear model for experiments with categorical factors. Currently supports Logit, Poisson, and linear regression.

GLM Power for Categorical Factors

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Power

Planning

Groups factors according to management strategy to assist in down-selection and design.

Input-Process-Output Diagram

Document-PDF

Contributed by: IDA Staff
Dec-03-2020

Factor Management

Design

JEDIS is an add-in for the JMP statistical software program that helps automate the Design of Experiments (DOE) process within JMP in a user-friendly manner.

JEDIS JMP AddIn

JMP Add In

Contributed by: IDA Staff
Jan-12-2022

Power

Analysis

This application fits a logistic regression model to binary response data with one or two independent variables. It produces downloadable plots and statistics of the resulting model for reporting or further analysis.

Logistic Regression

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Binary Data, Logistic Regression

Analysis

Calculates Wald Confidence Intervals about the mean, median, and percentiles for a single sample where the data best follow a lognormal distribution.

Lognormal Confidence Intervals

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Confidence Intervals

Planning

This booklet contains the materials necessary to collect subjective workload assessments with the NASA Task Load Index (TLX).

NASA-TLX Administration and Scoring Manual

Document-PDF

This booklet contains the materials necessary to collect subjective workload assessments with the NASA Task Load Index (TLX).

Contributed by: IDA Staff
Dec-03-2020

Survey, Published Surveys

Analysis

Calculates raw and weighted individual and sample-level workload scores given raw responses to the NASA-TLX questionnaire.

NASA-TLX Scoring Sheet

Calculator-XLS

Calculates raw and weighted individual and sample-level workload scores given raw responses to the NASA-TLX questionnaire.

Contributed by: IDA Staff
Dec-03-2020

Survey Results, Published Surveys

Planning

Includes original NASA-TLX question wording, rating scale, and word-pairs for optional choice task.

NASA-TLX Survey Questions

Document-DOCX

Includes original NASA-TLX question wording, rating scale, and word-pairs for optional choice task.

Contributed by: IDA Staff
Dec-03-2020

Survey, Published Surveys

Planning

This application generates operating characteristic curves for single or double sampling test plans, and highlights the risk for each sampling plan.

OC Curve (Acceptance Sampling by Attribute)

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Reliability

Design, Analysis |code|

Estimates power and plots power by sample size for a one sample proportion test.

One Sample Proportion Test and Power

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Power

Design, Analysis

Estimates power and plots power by sample size for a one sample t-test.

One Sample t-test and Power

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Power

Analysis

|code|

This application fits three statistical distributions to censored or un-censored univariate reliability data and plots the failure probability, reliability, hazard, and probability density functions for each model. It provides comparison criteria for model selection and allows the user to download high-resolution images of the model graphs.

Parametric Reliability Models

Interactive Shiny App

Contributed by: IDA Staff
Apr-29-2021

Reliability

Design

Provides an overview of power calculations and detailed instructions for calculating power for Designed Experiments across a variety of software packages.

Power in JMP Tutorial

Document-PDF

Contributed by: IDA Staff
Dec-03-2020

Power

Analysis

This app reviews methods for validating probabilities that are predicted from M&S to binary outcomes that are observed in testing.

Predicted Probabilities Validation

Interactive Shiny App

Contributed by: IDA Staff
Jan-03-2023

M&S validation

Analysis

Calculates exact confidence intervals for the mean time between failures when failures follow an exponential distribution.

Reliability Confidence Intervals

Calculator-XLS

Contributed by: IDA Staff
Dec-03-2020

Reliability, Confidence Intervals

Design, Analysis

This interactive tool allows the user to conduct a Sequential Probability Ratio Test (SPRT) for a binomial proportion. The user may enter her own sequentially observed data or may investigate the SPRT by using random sequentially generated data.

SPRT – Binomial

Interactive Shiny App

Contributed by: IDA Staff
Aug-01-2022

SPRT, Sequential Test, Binomial, Stopping Rule

Planning, Design

This application illustrates the sample size distribution of the binomial SPRT over a collection of independent, simulated experiments.

SPRT Sample Size Distribution – Binomial

Interactive Shiny App

Contributed by: IDA Staff
Oct-28-2022

SPRT, Sequential Test, Binomial, Sample Size

Planning

Lists best practices for writing and formatting custom surveys.

Survey Design Best Practices Checklist

Calculator-XLS

Contributed by: IDA Staff
Dec-03-2020

Survey, Custom Surveys

Analysis

This web application analyzes Likert-scale survey data. Users upload .csv-formatted data tables, and the application produces customizable tables of statistics and plots of survey responses. Tables and plots can be downloaded for reporting or further analysis.

Survey Exploratory Data Analysis

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Survey Results

Analysis

This application analyzes system usability scale (SUS) data and produces downloadable histograms and box plots of the SUS score distributions.

System Usability Scale (SUS)

Interactive Shiny App

Contributed by: IDA Staff
Apr-09-2021

System Usability Scale, Surveys

Planning

Documents development of the SUS and provides questions, scoring and administration guidelines.

System Usability Scale (SUS) Documentation

Document-PDF

Contributed by: IDA Staff
Dec-03-2020

Survey, Published Surveys

Analysis

Coming Soon! Calculates overall usability scores given raw responses to the SUS questionnaire.

System Usability Scale (SUS) Scoring Sheet

Calculator-XLS

Coming Soon! Calculates overall usability scores given raw responses to the SUS questionnaire.

Contributed by: IDA Staff
Dec-03-2020

Survey Results, Published Surveys

Analysis

JMP Add-In, video demonstration of installation and use, and introduction document and video lecture on Top N Pareto Front Search.

Top N Pareto Front Search

JMP Add-In

Contributed by: IDA Staff
Dec-03-2020

Solution Reduction

Analysis

This application computes the Kolmogorov-Smirnov test statistic for comparing two distributions, provides report-ready visualizations of the probability density and empirical cumulative density functions, and generates a paragraph explaining the meaning of the test statistic and its associated p-value.

Two Sample Kolmogorov-Smirnov Test

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Design

|code|

Estimates power and plots power by sample size for a two sample t-test.

Two Sample t-test Power

Interactive Shiny App

Contributed by: IDA Staff
Dec-03-2020

Power

Analysis

Provides an overview of the validated scales approved by DOT&E for use in operational test and evaluation.

Validated Scales Repository

Other

Contributed by: IDA Staff
Feb-15-2022

Subscribe