Session Title Speaker Type Materials Yr

Open Architecture Tradeoffs (OAT): A simple, computational game engine for rapidly exploring hypotheses in Battle Management Command and Control (BMC2)

[162] Shelley Cazares[165] Breakout 2019

Comparison of Methods for Testing Uniformity to Support the Validation of Simulation Models used for Live-Fire Testing

[162] Shannon Shelburne[165] Breakout 2019

Valuing Human Systems Integration: A Test and Data Perspective

[162] Jeffrey Thomas[165] Breakout 2019

Air Force Human Systems Integration Program

[162] Anthony Thomas[165] Breakout 2019

Toward Real-Time Decision Making in Experimental Settings

[162] Devin Francom[165] Breakout 2019

Area Validation for Applications with Mixed Uncertainty

[162] Laura White[165] Breakout 2019

A 2nd-Order Uncertainty Quantification Framework Applied to a Turbulence Model Validation Effort

[162] Robert Baurle[165] Breakout 2019

Sources of Error and Bias in Experiments with Human Subjects

[162] Poornima Madhavan[165] Breakout 2019

Deep Reinforcement Learning

[162] Benjamin Bell[165] Breakout 2019

Decentralized Signal Processing and Distributed Control for Collaborative Autonomous Sensor Networks

[162] Ryan Goldhahn[165] Breakout 2019

An Overview of Uncertainty-Tolerant Decision Support Modeling for Cybersecurity

[162] Samrat Chatterjee[165] Breakout 2019

Software Reliability and Security Assessment: Automation and Frameworks

[162] Lance Fiondella[165] Breakout 2019

AI & ML in Complex Environment

[162] Tien Pham[165] Breakout 2019

Waste Not, Want Not: A Methodological Illustration of Quantitative Text Analysis

[162] Laura Castro-Schilo[165] Breakout 2019

Machine Learning Prediction With Streamed Sensor Data: Fitting Neural Networks using Functional Principal Components

[162] Chris Gotwalt[165] Breakout 2019

Screening Designs for Resource Constrained Deterministic M&S Experiments: A Munitions Case Study

[162] Christopher Drake[165] Breakout 2019

The Isle of Misfit Designs: A Guided Tour of Optimal Designs That Break the Mold

[162] Caleb King[165] Breakout 2019

Adapting Operational Test to Rapid-Acquisition Programs

[162] Panel Discussion[165] Breakout 2019

Sample Size Calculations for Quiet Sonic Boom Community Surveys

[162] Jasme Lee[165] Breakout 2019

Improved Surface Gunnery Analysis with Continuous Data

[162] Benjamin Ashwell & V. Bram Lillard[165] Breakout 2019

Human in the Loop Experiment Series Evaluating Synthetic Vision Displays for Enhanced Airplane State Awareness

[162] Kathryn Ballard[165] Breakout 2019

Statistical Engineering and M&S in the Design and Development of DoD Systems

[162] Doug Ray & Melissa Jablonski[165] Breakout 2019

Uncertainty Quantification: Combining Large Scale Computational Models with Physical Data for Inference

[162] Dave Higdon[165] Breakout 2019

A User-Centered Design Approach to Military Software Development

[162] Pam Savage-Knepshield[165] Breakout 2019

Engineering first, Statistics second: Deploying Statistical Test Optimization (STO) for Cyber

[162] Kedar Phadke[165] Breakout 2019

Validation and Uncertainty Quantification of Complex Models

[162] Kassie Fronczyk[165] Breakout 2019

Communicating Statistical Concepts and Results: Lessons Learned from the US Service Academies

[162] Panel Discussion[165] Breakout 2019

Multivariate Density Estimation and Data-enclosing Sets Using Sliced-Normal Distributions

[162] Luis Crespo[165] Breakout 2019

A Statistical Approach for Uncertainty Quantification with Missing Data

[162] Mark Andrews[165] Breakout 2019

Exploring Problems in Shipboard Air Defense with Modeling

[162] Ralph Donnelly & Benjamin Ashwell[165] Breakout 2019

Sequential Testing for Fast Jet Life Support Systems

[162] Darryl Ahner[165] Breakout 2019

Bayesian Component Reliability Estimation: F-35 Case Study

[162] V. Bram Lillard & Rebecca Medlin[165] Breakout 2019

Applying Functional Data Analysis throughout Aerospace Testing

[162] David Harrison[165] Breakout 2019

Adopting Optimized Software Test Design Methods at Scale

[162] Justin Hunter[165] Breakout 2019

A Quantitative Assessment of the Science Robustness of the Europa Clipper Mission

[162] Kelli McCoy[165] Breakout 2019

Identifying and Contextualizing Maximum Instrument Fault Rates and Minimum Instrument Recovery Times for Europa Clipper Science through Applied Statistics and Strategic Visualizations

[162] Thomas Youmans[165] Breakout 2019

Design and Analysis of Experiments for Europa Clipper’s Science Sensitivity Model

[162] Amy Braverman[165] Breakout 2019

SLS Structural Dynamics Sensor Optimization Study

[162] Ken Toro & Jon Stallrich[165] Breakout 2019

The 80/20 rule, can and should we break it using efficient data management tools?

[162] Ghaleb Abdulla[165] Breakout 2019

Time Machine Learning: Getting Navy Maintenance Duration Right

[162] Tim Kao[165] Breakout 2019

Behavioral Analytics: Paradigms and Performance Tools of Engagement in System Cybersecurity

[162] Robert Gough[165] Breakout 2019

3D Mapping, Plotting, and Printing in R with Rayshader

[162] Tyler Morgan-Wall[165] Breakout 2019

Functional Data Analysis for Design of Experiments

[162] Tom Donnelly[165] Breakout 2019

Test and Evaluation of Emerging Technologies

[162] Dr. Greg Zacharias, Chief Scientist Operational Test and Evaluation[165] Breakout 2019

Challenges in Test and Evaluation of AI: DoD’s Project Maven

[162] Jane Pinelis[165] Breakout 2019

Demystifying the Black Box: A Test Strategy for Autonomy

[162] Dan Porter[165] Breakout 2019

Satellite Affordability in LEO (SAL)

[162] Matthew Avery[165] Breakout 2019

Statistical Process Control and Capability Study on the Water Content Measurements in NASA Glenn’s Icing Research Tunnel

[162] Emily Timko[165] Breakout 2019

Reasoning about Uncertainty with the Stan Modeling Language

[162] John Haman[165] Breakout 2019

Target Location Error Estimation Using Parametric Models

[162] James Brownlow[165] Breakout 2019

Anatomy of a Cyberattack: Standardizing Data Collection for Adversarial and Defensive Analyses

[162] Jason Schlup[165] Breakout 2019

A Survey of Statistical Methods in Aeronautical Ground Testing

[162] Drew Landman[165] Breakout 2019

Your Mean May Not Mean What You Mean It to Mean

[162] Ken Johnson[165] Breakout 2019

A Causal Perspective on Reliability Assessment

[162] Lauren Hund[165] Breakout 2019

Hypergames for Control System Security

[162] Arnab Bhattacharya[165] Breakout 2019

Probabilistic Data Synthesis to Provide a Defensible Risk Assessment for Army Munition

[162] Kevin Singer[165] Breakout 2019

Using Bayesian Neural Networks for Uncertainty Quantification of Hyperspectral Image Target Detection

[162] Daniel Ries[165] Breakout 2019

Constructing Designs for Fault Location

[162] Erin Lanus[165] Breakout 2019

Accelerating Uncertainty Quantification for Complex Computational Models

[162] James Warner[165] Breakout 2019

When Validation Fails: Analysis of Data from an Imperfect Test Chamber

[162] Kendal Ferguson[165] Breakout 2019

Technical Leadership Panel-Tuesday Afternoon

[162] Catherine Warner[165]
Science Advsior
DOT&E
Breakout 2016

Technical Leadership Panel-Tuesday Afternoon

[162] Paul Roberts[165]
Chief Engineer
Engineering and Safety Center
Breakout 2016

Technical Leadership Panel-Tuesday Afternoon

[162] Frank Peri[165]
Deputy Director
Langley Engineering Directorate
Breakout 2016

Technical Leadership Panel-Tuesday Afternoon

[162] Peter Matisoo[165]
Technical Director
COTF
Breakout 2016

Technical Leadership Panel-Tuesday Afternoon

[162] Jeff Olinger[165]
Technical Director
AFOTEC
Breakout 2016

Combining information for Realiability Assesment-Tuesday Morning

[162] Alyson Wilson[165]
North Carolina State University
Breakout materials 2016

Reliability Growth in T&E – Summary of National Research Council’s Committee on National Statistics Report Finding-Tuesday Morning

[162] Art Fries[165]
Research Staff Member
IDA
Breakout materials 2016

Design and Analysis of Margin Testing in Support of Product Qualification for High Reliability Systems

[162] Justin Newcomer[165]
Sandia National Lab
Breakout 2016

Three Case Studies Comparing Traditional versus Modern Test Designs

[162] Ray Hill[165]
Air Force instite of Technology
Breakout materials 2016

Supersaturated Designs: Construction and Analysis

[162] David Edwards[165]
Virginia Commonwealth University
Breakout 2016

Statistically Defensible Experiment Design for Wind Tunnel Characterization of Subscale Parachutes for Mission to Mars

[162] Drew Landman[165]
Old Dominion Univerity
Breakout materials 2016

Managing Uncertainty in the Context of Risk Acceptance Decision Making at NASA: Thinking Beyond the Model

[162] Homayoon Dezfuli[165]
NASA
Breakout materials 2016

Acceptability of Radiation Detection Systems

[162] Dennis Leber[165]
NIST
Breakout materials 2016

Risk Analysis for Orbital Debris Wire Harness Failure Assessment for the Joint Polar Satellite System

[162] Joel Williamsen[165]
IDA
Breakout materials 2016

Application of Statistical Engineering to Mixture Problems With Process Variables

[162] Roger Hoerl[165]
Union College
Breakout materials 2016

The Sixth Sense: Clarity through Statistical Engineering

[162] Jennifer Van-Mullekom[165]
DuPont
Breakout 2016

Case Studies for Statistical Engineering Applied to Powered Rotorcraft Wind-Tunnel Tests

[162] Sean Commo[165]
NASA
Breakout 2016

Bayesian Adaptive Design for Conformance Testing with Bernoulli Trials

[162] Adamn Pintar[165]
NIST
Breakout materials 2016

Statistical Models for Combining Information: Styrker Reliability Case Study

[162] Rebecca Dickinson[165]
IDA
Breakout materials 2016

Bayesian Estimation of Reliability Growth

[162] Jim Brownlow[165]
U.S. Air Force 812TSS/ENT
Breakout materials 2016

Recent use of Statistical Methods in NASA Aeroscience Testing Research and Development Activities

[162] Eric Walker[165]
NASA
Breakout 2016

“High Velocity Analytics for NASA JPL Mars Rover Experimental Design”

[162] Jim Wisnowski[165]
Co-founder/Principle
Adsurgo
Breakout materials 2016

“High Velocity Analytics for NASA JPL Mars Rover Experimental Design”

[162] Heath Rushing[165]
Co-founder/Principle
Adsurgo
Breakout materials 2016

An Engineer and a Statistician Walk into a Bar: A Statistical Engineering Negotiation

[162] Ken Johnson[165]
NASA
Breakout materials 2016

Making Statistically Defensible Testing ‘The way we do things around here’

[162] Greg Hutto[165]
Air Force 96th Test Wing
Breakout 2016

Using Sequential Testing to Address Complex Full-Scale Live Fire Test and Evaluation

[162] Darryl Ahner[165]
AFIT, STAT COE
Breakout 2016

Aerospace Measurement and Experimental System Development Characterization

[162] Ray Rhew[165]
NASA
Breakout materials 2016

Leveraging Design for Variation to Improve both Testing and Design – A Case Study on Probabilistic Design of Bearings

[162] Jaime O’connell[165]
Pratt and Whitney
Breakout materials 2016

Importance of Modeling and Simulation in Testing and the Need for Rigorous Validation

[162] Kelly McGinnity[165]
IDA
Breakout materials 2016

Operational Cybersecurity Testing

[162] Alex Hoover[165]
DHS
Breakout materials 2016

[162] Tye Botting[165]
Research Staff Member
IDA
Breakout 2016

Recent Advances in Measuring Display Clutter

[162] David Kaber[165]
NCSU
Breakout materials 2017

Recent Advances in Measuring Display Clutter

[162] Carl Pankok[165] Breakout materials 2017

Trust in Automation

[162] Joseph Lyons[165]
Technical Advisor
Air Force Research Laboratory
Breakout materials 2017

Dose-Response Model of Recent Sonic Boom Community Annoyance Data

[162] Jonathan Rathsam[165]
NASA
Breakout 2017

Overview of Statistical Validation Tools

[162] Kelly McGinnity[165]
IDA
Breakout materials 2017

Improving the Rigor of Navy M&S VV&A through the application of Design of Experiments Methodologies and related Statistical Techniques

[162] Stargel Doane[165]
COTF
Breakout materials 2017

Validation of AIM-9X Modeling and Simulation

[162] Rebecca Dickinson[165]
Research Staff Member
IDA
Breakout materials 2017

Software Reliability Modeling

[162] Lance Fiondella[165]
UMASS
Breakout materials 2017

Reliability Growth Modeling

[162] Kellly Sullivan[165]
University of Arkansas
Breakout materials 2017

Updating R and Reliability Training with Bill Meeker

[162] Jason Freels[165]
AFIT
Breakout materials 2017

Introduction to Bayesian Statistics

[162] Alyson Wilson[165]
North Carolina State University
Breakout materials 2017

How do the Framework and Design of Experiments Fundamentally Help?

[162] Luis A. Cortes[165] Breakout 2017

How do the Framework and Design of Experiments Fundamentally Help?

[162] Mike Sheeha[165]
MITRE
Breakout 2017

Allocating Information Gathering Efforts for Selection Decisions

[162] Dennis Leber[165]
NIST
Breakout materials 2017

Allocating Information Gathering Efforts for Selection Decisions

[162] Jeffrey Herrmann[165]
University of Maryland
Breakout materials 2017

Statistical Methods for Programmatic Assessment and Anomaly Detection

[162] Douglas Brown[165]
BAH
Breakout materials 2017

Statistical Methods for Programmatic Assessment and Anomaly Detection

[162] Ray McCollum[165]
BAH
Breakout materials 2017

Flight Test and Evaluation of Airborne Spacing Application

[162] Sara Wilson[165]
NASA
Breakout materials 2017

Testing and Estimation in Sequential High-Dimension Data

[162] Eric Chicken[165]
Florida State University
Breakout materials 2017

Blast Noise Event Classification from a Spectrogram

[162] Edward Nykaza[165]
Army Engineering Research and Development Center, Construction Engineering Research Laboratory
Breakout materials 2017

Automated Software Testing Best Practices and Framework: A STAT COE Project

[162] Jim Simpson[165]
JK Analytics
Breakout materials 2017

Automated Software Testing Best Practices and Framework: A STAT COE Project

[162] Jim Wisnowski[165]
Adsurgo
Breakout materials 2017

Software Test Techniques

[162] Jose Calderon[165]
Galois
Breakout materials 2017

Combinational Testing

[162] Raghu Kacker[165]
NIST
Breakout materials 2017

Combinational Testing

[162] Rick Kuhn[165]
NIST
Breakout materials 2017

Introduction to Human Measurement

[162] Cynthia Null[165]
NASA
Breakout 2017

The (Empirical) Case for Analyzing Likert-Type Data with Parametric Tests

[162] Heather Wojton[165]
Research Staff Member
IDA
Breakout materials 2017

The System Usability Scale: A measurement Instrument Should Suit the Measurement Needs

[162] Keith Kidder[165]
AFOTEC
Breakout materials 2017

Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation

[162] Scott West[165]
Aerospace Corporation
Breakout materials 2017

Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation

[162] Martin Annett[165]
Aerospace Corporation
Breakout materials 2017

Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation

[162] James Womach[165]
Aerospace Corporation
Breakout materials 2017

Machine Learning: Overview and Applications to Test

[162] Takayuki Iguchi[165]
AFOTEC
Breakout materials 2017

Machine Learning: Overview and Applications to Test

[162] Megan Lewis[165]
AFOTEC
Breakout materials 2017

Range Adversarial Planning Tool for Autonomy Test and Evaluation

[162] Chad Hawthorne[165]
JHU/APL
Breakout 2017

Search for Extended Test Design Methods for Complex Systems of Systems

[162] Alex Alaniz[165]
AFOTEC
Breakout materials 2017

The Future of Engineering at NASA Langley

[162] Joe Gasbarre[165]
NASA
Breakout materials 2017

Combinatorial Testing for Link-16 Developmental Test and Evaluation

[162] Tim Mclean[165]
MCTSSA
Breakout materials 2017

Censored Data Analysis for Performance Data

[162] Bram Lillard[165]
IDA
Breakout materials 2017

Estimating the Distribution of an Extremum using a Peaks-Over-Threshold Model and Monte Carlo Simulation

[162] Adam Pintar[165]
NIST
Breakout materials 2017

Design & Analysis of a Computer Experiment for an Aerospace Conformance Simulation Study

[162] David Edwards[165]
Virginia Commonwealth University
Breakout materials 2017

Optimal Multi-Response Designs

[162] Sarah Burke[165]
STAT COE
Breakout 2017

Augmenting Definitive Screening Designs

[162] Abby Nachtsheim[165]
ASU
Breakout materials 2017

Integrated Uncertainty Quantification for Risk and Resource Management: Building Confidence in Design

[162] Eric Walker[165]
NASA
Breakout materials 2017

Background of NASA’s Juncture Flow Validation Test

[162] Joseph Morrison[165]
NASA
Breakout 2017

A Study to Investigate the Use of CFD as a Surrogate for Wind Tunnel Testing in the High Supersonic Speed Regime

[162] Eric Walker[165]
NASA
Breakout materials 2017

A Study to Investigate the Use of CFD as a Surrogate for Wind Tunnel Testing in the High Supersonic Speed Regime

[162] Joseph Morrison[165]
NASA
Breakout materials 2017

Communicating Complex Statistical Methodologies to Leadership

[162] Jane Pinelis[165]
Johns Hopkins University Applied Physics Lab or JHU
Breakout materials 2017

Communicating Complex Statistical Methodologies to Leadership

[162] Paul Johnson[165]
MCOTEA
Breakout materials 2017

DOE Case Studies in Aerospace Research and Development

[162] Drew Landman[165]
Old Dominion University
Breakout materials 2017

Sample Size and Considerations for Statistical Power

[162] Vance Oas[165]
AFOTEC
Breakout materials 2017

Sample Size and Considerations for Statistical Power

[162] Nick Garcia[165]
AFOTEC
Breakout materials 2017

Experimental Design for Composite Pressure Vessel Life Prediction

[162] Anne Drsicoll[165]
Virginia Tech
Breakout materials 2017

Improving Sensitivity Experiments

[162] Douglas Ray[165]
US Army RDECOM ARDEC
Breakout materials 2017

Improving Sensitivity Experiments

[162] Kevin Singer[165]
US Army
Breakout materials 2017

Sequential Experimentation for a Binary Response – The Break Separation Method

[162] Darsh Thakkar[165]
RIT-S
Breakout materials 2017

Sequential Experimentation for a Binary Response – The Break Separation Method

[162] Rachel Silvestrini[165]
RIT-S
Breakout materials 2017

Carrier Reliability Model Validation

[162] Dean Thomas[165]
IDA
Breakout 2017

Model Based Systems Engineering Panel Discussion

[162] John Holladay[165]
NASA
Breakout materials 2017

Resampling Methods

[162] David Ruth[165]
United States Naval Academy
Breakout materials 2017

Structured Decision Making

[162] Christine Anderson Cook[165]
LANL
Breakout materials 2017

Do Asymmetries in Nuclear Arsenals Matter?

[162] Jane Pinelis[165]
Johns Hopkins University Applied Physics Lab or JHU
Breakout materials 2017

Communication in Statistics & the Five Hardest Concepts

[162] Jennifer Van-Mellekom[165]
Virginia Tech
Breakout 2017

Uncertainty Quantification: What is it and Why it is Important to Test, Evaluation, and Modeling and Simulation in Defense and Aerospace

[162] Peter Qian[165]
University of Wisconsin and SmartUQ
Breakout materials 2017

Model Uncertainty and its Inclusion in Testing Results

[162] Stever Lund[165]
NIST
Breakout materials 2017

VV&UQ – Uncertainty Quantification for Model-Based Engineering of DoD Systems

[162] Douglas Ray[165]
US Army RDECOM ARDEC
Breakout materials 2017

VV&UQ – Uncertainty Quantification for Model-Based Engineering of DoD Systems

[162] Melissa Jablonski[165]
US Army
Breakout materials 2017

Data Visualization

[162] Lori Perklins[165]
NASA
Breakout 2017

Big Data, Big Think

[162] Robert Beil[165]
NASA
Breakout materials 2017

Project Data Flow Is an Engineered System

[162] Ken Johnson[165]
NASA
Breakout materials 2017

Comparing Experimental Designs

[162] Tom Donnelly[165]
JMP
Breakout materials 2017

Testing Autonomous Systems

[162] Darryl Ahner[165]
Director
AFIT
Breakout materials 2018

Screening Experiments with Partial Replication

[162] David Edwards[165]
Virginia Commonwealth University
Breakout materials 2018

What is Bayesian Experimental Design?

[162] Blaza Toman[165]
Statistical Engineering Division, NIST
Breakout materials 2018

DOE and Test Automation for System of Systems TE

[162] Jim Simpson[165]
JK Analytics
Breakout materials 2018

Building A Universal Helicopter Noise Model Using Machine Learning

[162] Eric Greenwood[165]
Aeroacoustics Branch
Breakout materials 2018

Machine Learning to Assess Piolts’ Cognitive State

[162] Tina Heinich[165]
Computer Engineer, OCIO Data Science Team
AST, Data Systems
Breakout materials 2018

CYBER Penetration Testing and Statistical Analysis in DT&E

[162] Timothy McLean[165] Breakout materials 2018

Method for Evaluating the Quality of Cybersecurity Defenses

[162] Shawn Whetstone[165]
Research Staff Member
IDA
Breakout materials 2018

Metrics to Characterize Temporal patterns in Lifespans of Artifacts

[162] Soumyo Moitra[165]
Software Engineering Institute Carnegie Mellon Univeristy
Breakout materials 2018

Uncertainty Quantification with Mixed Uncertainty Sources

[162] Tom West[165] Breakout 2018

System Level Uncertainty Quanification for Low-Boom Supersonic Flight Vehicles

[162] Ben Phillips[165] Breakout 2018

Uncertainty Quantification and Analysis at The Boeing Company

[162] John Schaefer[165]
Sandia National Labortories
Breakout materials 2018

Interface design for analysts in a data and analysis-rich environment

[162] Karin Butler[165]
Sandia National Labortories
Breakout materials 2018

Asparagus is the most articulate vegetable ever

[162] Kerstan Cole[165] Breakout 2018

Mitigating Pilot Disorientation with Synthetic Vision Displays

[162] Kathryn Ballard[165]
NASA
Breakout materials 2018

Sage III Seu Statistical Analysis Model

[162] Ray McCollum[165]
Booz Allen Hamilton
Breakout materials 2018

Initial Validation of the Trust of Automated System Test

[162] Heather Wojton[165]
Research Staff Member
IDA
Breakout materials 2018

Operational Evaluation of a Flight-deck Software Application

[162] Sara Wilson[165]
NASA
Breakout materials 2018

Comparing M&S Output to Live Test Data: A Missile System Case Study

[162] Kelly Avery[165]
Reasearch Staff member
IDA
Breakout materials 2018

NASA’s Human Exploration Research Analog (HERA): An analog mission for isolation, confinement, and remote conditions in space exploration scenarios

[162] Shelley Cazares[165]
NASA
Breakout 2018

Reliability Fundamentals and Analysus Lessons Learned

[162] Dan Telford[165]
AFOTEC
Breakout materials 2018

Design and Analysis of Nonlinear Models for the Mars 2020 Rover

[162] Jim Wisnowski[165] Breakout materials 2018

Cases of Second-Order Split-Plot Designs

[162] Luis Cortes[165]
MITRE
Breakout materials 2018

The Development and Execution of Split-Plot Designs In Navy Operational Test and Evaluation: A Practitioner’s Perspective

[162] Stargel Doane[165] Breakout 2018

B-52 Radar Modernization Test Design Considerations

[162] Stuart Corbett[165]
AFOTEC
Breakout materials 2018

B-52 Radar Modernization Test Design Considerations

[162] Joseph Maloney[165]
AFOTEC
Breakout materials 2018

Experimental Design of a Unique Force Measurement System Calibration

[162] Ken Toro[165] Breakout 2018

Application of Design of Experiments to a Calibration of the National Transonic Facility

[162] Matt Rhode[165]
NASA
Breakout materials 2018

Application of Design of Experiments to a Calibration of the National Transonic Facility

[162] Matt Bailey[165]
Jacobs Technology Inc
Breakout materials 2018

The Use of DOE vs OFAT in the Calibration of AEDC Wind Tunnels

[162] Rebecca Rought[165]
AEDC/TSTA
Breakout materials 2018

Initial Investigation into the Psychoacoustic Properties of Small Unmanned Aerial System Noise

[162] Andrew Chrisrian[165]
Structural Acoustics Branch
Breakout materials 2018

Combining Human Factors Data and Models of Human Performance

[162] Cynthia Null[165]
Technicial Fellow for Human Factors
Breakout materials 2018

A Multi-method, Triangulation Approach to Operational Testing

[162] Daniel Porter[165]
Research Staff Member
IDA
Breakout materials 2018

Illustrating the Importance of Uncertainty Quantification (UQ) in Munitions Modeling

[162] Donald Calucci[165] Breakout 2018

Space-Filling Designs for Robustness Experiments

[162] Roshan Vengazhiyil[165] Breakout 2018

Introduction of Uncertainty Quantification and Industry Challenges

[162] Peter Chien[165] Breakout 2018

The Effect of Extremes in Small Sample Size on Simple Mixed Models: A Comparison of Level-1 and Level-2 Size

[162] Kristina Carter[165]
Research Staff Member
IDA
Breakout materials 2018

Evaluating Deterministic Models of Time Series by Comparison to Observations

[162] Amy Braverman[165]
Jet Propulsion Laboratory, California Institute of Technology
Breakout materials 2018

Challenger Challenge: Pass-Fail Thinking Increases Risk Measurably

[162] Ken Johnson[165]
Applied Statistician
NASA Engineering and Safety Center
Breakout materials 2018

Doppler Assisted Sensor Fusion for Tracking and Exploitation

[162] J. Derek Tucker[165]
Sandia National Laboratories
Breakout materials 2018

XPCA: A Copula-based Generalization of PCA for Ordinal Data

[162] Cliff Anderson-Bergman[165]
Sandia National Laboratories
Breakout materials 2018

Insights, Predictions, and Actions: Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

[162] Andrew Flack[165]
Research Staff Member
IDA
Breakout materials 2018

A Notional Case Study of Uncertainty Analysis in Live Fire Modeling and Simulation

[162] Thomas Johnson[165]
Research Staff Member
IDA
Breakout 2020

An Approach to Assessing Sterilization Probabilistically

[162] Mike Dinicola[165]
System Engineer
Jet Propulsion Laboratory
Breakout 2020

Reevaluating Planetary Protection Bioburden Accounting and Verification Reporting

[162] James Benardini[165]
Sr. Planetary Protection Engineer
Jet Propulsion Laboratory
Breakout 2020

Quantifying Computational Uncertainty in Supersonic Flow Predictions without Experimental Measurements

[162] Thomas West[165]
NASA Langley
Breakout 2020

Title Coming Soon

[162] Kedar Phadke[165]
Phadke Associates, Inc
Breakout 2020

Building an End-to-End Model of Super Hornet Readiness

[162] Benjamin Ashwell[165]
Research Staff Member
IDA
Breakout 2020

The OTA Perspective on the Challenges of Testing in the Evolving Acquisition Environment and Proposed Mitigations

[162] Leisha Scheiss[165]
AFOTEC
Breakout 2020

Quantifying Uncertainty in Reporting System Usability Scale Results

[162] Nick Clark[165]
Assistant Professor
West Point – Math Department
Breakout 2020

Uncertainty Quantification and Check Standard Testing at NASA Glenn Research Facilities

[162] Erin Hubbard[165]
Data Engineer
Jacobs / NASA Glenn Research Center
Breakout 2020

STAT COE Autonomy Test and Evaluation Workshop Highlights

[162] Troy Welker[165]
Analyst
STAT COE
Breakout 2020

Automated Feature Extraction

[162] Samuel Humphries[165]
Student
United States Military Academy
Breakout 2020

Predicting System Failures – A Statistical Approach to Reliability Growth Modeling

[162] Kate Sanborn[165]
Invited Speaker
North Carolina State University
Breakout 2020

Graph link prediction in computer networks using Poisson Matrix Factorisation

[162] Melissa Turcotte[165]
Research Scientist
Los Alamos National Laboratory
Breakout 2020

Trusted Collaborative Autonomous Systems for Multi Domain Operations

[162] Robert Murphey[165]
Principal Research Engineer
Georgia Tech Research Institute
Breakout 2020

Practical Applications for Functional Data Analysis in T&E

[162] James Wisnowski[165]
Principal Consultant and Co-owner
Adsurgo LLC
Breakout 2020

Improving Cyber Resiliency through the Application of Behavioral Science to Cybersecurity

[162] Poornima Madhavan[165]
Principal Behavioral Scientist
MITRE
Breakout 2020

AI for Cyber

[162] Adam Cardinal-Stakenas[165]
Data Science Lead
NSA
Breakout 2020

Spectral Embedding and Cyber Networks

[162] David Marchette[165]
Principal Scientist
Naval Surface Warfare Center, Dahlgren Division
Breakout 2020

Generalized Linear Multilevel Model Applied to a Forced-Choice Psychoacoustic Test

[162] Matthew Boucher[165]
Research Engineer
NASA Langley Research Center
Breakout 2020

A Path to Fielding Autonomous Systems

[162] Craig Lennon[165]
Autonomy CoI TEVV co-lead
CCDC Army Research Lab
Breakout 2020

Finding a Cheater: Machine Learning and the Dice Game “Craps”

[162] Paul Johnson[165]
Scientific Advisor
MCOTEA
Breakout 2020

Dynamic Model Updating for Streaming Classification and Clustering

[162] Alexander Foss[165]
Senior Statistician
Sandia National Laboratories
Breakout 2020

Data Analysis for Special Operations Selection Programs

[162] Nicholas Cunningham[165]
Cadet
United States Military Academy
Breakout 2020

Statistical Analysis of a Transonic Aerodynamic Calibration

[162] Lindsey Drone[165]
Data Engineer
NASA Ames Research Center
Breakout 2020

Automated Road Extraction from Satellite Images

[162] Trevor Parker[165]
Cadet
United States Military Academy
Breakout 2020

The Role of Sensitivity Analysis in Evaluating the Credibility of Machine Learning

[162] Kyle Hickmann[165]
Scientist
Los Alamos National Laboratory
Breakout 2020

Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning

[162] Jize Zhang[165]
Postdoctoral Research Staff Member
Lawrence Livermore National Laboratory
Breakout 2020

Process/Workflow-Oriented View for Decision-Support Systems

[162] Nicole Murchison[165]
Systems Research and Analysis
Sandia National Laboratories
Breakout 2020

Uncertainty Quantification and Decomposition Methods for Risk-Sensitive Machine Learning

[162] Ahmad Rushdi[165]
Member of Technical Staff
Sandia National Laboratories
Breakout 2020

Balancing Human & Virtual Decision Making for Identifying Fraudulent Credit Card Activity

[162] Rao Abdul Hannan[165]
Cadet
United States Air Force Academy
Breakout 2020

Integrating Systems Engineering into Test Strategy Development and Systems Evaluation

[162] Charlie Middleton[165]
Test and Evaluation Expert
OSD Scientific Test and Analysis Techniques Center of Excellence
Breakout 2020

The Challenge of Data for Predicting Human Errors

[162] Thomas Ulrich[165]
Human Factors & Reliability Associate Scientist
Idaho National Laboratory
Breakout 2020

Creating Insight into Joint Cognitive System Performance

[162] Taylor Murphy[165]
Cognitive Systems Engineer
Air Force Research Laboratory
Breakout 2020

Introduction to Structural Equation Modeling: Implications for Human-System Interactions

[162] Laura Castro-Schilo[165]
Research Statistician Developer
JMP Division, SAS Institute, Inc.
Breakout 2020

Optimal Designs for Multiple Response Distributions

[162] Brittany Fischer[165]
Arizona State University
Breakout 2020

Orbital position in space: What is Truth? A study comparing two astrodynamics systems

[162] Jason Sheldon[165]
Research Staff Member
IDA
Breakout 2020

Machine Learning Reveals that Russian IRA’s Twitter Topic Patterns Evolved over Time

[162] Emily Parrish[165]
Research Associate
IDA
Breakout 2020

Combining Physics-Based Simulation & Machine Learning for Fast Uncertainty Quantification

[162] James Warner[165]
Computational Scientist
NASA Langley Research Center
Breakout 2020

Expanding the Systems Test Engineer’s Toolbox A Multi-Criteria Decision Analysis Technique using the One-Sided Tolerance Interval for Analysis of DOE Planned Tests

[162] Michael Sheehan[165]
Principal Engineer
MITRE
Breakout 2020

Design Fractals: Visualizing the Coverage Properties of Covering Arrays

[162] Joseph Morgan[165]
Research Statistician
SAS Institute Inc
Breakout 2020

Resilience and Productive Safety Considerations for In-Time System-Wide Safety Assurance

[162] Lawrence J. Prinzel III[165]
Senior Aerospace Research Engineer
NASA Langley Research Center
Breakout 2020

Physics-Informed Deep Learning for Modeling and Simulation under Uncertainty

[162] Patrick Leser[165]
NASA Langley Research Center
Breakout 2020

Development of Predictive Models for Brain-Computer Interface Systems: A Case Study

[162] Kevin Eng[165]
Statistician
US Army CCDC Armaments Center
Breakout 2020

Employing Design of Experiments (DOE) in an Electronic Warfare Test Strategy/Design

[162] Michael Harman[165]
Statistical Test Designer
STAT COE
Breakout 2020

Bayesian Logistic Regression with Separated Data

[162] Jason Martin[165]
Test Design and Analysis Lead
U.S. Army CCDC Aviation and Missile Center
Breakout 2020

Natural Language Processing for Safety-Critical Requirements

[162] Ying Shi[165]
Safety and Mission Assurance
NASA GSFC
Breakout 2020

An end-to-end uncertainty quantification framework in predictive ocean data science

[162] Patrick Heimbach[165]
Associate Professor
University of Texas at Austin
Breakout 2020

Aliased Informed Model Selection for Nonregular Designs

[162] Carly Metcalfe[165]
PhD Candidate
Arizona State University
Breakout 2020

International journal of astrobiology

[162] Kelli Mccoy[165]
Mars Sample Return Campaign Risk Manager
JPL
Breakout 2020

Dashboard for Equipment Failure Reports

[162] Cole Molloy[165]
Johns Hopkins Applied Physics Lab
Breakout 2020

Designing Competitions that Reward Robust Algorithm Performance

[162] Kary Myers[165]
Deputy Group Leader, Statistical Sciences Group
Los Alamos National Laboratory
Breakout 2020

Post-hoc Uncertainty Quantification for Remote Sensing Observing Systems

[162] Amy Braverman[165]
Principal Statistician
Jet Propulsion Laboratory, California Institute of Technology
Breakout 2020

Bayesian Experimental Design to augment a sensor network

[162] Emily Casleton[165]
Staff Scientist
Los Alamos National Laboratory
Breakout 2020

Calibrate, Emulate, Sample

[162] Alfredo Garbuno-Inigo[165]
Postdoctoral Scholar
Caltech
Breakout 2020

Unlock Trends in Instrument Performance with Recurrence Studies and Text Analyses

[162] Rob Lievense[165]
Systems Engineer
SAS/JMP
Breakout 2020

Automated Test Case Generation for Human-Machine Interaction

[162] Matthew Bolton[165]
Associate Professor
University at Buffalo, the State University of New York
Breakout
2021

Entropy-Based Adaptive Design for Contour Finding and Estimating Reliability

[162] Austin Cole[165]
PhD Candidate
Virginia Tech
Breakout
2021

Cognitive Work Analysis – From System Requirements to Validation and Verification

[162] Matthew Miller[165]
Exploration Research Engineer
Jacobs/NASA Johnson Space Center
Breakout
2021

Spatio-Temporal Modeling of Pandemics

[162] Nicholas Clark[165]
Assistant Professor
West Point
Breakout
2021

Empirical Analysis of COVID-19 in U.S. States and Counties

[162] Emily Heuring[165]
Research Staff Member
Institute for Defense Analyses
Breakout
2021

Physics-Informed Deep Learning for Modeling and Simulation under Uncertainty

[162] Patrick Leser[165]
Aerospace Technologist
NASA Langley Research Center
Breakout
2021

Modeling and Simulation in Support of the Decision Analysis Process

[162] Michael Greco[165]
Computer Scientist
U.S. Army CCDC Armaments Center
Breakout
2021

Intelligent Integration of Limited-Knowledge IoT Services in a Cross-Reality Environment

[162] Mark Dennison[165]
Research Psychologist
U.S. Army DEVCOM Army Research Laboratory
Breakout
2021

Operational Cybersecurity Test and Evaluation of Non-IP and Wireless Networks

[162] Peter Mancini[165]
Research Staff Member
Institute for Defense Analyses
Breakout
2021

A DOE Case Study: Multidisciplinary Approach to Design an Army Gun Propulsion Charge

[162] Sarah Longo[165]
Data Scientist
US Army CCDC Armaments Center
Breakout
2021

A DOE Case Study: Multidisciplinary Approach to Design an Army Gun Propulsion Charge

[162] Melissa Jablonski[165]
Statistician
US Army CCDC Armaments Center
Breakout
2021

Challenges in Verification and Validation of CFD for Industrial Aerospace Applications

[162] Andrew Cary[165]
Technical Fellow
Boeing Research and Technology
Breakout
2021

Characterizing Human-Machine Teaming Metrics for Test and Evaluation

[162] Brian Vickers[165]
Research Staff Member
Institute for Defense Analyses
Breakout
2021

Verification and Validation of Elastodynamic Simulation Software for Aerospace Research

[162] Erik Frankforter[165]
Research Engineer
NASA Langley Research Center
Breakout
2021

Fast, Unbiased Uncertainty Propagation with Multi-model Monte Carlo

[162] Geoffrey Bomarito[165]
Materials Research Engineer
NASA Langley Research Center
Breakout
2021

Assessing Next-Gen Spacesuit Reliability: A Probabilistic Analysis Case Study at NASA

[162] James Warner[165]
Computational Scientist
NASA Langley Research Center
Breakout
2021

Debunking Stress Rupture Theories Using Weibull Regression Plots

[162] Anne Driscoll[165]
Associate Collegiate Professor
Virginia Tech
Breakout
2021

Advancements in Characterizing Warhead Fragmentation Events

[162] John Haman[165]
Research Staff Member
Institute for Defense Analyses
Breakout
2021

Prior Formulation in a Bayesian Analysis of Biomechanical Data

[162] Amanda French[165]
Data Scientist
Johns Hopkins University Applied Physics Laboratory
Breakout
2021

A Great Test Requires a Great Plan

[162] Aaron Ramert[165]
STAT Analyst
Scientific Test and Analytics Techniques Center of Excellence (STAT COE)
Breakout
2021

Metrics for Assessing Underwater Demonstrations for Detection and Classification of UXO

[162] Jacob Bartel[165]
Research Associate
Institute for Defense Analyses
Breakout
2021

Collaborative Human AI Red Teaming

[162] Galen Mullins[165]
Senior AI Researcher
Johns Hopkins University Applied Physics Laboratory
Breakout
2021

Machine Learning Reveals that the Russian IRA’s Twitter Topic Patterns Evolved over Time

[162] Emily Parrish[165]
Research Associate
Institute for Defense Analyses
Breakout
2021

Statistical Engineering in Practice

[162] Peter Parker[165]
Team Lead for Advancement Measurement Systems
NASA Langley
Breakout
2021

Statistical Engineering in Practice

[162] Alex Varbanov[165]
Principal Scientist
Procter and Gamble
Breakout
2021

Statistical Engineering in Practice

[162] Roger Hoerl[165]
Associate Professor of Statistics
Union College
Breakout
2021

Statistical Engineering in Practice

[162] Angie Patterson[165]
Chief Consulting Engineer
GE Aviation
Breakout 2021

Certification by Analysis: A 20-year Vision for Virtual Flight and Engine Testing

[162] Timothy Mauery[165]
Boeing
Breakout
2021

Dashboard for Equipment Failure Reports

[162] Robert Cole Molloy[165]
Johns Hopkins University Applied Physics Laboratory
Breakout
2021

A Framework for Efficient Operational Testing through Bayesian Adaptive Design

[162] Victoria Sieck[165]
Student / Operations Research Analyst
University of New Mexico / Air Force Institute of Technology
Breakout
2021

Cybersecurity Metrics and Quantification: Problems, Some Results, and Research Directions

[162] Shouhuai Xu[165]
Professor
University of Colorado Colorado Springs
Breakout
materials 2021

An Adaptive Approach to Shock Train Detection

[162] Greg Hunt[165]
Assistant Professor
William & Mary
Breakout
2021

Estimating Pure-Error from Near Replicates in Design of Experiments

[162] Caleb King[165]
Research Statistician Developer
SAS Institute
Breakout
2021

Uncertainty Quantification and Sensitivity Analysis Methodology for AJEM

[162] Craig Andres[165]
Mathematical Statistician
U.S. Army CCDC Data & Analysis Center
Breakout
2021

Surrogate Models and Sampling Plans for Multi-fidelity Aerodynamic Performance Databases

[162] Kevin Quinlan[165]
Applied Statistician
Lawrence Livermore National Laboratory
Breakout
2021

Bayesian Calibration and Uncertainty Analysis: A Case Study Using a 2-D CFD Turbulence Model

[162] Peter Chien[165] Contributed 2018

Assessing Human Visual Inspection for Acceptance Testing: An Attribute Agreement Analysis Case Study

[162] Christopher Drake[165]
Lead Statistician
QE&SA Statistical Methods & Analysis Group
Contributed materials 2018

Leveraging Anomaly Detection for Aircraft System Health Data Stability Reporting

[162] Kyle Gartrell[165] Contributed materials 2018

Application of Adaptive Sampling to Advance the Metamodeling and Uncertainty Quantification Process

[162] Erik Axdahl[165]
Hypersonic Airbreathing Propulsion Branch NASA Langley Research Center
Contributed materials 2018

Application of Adaptive Sampling to Advance the Metamodeling and Uncertainty Quantification Process

[162] Robert Baurle[165]
Hypersonic Airbreathing Propulsion Branch NASA Langley Research Center
Contributed materials 2018

Application of Statistical Methods and Designed Experiments to Development of Technical Requirements

[162] Eli Golden[165]
U.S. ARMY ARMAMENT RESEARCH, DEVELOPMENT & ENGINEERING CENTER
Contributed materials 2018

Infrastructure Lifetimes

[162] Erika Taketa[165]
Lawrence Livermore National Laboratory
Contributed materials 2018

Infrastructure Lifetimes

[162] William Romine[165]
Lawrence Livermore National Laboratory
Contributed materials 2018

Workforce Analytics

[162] William Romine[165]
Lawrence Livermore National Laboratory
Contributed 2018

Optimizing for Mission Success in Highly Uncertain Scenarios

[162] Brian Chell[165] Contributed 2018

Test Planning for Observational Studies using Poisson Process Modeling

[162] Brian Stone[165]
AFOTEC
Contributed materials 2018

Model credibility in statistical reliability analysis with limited data

[162] Caleb King[165]
Sandia National Laboratories
Contributed materials 2018

Sound level recommendations for quiet sonic boom dose-response community surveys

[162] Jasme Lee[165]
North Carlina State Univeristy
Contributed materials 2018

Development of a Locking Setback Mass for Cluster Munition Applications: A UQ Case Study

[162] Melissa Jablonski[165]
U.S. ARMY ARMAMENT RESEARCH, DEVELOPMENT & ENGINEERING CENTER
Contributed materials 2018

A Metrics-based Software Tool to Guide Test Activity Allocation

[162] Jacob Aubertine[165]
Graduate Research Assistant
University of Massachusetts Dartmouth
Contributed
2021

Wednesday Keynote Speaker I

[162] Peter Parker[165]
Team Lead, Advanced Measurement Systems
NASA
Keynote
2019

Tuesday Keynote

[162] David Chu[165]
President
Institute for Defense Analyses
Keynote
2019

Thursday Keynote Speaker II

[162] Michael Little[165]
Program Manager, Advanced Information Systems Technology
Earth Science Technology Office, NASA Headquarters
Keynote
2019

Thursday Keynote Speaker I

[162] Wendy Martinez[165]
Director, Mathematical Statistics Research Center, Bureau of Labor Statistics
ASA President-Elect (2020)
Keynote
materials 2019

Wednesday Keynote Speaker II

[162] Laura Freeman[165]
Associate Director, ISL
Hume Center for National Security and Technology, Virginia Tech
Keynote
2019

Thursday Lunchtime Keynote Speaker

[162] T. Charles Clancy[165]
Bradley Professor of Electrical and Computer Engineering
Virginia Tech
Keynote
2019

Wednesday Keynote Speaker III

[162] Timothy Dare[165]
Deputy Director, Developmental Test, Evaluation, and Prototyping
SES OUSD(R&E)
Keynote
2019

Wednesday Lunchtime Keynote Speaker

[162] Jared Freeman[165]
Chief Scientist of Aptima and Chair of the Human Systems Division
National Defense Industry Association
Keynote
2019

Welcoming & Opening Keynote-Tuesday AM

[162] Mike Gilmore[165]
Director
DOT&E
Keynote
materials 2016

Lunch with Keynote Leadership Perspective

[162] Jon Hollday[165]
NASA
Keynote
2016

STAT Engineering Keynote-Wednesday AM

[162] Christine Anderson Cook[165]
Statistics
Los Alamos National Lab
Keynote
2016

Lunch With Leadership Perspective-Wednesday PM

[162] David Brown[165]
Deputy Assistant
Secretary of Defense, Developmental Test & Evaluation
Keynote
2016

Test and Evaluation Matter for Warfighter and We Need your Help to Make it Better

[162] Katherine Warner[165]
Science Advisor within Secretary of Defense
DOT&E
Keynote
materials 2017

Retooling Design and Development

[162] Chris Singer[165]
NASA Deputy Chief Engineer
NASA
Keynote
materials 2017

Reflections on Statistical Engineering and it’s Application

[162] Geoff Vining[165]
Professor
Virginia Tech
Keynote
materials 2017

Developmental Test and Evaluation

[162] Brian Hall[165]
Principal Deputy Director
DoD
Keynote
materials 2017

[162] Dave Duma[165]
Acting Director, Operationak Test and Evaluation, Office of the Secretary of Defense
DOT&E
Keynote
2017

Opening Keynote

[162] David Chu[165]
President
IDA
Keynote
2018

Closing Remarks

[162] Robert Behler[165]
Director
DOT&E
Keynote
2018

Testing and Analytical Challenges on the Path to Hypersonic Flight

[162] Mark Lewis[165]
Director
IDA-STPI
Keynote
materials 2018

Journey to a Data Centric Approcach for National Security

[162] Marcey Hoover[165]
Quality Assurance Director
Sandia National Labortories
Keynote
materials 2018

NASA AERONAUTICS

[162] Bob Pearce[165]
Deputy Associate Administrator
Strategy, Aeronautics Research Mission DirectorateNASA
Keynote
materials 2018

High-Effective Statistical Collaboration. The Art and the Science

[162] Peter Parker[165]
Team Lead
Advance Measurement Systems NASA
Keynote
materials 2018

Consensus Building

[162] Antonio Possolo[165]
NIST Fellow, Chief Statistician
National Institute of Standards and Technology.
Keynote
materials 2018

Opening Keynote

[162] Dave Duma[165]
Assistant Director
Operational Test and Evaluation
Keynote
2018

Morning Keynote – Greg Zacharias

[162] Greg Zacharias[165]
Chief Scientist
DOT&E
Keynote
2020

Lunch Keynote

[162] Yisroel Brumer[165]
Principal Deputy Director
CAPE
Keynote
2020

Morning Keynote

[162] Michael Seablom[165]
Chief Technologist
Science Mission Directorate
Keynote
2020

Opening Keynote – Norty Schwartz

[162] Norton “Norty” Schwartz[165]
President and CEO
IDA
Keynote
2020

Assessing Human-Autonomy Interaction in Driving-Assist Settings

[162] Mary “Missy” Cummings[165]
Professor
Duke University
Keynote
materials 2021

Opening Remarks

[162] Norton Schwartz[165]
President
Institute for Defense Analyses
Keynote
2021

Closing Remarks

[162] William “Allen” Kilgore[165]
Director, Research Directorate
NASA Langley Research Center
Keynote
2021

Opening Remarks

[162] Raymond O’Toole[165]
Acting Director, Operational Test and Evaluation
DOT&E
Keynote
2021

Army’s Open Experimentation Test Range for Internet of Battlefield Things: MSA-DPG

[162] Jade Freeman[165]
Research Scientist
U.S. Army DEVCOM Army Research Laboratory
Panel
2021

Multi-Agent Adaptive Coordinated Autonomy in Contested Battlefields

[162] John Rogers[165]
Senior Research Scientist
U.S. Army DEVCOM Army Research Laboratory
Panel
2021

The Keys to Successful Collaborations during Test and Evaluation: Panelist

[162] Sarah Burke[165]
STAT Expert
STAT Center of Excellence
Panel
2021

The Keys to Successful Collaborations during Test and Evaluation: Panelist

[162] John Haman[165]
RSM
Institute for Defense Analyses
Panel
2021

The Keys to Successful Collaborations during Test and Evaluation: Panelist

[162] Peter Parker[165]
Team Lead for Advanced Measurement Systems
NASA Langley
Panel
2021

The Keys to Successful Collaborations during Test and Evaluation: Panelist

[162] Willis Jensen[165]
HR Analyst
W.L. Gore & Associates
Panel
2021

The Keys to Successful Collaborations during Test and Evaluation: Moderator

[162] Christine Anderson-Cook[165]
Los Alamos National Lab
Panel
2021

Finding the Human in the Loop: HSI | Trustworthy AI

[162] Stoney Trent[165]
Research Professor and Principal Advisor for Research and Innovation; Founder
Virginia Tech; The Bulls Run Group, LLC
Panel
2021

Finding the Human in the Loop: Evaluating Warfighters’ Ability to Employ AI Capabilities

[162] Dan Porter[165]
Research Staff Member
Institute for Defense Analyses
Panel
2021

Finding the Human in the Loop: Evaluating HSI with AI-Enabled Systems: What should you consider in a TEMP?

[162] Jane Pinelis[165]
Chief of the Test, Evaluation, and Assessment branch
Department of Defense Joint Artificial Intelligence Center (JAIC)
Panel
2021

Finding the Human in the Loop: Panelist

[162] Rachel Haga[165]
Research Associate
Institute for Defense Analyses
Panel
2021

Finding the Human in the Loop: Considerations for AI in Decision Making

[162] Joe Lyons[165]
Lead for the Collaborative Interfaces and Teaming Core Research Area
711 Human Performance Wing at Wright-Patterson AFB
Panel
2021

Finding the Human in the Loop: Panelist

[162] Chad Bieber[165]
Director, Test and Evaluation. Senior Research Engineer.
Johns Hopkins University Applied Physics Laboratory
Panel
2021

Finding the Human in the Loop: Panelist

[162] Poornima Madhavan[165]
Principal Scientist and Capability Lead for Social and Behavioral Sciences
MITRE
Panel
2021

The Role of the Statistics Profession in the DoD’s Current AI Initiative

[162] Laura Freeman[165]
Research Associate Professor of Statistics and Director of the Intelligent Systems Lab
Virginia Tech
Roundtable
2021

Test Design and Analysis for Modeling & Simulation Validation

[162] Kelly Avery[165]
Research Staff Member
Institute for Defense Analyses
Roundtable
2021

Organizing and Sharing Data within the T&E Community

[162] Matthew Avery[165]
Research Staff Memeber
Institute for Defense Analyses
Roundtable
2021

Opportunities and Challenges for Openly Publishing Statistics Research for National Defense

[162] Lyndsay Shand[165]
R&D Statistician
Sandia National Laboratories
Roundtable
2021

Identifying Challenges and Solutions to T&E of Non-IP Networks

[162] Peter Mancini[165]
Research Staff Member
Institute for Defense Analyses
Roundtable
2021

Overcoming Challenges and Applying Sequential Procedures to T&E

[162] Rebecca Medlin[165]
Research Staff Member
Institute for Defense Analyses
Roundtable
2021

Bayesian Analysis

[162] Robert Gramacy[165]
Virginia Tech
Short Course materials 2019

Categorical Data Analysis

[162] Christopher Franck[165]
Virginia Tech
Short Course materials 2019

Multivariate Data Analysis

[162] Doug Steinley[165]
University of Missouri
Short Course materials 2019

Statistical Methods for Modeling and Simulation Verification and Validation

[162] Dr. Jim Simpson, Dr. Jim Wisnowski, and Dr. Stargel Doane[165]
JK Analytics LLC, Adsurgo LLC, Analytical Arts LLC
Short Course materials 2019

Uncertainty Quantification

[162] Ralph Smith[165]
North Carolina State University
Short Course materials 2019

Design of Experiments

[162] Dr. Doug Montgomery and Dr. Caleb King[165]
Arizona State University, JMP
Short Course 2019

Overview of Design of Experiments

[162] Doug Montgomery[165]
Professor
Arizon State University
Short Course materials 2016

Experiences in Reliability Analysis

[162] Bill Meeker[165]
Professor
Iowa State University
Short Course materials 2016

Advanced Regression

[162] Geoff Vining[165]
Professor
Virginia Tech University
Short Course materials 2016

Introduction to Bayesian

[162] Robert Gramacy[165]
Associate Professor
University of Chicago
Short Course 2016

Introduction To Design of Experiments

[162] Doug Montgomery[165]
Professor
Arizona State University
Short Course 2017

Introduction To Design of Experiments

[162] Brad Jones[165]
Professor
Arizona State University
Short Course 2017

Data Farming

[162] Susan Sanchez[165]
Naval Postgraduate School
Short Course materials 2017

Split-Plot and Restricted Randomization Designs

[162] Jim Simpson[165]
JK Analytics
Short Course materials 2017

Statistical Models for Reliability Data

[162] William Meeker[165]
Professor
Iowa State University
Short Course materials 2017

Data Visualization