DATAWorks Archive

Session Title Speaker Type Materials Yr
Open Architecture Tradeoffs (OAT): A simple, computational game engine for rapidly exploring hypotheses in Battle Management Command and Control (BMC2) Shelley Cazares

Breakout 2019
Comparison of Methods for Testing Uniformity to Support the Validation of Simulation Models used for Live-Fire Testing Shannon Shelburne

Breakout 2019
Valuing Human Systems Integration: A Test and Data Perspective Jeffrey Thomas

Breakout 2019
Air Force Human Systems Integration Program Anthony Thomas

Breakout 2019
Toward Real-Time Decision Making in Experimental Settings Devin Francom

Breakout 2019
Area Validation for Applications with Mixed Uncertainty Laura White

Breakout 2019
A 2nd-Order Uncertainty Quantification Framework Applied to a Turbulence Model Validation Effort Robert Baurle

Breakout 2019
Sources of Error and Bias in Experiments with Human Subjects Poornima Madhavan

Breakout 2019
Deep Reinforcement Learning Benjamin Bell

Breakout 2019
Decentralized Signal Processing and Distributed Control for Collaborative Autonomous Sensor Networks Ryan Goldhahn

Breakout 2019
An Overview of Uncertainty-Tolerant Decision Support Modeling for Cybersecurity Samrat Chatterjee

Breakout 2019
Software Reliability and Security Assessment: Automation and Frameworks Lance Fiondella

Breakout 2019
AI & ML in Complex Environment Tien Pham

Breakout 2019
Waste Not, Want Not: A Methodological Illustration of Quantitative Text Analysis Laura Castro-Schilo

Breakout 2019
Machine Learning Prediction With Streamed Sensor Data: Fitting Neural Networks using Functional Principal Components Chris Gotwalt

Breakout 2019
Screening Designs for Resource Constrained Deterministic M&S Experiments: A Munitions Case Study Christopher Drake

Breakout 2019
The Isle of Misfit Designs: A Guided Tour of Optimal Designs That Break the Mold Caleb King

Breakout 2019
Adapting Operational Test to Rapid-Acquisition Programs Panel Discussion

Breakout 2019
Sample Size Calculations for Quiet Sonic Boom Community Surveys Jasme Lee

Breakout 2019
Improved Surface Gunnery Analysis with Continuous Data Benjamin Ashwell & V. Bram Lillard

Breakout 2019
Human in the Loop Experiment Series Evaluating Synthetic Vision Displays for Enhanced Airplane State Awareness Kathryn Ballard

Breakout 2019
Statistical Engineering and M&S in the Design and Development of DoD Systems Doug Ray & Melissa Jablonski

Breakout 2019
Uncertainty Quantification: Combining Large Scale Computational Models with Physical Data for Inference Dave Higdon

Breakout 2019
A User-Centered Design Approach to Military Software Development Pam Savage-Knepshield

Breakout 2019
Engineering first, Statistics second: Deploying Statistical Test Optimization (STO) for Cyber Kedar Phadke

Breakout 2019
Validation and Uncertainty Quantification of Complex Models Kassie Fronczyk

Breakout 2019
Communicating Statistical Concepts and Results: Lessons Learned from the US Service Academies Panel Discussion

Breakout 2019
Multivariate Density Estimation and Data-enclosing Sets Using Sliced-Normal Distributions Luis Crespo

Breakout 2019
A Statistical Approach for Uncertainty Quantification with Missing Data Mark Andrews

Breakout 2019
Exploring Problems in Shipboard Air Defense with Modeling Ralph Donnelly & Benjamin Ashwell

Breakout 2019
Sequential Testing for Fast Jet Life Support Systems Darryl Ahner

Breakout 2019
Bayesian Component Reliability Estimation: F-35 Case Study V. Bram Lillard & Rebecca Medlin

Breakout 2019
Applying Functional Data Analysis throughout Aerospace Testing David Harrison

Breakout 2019
Adopting Optimized Software Test Design Methods at Scale Justin Hunter

Breakout 2019
A Quantitative Assessment of the Science Robustness of the Europa Clipper Mission Kelli McCoy

Breakout 2019
Identifying and Contextualizing Maximum Instrument Fault Rates and Minimum Instrument Recovery Times for Europa Clipper Science through Applied Statistics and Strategic Visualizations Thomas Youmans

Breakout 2019
Design and Analysis of Experiments for Europa Clipper’s Science Sensitivity Model Amy Braverman

Breakout 2019
SLS Structural Dynamics Sensor Optimization Study Ken Toro & Jon Stallrich

Breakout 2019
The 80/20 rule, can and should we break it using efficient data management tools? Ghaleb Abdulla

Breakout 2019
Time Machine Learning: Getting Navy Maintenance Duration Right Tim Kao

Breakout 2019
Behavioral Analytics: Paradigms and Performance Tools of Engagement in System Cybersecurity Robert Gough

Breakout 2019
3D Mapping, Plotting, and Printing in R with Rayshader Tyler Morgan-Wall

Breakout 2019
Functional Data Analysis for Design of Experiments Tom Donnelly

Breakout 2019
Test and Evaluation of Emerging Technologies Dr. Greg Zacharias, Chief Scientist Operational Test and Evaluation

Breakout 2019
Challenges in Test and Evaluation of AI: DoD’s Project Maven Jane Pinelis

Breakout 2019
Demystifying the Black Box: A Test Strategy for Autonomy Dan Porter

Breakout 2019
Satellite Affordability in LEO (SAL) Matthew Avery

Breakout 2019
Statistical Process Control and Capability Study on the Water Content Measurements in NASA Glenn’s Icing Research Tunnel Emily Timko

Breakout 2019
Reasoning about Uncertainty with the Stan Modeling Language John Haman

Breakout 2019
Target Location Error Estimation Using Parametric Models James Brownlow

Breakout 2019
Anatomy of a Cyberattack: Standardizing Data Collection for Adversarial and Defensive Analyses Jason Schlup

Breakout 2019
A Survey of Statistical Methods in Aeronautical Ground Testing Drew Landman

Breakout 2019
Your Mean May Not Mean What You Mean It to Mean Ken Johnson

Breakout 2019
A Causal Perspective on Reliability Assessment Lauren Hund

Breakout 2019
Hypergames for Control System Security Arnab Bhattacharya

Breakout 2019
Probabilistic Data Synthesis to Provide a Defensible Risk Assessment for Army Munition Kevin Singer

Breakout 2019
Using Bayesian Neural Networks for Uncertainty Quantification of Hyperspectral Image Target Detection Daniel Ries

Breakout 2019
Constructing Designs for Fault Location Erin Lanus

Breakout 2019
Accelerating Uncertainty Quantification for Complex Computational Models James Warner

Breakout 2019
When Validation Fails: Analysis of Data from an Imperfect Test Chamber Kendal Ferguson

Breakout 2019
Technical Leadership Panel-Tuesday Afternoon Dr. Catherine Warner
Science Advsior
DOT&E
Breakout 2016
Technical Leadership Panel-Tuesday Afternoon Paul Roberts
Chief Engineer
Engineering and Safety Center
Breakout 2016
Technical Leadership Panel-Tuesday Afternoon Frank Peri
Deputy Director
Langley Engineering Directorate
Breakout 2016
Technical Leadership Panel-Tuesday Afternoon CAPT Peter Matisoo
Technical Director
COTF
Breakout 2016
Technical Leadership Panel-Tuesday Afternoon Jeff Olinger
Technical Director
AFOTEC
Breakout 2016
Combining information for Realiability Assesment-Tuesday Morning Dr. Alyson Wilson

North Carolina State University
Breakout
materials
2016
Reliability Growth in T&E – Summary of National Research Council’s Committee on National Statistics Report Finding-Tuesday Morning Dr. Art Fries
Research Staff Member
IDA
Breakout
materials
2016
Design and Analysis of Margin Testing in Support of Product Qualification for High Reliability Systems Dr. Justin Newcomer

Sandia National Lab
Breakout 2016
Three Case Studies Comparing Traditional versus Modern Test Designs Dr. Ray Hill

Air Force instite of Technology
Breakout
materials
2016
Supersaturated Designs: Construction and Analysis Dr. David Edwards

Virginia Commonwealth University
Breakout 2016
Statistically Defensible Experiment Design for Wind Tunnel Characterization of Subscale Parachutes for Mission to Mars Dr. Drew Landman

Old Dominion Univerity
Breakout
materials
2016
Managing Uncertainty in the Context of Risk Acceptance Decision Making at NASA: Thinking Beyond the Model Dr. Homayoon Dezfuli

NASA
Breakout
materials
2016
Acceptability of Radiation Detection Systems Dr. Dennis Leber

NIST
Breakout
materials
2016
Risk Analysis for Orbital Debris Wire Harness Failure Assessment for the Joint Polar Satellite System Dr. Joel Williamsen

IDA
Breakout
materials
2016
Application of Statistical Engineering to Mixture Problems With Process Variables Dr. Roger Hoerl

Union College
Breakout
materials
2016
The Sixth Sense: Clarity through Statistical Engineering Dr. Jennifer Van-Mullekom

DuPont
Breakout 2016
Case Studies for Statistical Engineering Applied to Powered Rotorcraft Wind-Tunnel Tests Dr. Sean Commo

NASA
Breakout 2016
Bayesian Adaptive Design for Conformance Testing with Bernoulli Trials Dr. Adamn Pintar

NIST
Breakout
materials
2016
Statistical Models for Combining Information: Styrker Reliability Case Study Dr. Rebecca Dickinson

IDA
Breakout
materials
2016
Bayesian Estimation of Reliability Growth Dr. Jim Brownlow

U.S. Air Force 812TSS/ENT
Breakout
materials
2016
Recent use of Statistical Methods in NASA Aeroscience Testing Research and Development Activities Dr. Eric Walker

NASA
Breakout 2016
“High Velocity Analytics for NASA JPL Mars Rover Experimental Design” Dr. Jim Wisnowski
Co-founder/Principle
Adsurgo
Breakout
materials
2016
“High Velocity Analytics for NASA JPL Mars Rover Experimental Design” Dr. Heath Rushing
Co-founder/Principle
Adsurgo
Breakout
materials
2016
An Engineer and a Statistician Walk into a Bar: A Statistical Engineering Negotiation Mr. Ken Johnson

NASA
Breakout
materials
2016
Making Statistically Defensible Testing ‘The way we do things around here’ Mr. Greg Hutto

Air Force 96th Test Wing
Breakout 2016
Using Sequential Testing to Address Complex Full-Scale Live Fire Test and Evaluation Dr. Darryl Ahner

AFIT, STAT COE
Breakout 2016
Aerospace Measurement and Experimental System Development Characterization Mr. Ray Rhew

NASA
Breakout
materials
2016
Leveraging Design for Variation to Improve both Testing and Design – A Case Study on Probabilistic Design of Bearings Dr. Jaime O’connell

Pratt and Whitney
Breakout
materials
2016
Importance of Modeling and Simulation in Testing and the Need for Rigorous Validation Dr. Kelly McGinnity

IDA
Breakout
materials
2016
Operational Cybersecurity Testing Mr. Alex Hoover

DHS
Breakout
materials
2016
Dr. Tye Botting
Research Staff Member
IDA
Breakout 2016
Recent Advances in Measuring Display Clutter Dr. David Kaber

NCSU
Breakout
materials
2017
Recent Advances in Measuring Display Clutter Dr. Carl Pankok

Breakout
materials
2017
Trust in Automation Dr. Joseph Lyons
Technical Advisor
Air Force Research Laboratory
Breakout
materials
2017
Dose-Response Model of Recent Sonic Boom Community Annoyance Data Dr. Jonathan Rathsam

NASA
Breakout 2017
Overview of Statistical Validation Tools Dr. Kelly McGinnity

IDA
Breakout
materials
2017
Improving the Rigor of Navy M&S VV&A through the application of Design of Experiments Methodologies and related Statistical Techniques Dr. Stargel Doane

COTF
Breakout
materials
2017
Validation of AIM-9X Modeling and Simulation Dr. Rebecca Dickinson
Research Staff Member
IDA
Breakout
materials
2017
Software Reliability Modeling Dr. Lance Fiondella

UMASS
Breakout
materials
2017
Reliability Growth Modeling Dr. Kellly Sullivan

University of Arkansas
Breakout
materials
2017
Updating R and Reliability Training with Bill Meeker Dr. Jason Freels

AFIT
Breakout
materials
2017
Introduction to Bayesian Statistics Dr. Alyson Wilson

North Carolina State University
Breakout
materials
2017
How do the Framework and Design of Experiments Fundamentally Help? Dr. Luis A. Cortes

Breakout 2017
How do the Framework and Design of Experiments Fundamentally Help? Mr. Mike Sheeha

MITRE
Breakout 2017
Allocating Information Gathering Efforts for Selection Decisions Dr. Dennis Leber

NIST
Breakout
materials
2017
Allocating Information Gathering Efforts for Selection Decisions Dr. Jeffrey Herrmann

University of Maryland
Breakout
materials
2017
Statistical Methods for Programmatic Assessment and Anomaly Detection Mr. Douglas Brown

BAH
Breakout
materials
2017
Statistical Methods for Programmatic Assessment and Anomaly Detection Dr. Ray McCollum

BAH
Breakout
materials
2017
Flight Test and Evaluation of Airborne Spacing Application Dr. Sara Wilson

NASA
Breakout
materials
2017
Testing and Estimation in Sequential High-Dimension Data Dr. Eric Chicken

Florida State University
Breakout
materials
2017
Blast Noise Event Classification from a Spectrogram Dr. Edward Nykaza

Army Engineering Research and Development Center, Construction Engineering Research Laboratory
Breakout
materials
2017
Automated Software Testing Best Practices and Framework: A STAT COE Project Dr. Jim Simpson

JK Analytics
Breakout
materials
2017
Automated Software Testing Best Practices and Framework: A STAT COE Project Dr. Jim Wisnowski

Adsurgo
Breakout
materials
2017
Software Test Techniques Dr. Jose Calderon

Galois
Breakout
materials
2017
Combinational Testing Dr. Raghu Kacker

NIST
Breakout
materials
2017
Combinational Testing Dr. Rick Kuhn

NIST
Breakout
materials
2017
Introduction to Human Measurement Dr. Cynthia Null

NASA
Breakout 2017
The (Empirical) Case for Analyzing Likert-Type Data with Parametric Tests Dr. Heather Wojton
Research Staff Member
IDA
Breakout
materials
2017
The System Usability Scale: A measurement Instrument Should Suit the Measurement Needs Mr. Keith Kidder

AFOTEC
Breakout
materials
2017
Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation Mr. Scott West

Aerospace Corporation
Breakout
materials
2017
Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation Mr. Martin Annett

Aerospace Corporation
Breakout
materials
2017
Deterministic System Design of Experiments Based Frangible Joint Design Reliability Estimation Dr. James Womach

Aerospace Corporation
Breakout
materials
2017
Machine Learning: Overview and Applications to Test Lt. Takayuki Iguchi

AFOTEC
Breakout
materials
2017
Machine Learning: Overview and Applications to Test Lt. Megan Lewis

AFOTEC
Breakout
materials
2017
Range Adversarial Planning Tool for Autonomy Test and Evaluation Dr. Chad Hawthorne

JHU/APL
Breakout 2017
Search for Extended Test Design Methods for Complex Systems of Systems Dr. Alex Alaniz

AFOTEC
Breakout
materials
2017
The Future of Engineering at NASA Langley Mr. Joe Gasbarre

NASA
Breakout
materials
2017
Combinatorial Testing for Link-16 Developmental Test and Evaluation Mr. Tim Mclean

MCTSSA
Breakout
materials
2017
Censored Data Analysis for Performance Data Dr. Bram Lillard

IDA
Breakout
materials
2017
Estimating the Distribution of an Extremum using a Peaks-Over-Threshold Model and Monte Carlo Simulation Dr. Adam Pintar

NIST
Breakout
materials
2017
Design & Analysis of a Computer Experiment for an Aerospace Conformance Simulation Study Dr. David Edwards

Virginia Commonwealth University
Breakout
materials
2017
Optimal Multi-Response Designs Dr. Sarah Burke

STAT COE
Breakout 2017
Augmenting Definitive Screening Designs Ms. Abby Nachtsheim

ASU
Breakout
materials
2017
Integrated Uncertainty Quantification for Risk and Resource Management: Building Confidence in Design Dr. Eric Walker

NASA
Breakout
materials
2017
Background of NASA’s Juncture Flow Validation Test Mr. Joseph Morrison

NASA
Breakout 2017
A Study to Investigate the Use of CFD as a Surrogate for Wind Tunnel Testing in the High Supersonic Speed Regime Dr. Eric Walker

NASA
Breakout
materials
2017
A Study to Investigate the Use of CFD as a Surrogate for Wind Tunnel Testing in the High Supersonic Speed Regime Mr. Joseph Morrison

NASA
Breakout
materials
2017
Communicating Complex Statistical Methodologies to Leadership Dr. Jane Pinelis

Johns Hopkins University Applied Physics Lab or JHU
Breakout
materials
2017
Communicating Complex Statistical Methodologies to Leadership Mr. Paul Johnson

MCOTEA
Breakout
materials
2017
DOE Case Studies in Aerospace Research and Development Dr. Drew Landman

Old Dominion University
Breakout
materials
2017
Sample Size and Considerations for Statistical Power Mr. Vance Oas

AFOTEC
Breakout
materials
2017
Sample Size and Considerations for Statistical Power Mr. Nick Garcia

AFOTEC
Breakout
materials
2017
Experimental Design for Composite Pressure Vessel Life Prediction Dr. Anne Drsicoll

Virginia Tech
Breakout
materials
2017
Improving Sensitivity Experiments Mr. Douglas Ray

US Army RDECOM ARDEC
Breakout
materials
2017
Improving Sensitivity Experiments Mr. Kevin Singer

US Army
Breakout
materials
2017
Sequential Experimentation for a Binary Response – The Break Separation Method Mr. Darsh Thakkar

RIT-S
Breakout
materials
2017
Sequential Experimentation for a Binary Response – The Break Separation Method Dr. Rachel Silvestrini

RIT-S
Breakout
materials
2017
Carrier Reliability Model Validation Dr. Dean Thomas

IDA
Breakout 2017
Model Based Systems Engineering Panel Discussion Mr. John Holladay

NASA
Breakout
materials
2017
Resampling Methods Dr. David Ruth

United States Naval Academy
Breakout
materials
2017
Structured Decision Making Dr. Christine Anderson Cook

LANL
Breakout
materials
2017
Do Asymmetries in Nuclear Arsenals Matter? Dr. Jane Pinelis

Johns Hopkins University Applied Physics Lab or JHU
Breakout
materials
2017
Communication in Statistics & the Five Hardest Concepts Dr. Jennifer Van-Mellekom

Virginia Tech
Breakout 2017
Uncertainty Quantification: What is it and Why it is Important to Test, Evaluation, and Modeling and Simulation in Defense and Aerospace Dr. Peter Qian

University of Wisconsin and SmartUQ
Breakout
materials
2017
Model Uncertainty and its Inclusion in Testing Results Dr. Stever Lund

NIST
Breakout
materials
2017
VV&UQ – Uncertainty Quantification for Model-Based Engineering of DoD Systems Mr. Douglas Ray

US Army RDECOM ARDEC
Breakout
materials
2017
VV&UQ – Uncertainty Quantification for Model-Based Engineering of DoD Systems Ms. Melissa Jablonski

US Army
Breakout
materials
2017
Data Visualization Ms. Lori Perklins

NASA
Breakout 2017
Big Data, Big Think Mr. Robert Beil

NASA
Breakout
materials
2017
Project Data Flow Is an Engineered System Mr. Ken Johnson

NASA
Breakout
materials
2017
Comparing Experimental Designs Dr. Tom Donnelly

JMP
Breakout
materials
2017
Testing Autonomous Systems Dr. Darryl Ahner
Director
AFIT
Breakout
materials
2018
Screening Experiments with Partial Replication Mr. David Edwards

Virginia Commonwealth University
Breakout
materials
2018
What is Bayesian Experimental Design? Blaza Toman

Statistical Engineering Division, NIST
Breakout
materials
2018
DOE and Test Automation for System of Systems TE Jim Simpson

JK Analytics
Breakout
materials
2018
Building A Universal Helicopter Noise Model Using Machine Learning Eric Greenwood

Aeroacoustics Branch
Breakout
materials
2018
Machine Learning to Assess Piolts’ Cognitive State Tina Heinich
Computer Engineer, OCIO Data Science Team
AST, Data Systems
Breakout
materials
2018
CYBER Penetration Testing and Statistical Analysis in DT&E Timothy McLean

Breakout
materials
2018
Method for Evaluating the Quality of Cybersecurity Defenses Dr, Shawn Whetstone
Research Staff Member
IDA
Breakout
materials
2018
Metrics to Characterize Temporal patterns in Lifespans of Artifacts Soumyo MoitraNA

Software Engineering Institute Carnegie Mellon Univeristy
Breakout
materials
2018
Uncertainty Quantification with Mixed Uncertainty Sources Tom West

Breakout 2018
System Level Uncertainty Quanification for Low-Boom Supersonic Flight Vehicles Ben Phillips

Breakout 2018
Uncertainty Quantification and Analysis at The Boeing Company John Schaefer

Sandia National Labortories
Breakout
materials
2018
Interface design for analysts in a data and analysis-rich environment Karin Butler

Sandia National Labortories
Breakout
materials
2018
Asparagus is the most articulate vegetable ever Kerstan Cole

Breakout 2018
Mitigating Pilot Disorientation with Synthetic Vision Displays Kathryn Ballard

NASA
Breakout
materials
2018
Sage III Seu Statistical Analysis Model Ray McCollum

Booz Allen Hamilton
Breakout
materials
2018
Initial Validation of the Trust of Automated System Test Dr. Heather Wojton
Research Staff Member
IDA
Breakout
materials
2018
Operational Evaluation of a Flight-deck Software Application Sara Wilson

NASA
Breakout
materials
2018
Comparing M&S Output to Live Test Data: A Missile System Case Study Dr. Kelly Avery
Reasearch Staff member
IDA
Breakout
materials
2018
NASA’s Human Exploration Research Analog (HERA): An analog mission for isolation, confinement, and remote conditions in space exploration scenarios Shelley Cazares

NASA
Breakout 2018
Reliability Fundamentals and Analysus Lessons Learned Dan Telford

AFOTEC
Breakout
materials
2018
Design and Analysis of Nonlinear Models for the Mars 2020 Rover Jim Wisnowski

Breakout
materials
2018
Cases of Second-Order Split-Plot Designs Dr. Luis Cortes

MITRE
Breakout
materials
2018
The Development and Execution of Split-Plot Designs In Navy Operational Test and Evaluation: A Practitioner’s Perspective Stargel Doane

Breakout 2018
B-52 Radar Modernization Test Design Considerations Stuart Corbett

AFOTEC
Breakout
materials
2018
B-52 Radar Modernization Test Design Considerations Joseph Maloney

AFOTEC
Breakout
materials
2018
Experimental Design of a Unique Force Measurement System Calibration Ken Toro

Breakout 2018
Application of Design of Experiments to a Calibration of the National Transonic Facility Matt Rhode

NASA
Breakout
materials
2018
Application of Design of Experiments to a Calibration of the National Transonic Facility Matt Bailey

Jacobs Technology Inc
Breakout
materials
2018
The Use of DOE vs OFAT in the Calibration of AEDC Wind Tunnels Rebecca Rought

AEDC/TSTA
Breakout
materials
2018
Initial Investigation into the Psychoacoustic Properties of Small Unmanned Aerial System Noise Andrew Chrisrian

Structural Acoustics Branch
Breakout
materials
2018
Combining Human Factors Data and Models of Human Performance Cynthia Null
Technicial Fellow for Human Factors
Breakout
materials
2018
A Multi-method, Triangulation Approach to Operational Testing Dr. Daniel Porter
Research Staff Member
IDA
Breakout
materials
2018
Illustrating the Importance of Uncertainty Quantification (UQ) in Munitions Modeling Donald Calucci

Breakout 2018
Space-Filling Designs for Robustness Experiments Roshan Vengazhiyil

Breakout 2018
Introduction of Uncertainty Quantification and Industry Challenges Peter Chien

Breakout 2018
The Effect of Extremes in Small Sample Size on Simple Mixed Models: A Comparison of Level-1 and Level-2 Size Dr. Kristina Carter
Research Staff Member
IDA
Breakout
materials
2018
Evaluating Deterministic Models of Time Series by Comparison to Observations Amy Braverman

Jet Propulsion Laboratory, California Institute of Technology
Breakout
materials
2018
Challenger Challenge: Pass-Fail Thinking Increases Risk Measurably Ken Johnson
Applied Statistician
NASA Engineering and Safety Center
Breakout
materials
2018
Doppler Assisted Sensor Fusion for Tracking and Exploitation J. Derek Tucker

Sandia National Laboratories
Breakout
materials
2018
XPCA: A Copula-based Generalization of PCA for Ordinal Data Cliff Anderson-Bergman

Sandia National Laboratories
Breakout
materials
2018
Insights, Predictions, and Actions: Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence Dr. Andrew Flack
Research Staff Member
IDA
Breakout
materials
2018
Bayesian Calibration and Uncertainty Analysis: A Case Study Using a 2-D CFD Turbulence Model Peter Chien

Contributed 2018
Assessing Human Visual Inspection for Acceptance Testing: An Attribute Agreement Analysis Case Study Christopher Drake
Lead Statistician
QE&SA Statistical Methods & Analysis Group
Contributed
materials
2018
Leveraging Anomaly Detection for Aircraft System Health Data Stability Reporting Kyle Gartrell

Contributed
materials
2018
Application of Adaptive Sampling to Advance the Metamodeling and Uncertainty Quantification Process Erik Axdahl

Hypersonic Airbreathing Propulsion Branch NASA Langley Research Center
Contributed
materials
2018
Application of Adaptive Sampling to Advance the Metamodeling and Uncertainty Quantification Process Robert Baurle

Hypersonic Airbreathing Propulsion Branch NASA Langley Research Center
Contributed
materials
2018
Application of Statistical Methods and Designed Experiments to Development of Technical Requirements Eli Golden

U.S. ARMY ARMAMENT RESEARCH, DEVELOPMENT & ENGINEERING CENTER
Contributed
materials
2018
Infrastructure Lifetimes Erika Taketa

Lawrence Livermore National Laboratory
Contributed
materials
2018
Infrastructure Lifetimes William Romine

Lawrence Livermore National Laboratory
Contributed
materials
2018
Workforce Analytics William Romine

Lawrence Livermore National Laboratory
Contributed 2018
Optimizing for Mission Success in Highly Uncertain Scenarios Brian Chell

Contributed 2018
Test Planning for Observational Studies using Poisson Process Modeling Brian Stone

AFOTEC
Contributed
materials
2018
Model credibility in statistical reliability analysis with limited data Caleb King

Sandia National Laboratories
Contributed
materials
2018
Sound level recommendations for quiet sonic boom dose-response community surveys Jasme Lee

North Carlina State Univeristy
Contributed
materials
2018
Development of a Locking Setback Mass for Cluster Munition Applications: A UQ Case Study Melissa Jablonski

U.S. ARMY ARMAMENT RESEARCH, DEVELOPMENT & ENGINEERING CENTER
Contributed
materials
2018
Wednesday Keynote Speaker I Dr. Peter Parker
Team Lead, Advanced Measurement Systems
NASA
Keynote
2019
Tuesday Keynote Dr. David Chu
President
Institute for Defense Analyses
Keynote
2019
Thursday Keynote Speaker II Mr. Michael Little
Program Manager, Advanced Information Systems Technology
Earth Science Technology Office, NASA Headquarters
Keynote
2019
Thursday Keynote Speaker I Dr. Wendy Martinez
Director, Mathematical Statistics Research Center, Bureau of Labor Statistics
ASA President-Elect (2020)
Keynote
materials
2019
Wednesday Keynote Speaker II Dr. Laura Freeman
Associate Director, ISL
Hume Center for National Security and Technology, Virginia Tech
Keynote
2019
Thursday Lunchtime Keynote Speaker Dr. T. Charles Clancy
Bradley Professor of Electrical and Computer Engineering
Virginia Tech
Keynote
2019
Wednesday Keynote Speaker III Mr. Timothy Dare
Deputy Director, Developmental Test, Evaluation, and Prototyping
SES OUSD(R&E)
Keynote
2019
Wednesday Lunchtime Keynote Speaker Dr. Jared Freeman
Chief Scientist of Aptima and Chair of the Human Systems Division
National Defense Industry Association
Keynote
2019
Welcoming & Opening Keynote-Tuesday AM Dr. Mike Gilmore
Director
DOT&E
Keynote
materials
2016
Lunch with Keynote Leadership Perspective Dr. Jon Hollday

NASA
Keynote
2016
STAT Engineering Keynote-Wednesday AM Dr. Christine Anderson Cook
Statistics
Los Alamos National Lab
Keynote
2016
Lunch With Leadership Perspective-Wednesday PM Dr. David Brown
Deputy Assistant
Secretary of Defense, Developmental Test & Evaluation
Keynote
2016
Test and Evaluation Matter for Warfighter and We Need your Help to Make it Better Dr. Katherine Warner
Science Advisor within Secretary of Defense
DOT&E
Keynote
materials
2017
Retooling Design and Development Mr. Chris Singer
NASA Deputy Chief Engineer
NASA
Keynote
materials
2017
Reflections on Statistical Engineering and it’s Application Dr. Geoff Vining
Professor
Virginia Tech
Keynote
materials
2017
Developmental Test and Evaluation Dr. Brian Hall
Principal Deputy Director
DoD
Keynote
materials
2017
Mr. Dave Duma
Acting Director, Operationak Test and Evaluation, Office of the Secretary of Defense
DOT&E
Keynote
2017
Opening Keynote Dr. David Chu
President
IDA
Keynote
2018
Closing Remarks Mr. Robert Behler
Director
DOT&E
Keynote
2018
Testing and Analytical Challenges on the Path to Hypersonic Flight Dr. Mark Lewis
Director
IDA-STPI
Keynote
materials
2018
Journey to a Data Centric Approcach for National Security Dr. Marcey Hoover
Quality Assurance Director
Sandia National Labortories
Keynote
materials
2018
NASA AERONAUTICS Mr. Bob Pearce
Deputy Associate Administrator
Strategy, Aeronautics Research Mission DirectorateNASA
Keynote
materials
2018
High-Effective Statistical Collaboration. The Art and the Science Dr. Peter Parker
Team Lead
Advance Measurement Systems NASA
Keynote
materials
2018
Consensus Building Dr. Antonio Possolo
NIST Fellow, Chief Statistician
National Institute of Standards and Technology.
Keynote
materials
2018
Opening Keynote Mr. Dave Duma
Assistant Director
Operational Test and Evaluation
Keynote
2018
Bayesian Analysis Dr. Robert Gramacy

Virginia Tech
Short Course
materials
2019
Categorical Data Analysis Dr. Christopher Franck

Virginia Tech
Short Course
materials
2019
Multivariate Data Analysis Dr. Doug Steinley

University of Missouri
Short Course
materials
2019
Statistical Methods for Modeling and Simulation Verification and Validation Dr. Jim Simpson, Dr. Jim Wisnowski, and Dr. Stargel Doane

JK Analytics LLC, Adsurgo LLC, Analytical Arts LLC
Short Course
materials
2019
Uncertainty Quantification Dr. Ralph Smith

North Carolina State University
Short Course
materials
2019
Design of Experiments Dr. Doug Montgomery and Dr. Caleb King

Arizona State University, JMP
Short Course 2019
Overview of Design of Experiments Dr. Doug Montgomery
Professor
Arizon State University
Short Course
materials
2016
Experiences in Reliability Analysis Dr. Bill Meeker
Professor
Iowa State University
Short Course
materials
2016
Advanced Regression Dr. Geoff Vining
Professor
Virginia Tech University
Short Course
materials
2016
Introduction to Bayesian Dr. Robert Gramacy
Associate Professor
University of Chicago
Short Course 2016
Introduction To Design of Experiments Dr. Doug Montgomery
Professor
Arizona State University
Short Course 2017
Introduction To Design of Experiments Dr. Brad Jones
Professor
Arizona State University
Short Course 2017
Data Farming Dr. Susan Sanchez

Naval Postgraduate School
Short Course
materials
2017
Split-Plot and Restricted Randomization Designs Dr. Jim Simpson

JK Analytics
Short Course
materials
2017
Statistical Models for Reliability Data Dr. William Meeker
Professor
Iowa State University
Short Course
materials
2017
Data Visualization Dr. Jim Wisnowski

Adsurgo
Short Course
materials
2017
Modern Response Surface Methods & Computer Experiments Dr. Robert Gramacy

Virginia Polytechnic Institute and State University
Short Course
materials
2018
Overview of Design of Experiments Dr. Bradley Jones
Distinguished Research Fellow
JMP Division/SAS
Short Course
materials
2018
Overview of Design of Experiments Dr. Doug Motgomery
Regents’ Professor of Industrial Engineering and Statistics
ASU Foundation Professor of Engineering Arizona State University
Short Course
materials
2018
Introduction to R Dr. Justin Post

North Carlina State Univeristy
Short Course
materials
2018
Survey Construction and Analysis Dr. Wendy Matrinez

Bureau of Labor and Statistics
Short Course
materials
2018
Survey Construction and Analysis Dr. MoonJung Cho

Bureau of Labor and Statistics
Short Course
materials
2018
Uncertainty Quantification Dr. Ralph Smith

North Carlina State Univeristy
Short Course
materials
2018
Tutorial: Combinatorial Methods for Testing and Analysis of Critical Software and Security Systems Rick Kuhn, Dimitris Simos, and Raghu Kacker

National Institute of Standards & Technology
Tutorial 2019
Tutorial: Cyber Attack Resilient Weapon Systems Barry Horowitz
Professor, Systems Engineering
University of Virginia
Tutorial 2019
Tutorial: Learning Python and Julia Douglas Hodson
Associate Professor
Air Force Institute of Technology
Tutorial 2019
Tutorial: Statistics Boot Camp Kelly Avery

IDA
Tutorial 2019
Tutorial: Reproducible Research Andrew Flack, Kevin Kirshenbaum, and John Haman

IDA
Tutorial 2019
Tutorial: Developing Valid and Reliable Scales Heather Wojton & Shane Hall

IDA / USARMY ATEC
Tutorial 2019
The Bootstrap World Dr. Matt Avery
Research Staff Member
IDA
Tutorial
materials
2016
Dr. Lance Fiondella

Univeristy of Massachusetts, Dartmouth
Tutorial
materials
2016
A Statistical Tool for Efficient and information-Rich Testing Dr. Bram Lillard
Research Staff Member
IDA
Tutorial
materials
2016
Power Anyalysis Concepts Dr. Jim Simpson

JK Analytics
Tutorial
materials
2016
Introduction to Survey Design Dr. Heather Wojton
Research Staff Member
IDA
Tutorial
materials
2016
Introduction to Survey Design Dr. Justin Mary
Research Staff Member
IDA
Tutorial
materials
2016
Introduction to Survey Design Mr. Jonathan Snavely

IDA
Tutorial
materials
2016
Bayesian Data Analysis in R/STAN Dr. Kassandra Fronczyk

IDA
Tutorial
materials
2016
Bayesian Data Analysis in R/STAN Dr. James Brownlow

U.S. Air Force 812TSS/ENT
Tutorial
materials
2016
Presenting Complex Statistical Methodologies to Military Leadership Dr. Jane Pinelis

John Hopkins University, Applied Physics Lab
Tutorial
materials
2016
Sensitivity Experiments Dr. Thomas Johnson
Research Staff Member
IDA
Tutorial
materials
2016
Sensitivity Experiments Mr. Greg Hutton

U.S. Air Force , 96 Test Wing
Tutorial
materials
2016
Creating Shiny Apps in R for Sharing Automated Statistical Products Mr. Randy Griffiths

U.S. Army Evaluation Center
Tutorial
materials
2018
Determination of Power for Complex Experimental Designs Mr. Pat Whitcomb

Stat-Ease, Inc
Tutorial
materials
2018
Operational Testing of Cyber Systems Mr. Paul Johnson

MCOTEA
Tutorial
materials
2018
Demystifying Data Science Dr. Alyson Wilson

Laboratory for Analytic Sciences North Carolina State Univeristy
Tutorial
materials
2018
Statistics Boot Camp Dr. Stephanie Lane
Research Staff Member
IDA
Tutorial
materials
2018
Robust Parameter Design Dr. Geoff Vining

Tutorial
materials
2018
Exploratory Data Analysis Dr. Jim Filliben

Tutorial 2018
Quality Control and Statistical Process Control Dr. Jane Pinelis
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Matthew Avery
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Tyler Morgan-Wall
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Benjamin Ashwell
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Kevin Kirshenbaum
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Stephanie Lane
Research Staff Member
IDA
Tutorial
materials
2018
Evolving Statistical Tools Dr. Jason Sheldon
Research Staff Member
IDA
Tutorial
materials
2018
Name Organization Type Yr

Peter Parker

NASA Workshop Organizer 2016

Laura Freeman

IDA Workshop Organizer 2016

Rebecca Medlin

IDA Logistics 2019

David Greene

IDA Logistics 2019

Heather Wojton

IDA Co-Chair 2019

Ronald Fricker

Department of Statistics,Virginia Tech Co-Chair 2019

Amy Braverman

Jet Propulsion Laboratory,California Institute of Technology Co-Chair 2019

Laura Freeman

Virginia Tech University Co-Chair 2019

Jonathan Rathsam

NASA Co-Chair 2019

Jane Pinelis

John Hopkins University Applied Physics Laboratory Co-Chair 2019

Julia Shirley

IDA Logistics 2018

Heather Wojton

IDA Logistics 2018

Kendall Beebe

IDA Logistics 2018

Jonathan Rathsam

IDA Co-Chair 2018

Jane Pinelis

IDA Co-Chair 2018

Laura Freeman

IDA Co-Chair 2018

Alyson Wilson

North Carolina State University Co-Chair 2018

Alyson Wilson

North Carolina State University Co-Chair 2019

Diane Quarles

Army Research Lab TPC 2019

Laura Castro-Schilo

JMP TPC 2019

Poornima Madhavan

IDA TPC 2019

Adi Zolotov

CNA TPC 2019

Earl Lawrence

LANL TPC 2019

Lance Fiondella

UMASS Dartmouth TPC 2019

Wendy Martinez

BLS TPC 2019

Scott Nestler

Unversity of Notre Dame TPC 2019

Eric Walker

NASA Langley Research Center TPC 2019

Dave Beyrodt

COTF TPC 2019

Melissa Jablonski

US Army RDECOM ARDEC TPC 2019

Dr. David Chu

IDA Advisory 2019

Dr. Pete Parker

NASA Langley Research Center Advisory 2019

Lt Col Brian Stone

AFOTEC TPC 2019

Dave Webb

ATEC TPC 2019

Justin Newcomer

Sandia National Laboratories TPC 2019

Kassie Fronczyk

LLNL TPC 2019

Ray Hill

Research Consortium/AFIT TPC 2019

Sarah Burke

STAT COE/AFIT TPC 2019

Doug Steinley

University of Missouri TPC 2019

Sara Wilson

NASA/Langley Research Center TPC 2019

David Harrison

LMCO/Lockheed Martin Space TPC 2019

Duane Steffy

Expnent TPC 2019

Ashley Llorens

JHU/APL TPC 2019

Reed Young

JHU/APL TPC 2019

Mr. Allen Kilgore

NASA Langley Research Center Advisory 2019

Mr. Dave Duma

DOT&E Advisory 2019
Theme Yr

1: Verification, Validation, and Uncertainty Quantification

These sessions will focus on model verification and validation including case study examples as well as the use of physics and computational based modeling and simulation to benefit system evaluation.
2019

2: Data Integration and Sequential Testing

These sessions will focus on integrating, to the extent possible all available information, including previous test outcomes, to sequentially update and refine future testing.
2019

3: Autonomy, Artificial Intelligence, Machine Learning

These sessions will focus on introducing new tools for evaluating how operators interact with autonomous systems and demonstrate how members of the defense and aerospace communities have applied statistical approaches to evaluate autonomous system performance.
2019

4: Data Curation and Engineering

These sessions will focus on best practices for storing, curating, cleaning and making data ready for analysis.
2019

5: Improving System Cybersecurity

These sessions will focus on methods for evaluating cyber survivability, specifically cyber-attack resiliency for weapon systems.
2019

6: Human-System Integration

These sessions demonstrate the importance of human-centered design in defense and aerospace systems and introduce the range of test design and statistical methods available for evaluating human-system integration.
2019

1: Statistical Engineering for Defense and Aerospace

2018

2: Statistical Engineering for Defense and Aerospace

2018

3: Humans are Part of the System: Implications for Test Planning and Analysis

2018

4: Rigorous Use of Modeling and Simulation

2018

5: Statistical Engineering for Autonomous Systems

2018

6: Data Science

2018

1: Improving Computational Modeling: CFD Vision 2030

This session will focus on the statistics in improving existing and developing new computational modeling capabilities.
2017

2: Experimental Design Methods for System Design and Characterization

This session will focus on the value of a structured experimental design process in both the design and evaluation of systems.
2017

3: Statistical Engineering for Defense and Aerospace

This session will include cases studies that illustrate how straightforward statistical approaches linked together in the right way and targeted towards answering the right question can be useful in addressing the complex data and design challenges in defense and aerospace.
2017

4: Rigorous Use of Modeling and Simulation

This session will focus on the use of physics and computational based modeling and simulation to benefit system evaluation and group/flight/live testing.
2017

5: Improving System Reliability and Reliability Test Planning

This session will focus on advanced techniques in testing long term system reliability.
2017

6: Humans are Part of the System: Implications for test planning and analysis.

This session will focus on the design and test methods for assessing the coupled interaction of the human and the system.
2017