DATAWorks Archive

Session Title Speaker Type Materials Yr
Open Architecture Tradeoffs (OAT): A simple, computational game engine for rapidly exploring hypotheses in Battle Management Command and Control (BMC2) Shelley Cazares

Breakout 2019
Comparison of Methods for Testing Uniformity to Support the Validation of Simulation Models used for Live-Fire Testing Shannon Shelburne

Breakout 2019
Valuing Human Systems Integration: A Test and Data Perspective Jeffrey Thomas

Breakout 2019
Air Force Human Systems Integration Program Anthony Thomas

Breakout 2019
Toward Real-Time Decision Making in Experimental Settings Devin Francom

Breakout 2019
Area Validation for Applications with Mixed Uncertainty Laura White

Breakout 2019
A 2nd-Order Uncertainty Quantification Framework Applied to a Turbulence Model Validation Effort Robert Baurle

Breakout 2019
Sources of Error and Bias in Experiments with Human Subjects Poornima Madhavan

Breakout 2019
Deep Reinforcement Learning Benjamin Bell

Breakout 2019
Decentralized Signal Processing and Distributed Control for Collaborative Autonomous Sensor Networks Ryan Goldhahn

Breakout 2019
An Overview of Uncertainty-Tolerant Decision Support Modeling for Cybersecurity Samrat Chatterjee

Breakout 2019
Software Reliability and Security Assessment: Automation and Frameworks Lance Fiondella

Breakout 2019
AI & ML in Complex Environment Tien Pham

Breakout 2019
Waste Not, Want Not: A Methodological Illustration of Quantitative Text Analysis Laura Castro-Schilo

Breakout 2019
Machine Learning Prediction With Streamed Sensor Data: Fitting Neural Networks using Functional Principal Components Chris Gotwalt

Breakout 2019
Screening Designs for Resource Constrained Deterministic M&S Experiments: A Munitions Case Study Christopher Drake

Breakout 2019
The Isle of Misfit Designs: A Guided Tour of Optimal Designs That Break the Mold Caleb King

Breakout 2019
Adapting Operational Test to Rapid-Acquisition Programs Panel Discussion

Breakout 2019
Sample Size Calculations for Quiet Sonic Boom Community Surveys Jasme Lee

Breakout 2019
Improved Surface Gunnery Analysis with Continuous Data Benjamin Ashwell & V. Bram Lillard

Breakout 2019
Human in the Loop Experiment Series Evaluating Synthetic Vision Displays for Enhanced Airplane State Awareness Kathryn Ballard

Breakout 2019
Statistical Engineering and M&S in the Design and Development of DoD Systems Doug Ray & Melissa Jablonski

Breakout 2019
Uncertainty Quantification: Combining Large Scale Computational Models with Physical Data for Inference Dave Higdon

Breakout 2019
A User-Centered Design Approach to Military Software Development Pam Savage-Knepshield

Breakout 2019
Engineering first, Statistics second: Deploying Statistical Test Optimization (STO) for Cyber Kedar Phadke

Breakout 2019
Validation and Uncertainty Quantification of Complex Models Kassie Fronczyk

Breakout 2019
Communicating Statistical Concepts and Results: Lessons Learned from the US Service Academies Panel Discussion

Breakout 2019
Multivariate Density Estimation and Data-enclosing Sets Using Sliced-Normal Distributions Luis Crespo

Breakout 2019
A Statistical Approach for Uncertainty Quantification with Missing Data Mark Andrews

Breakout 2019
Exploring Problems in Shipboard Air Defense with Modeling Ralph Donnelly & Benjamin Ashwell

Breakout 2019
Sequential Testing for Fast Jet Life Support Systems Darryl Ahner

Breakout 2019
Bayesian Component Reliability Estimation: F-35 Case Study V. Bram Lillard & Rebecca Medlin

Breakout 2019
Applying Functional Data Analysis throughout Aerospace Testing David Harrison

Breakout 2019
Adopting Optimized Software Test Design Methods at Scale Justin Hunter

Breakout 2019
A Quantitative Assessment of the Science Robustness of the Europa Clipper Mission Kelli McCoy

Breakout 2019
Identifying and Contextualizing Maximum Instrument Fault Rates and Minimum Instrument Recovery Times for Europa Clipper Science through Applied Statistics and Strategic Visualizations Thomas Youmans

Breakout 2019
Design and Analysis of Experiments for Europa Clipper’s Science Sensitivity Model Amy Braverman

Breakout 2019
SLS Structural Dynamics Sensor Optimization Study Ken Toro & Jon Stallrich

Breakout 2019
The 80/20 rule, can and should we break it using efficient data management tools? Ghaleb Abdulla

Breakout 2019
Time Machine Learning: Getting Navy Maintenance Duration Right Tim Kao

Breakout 2019
Behavioral Analytics: Paradigms and Performance Tools of Engagement in System Cybersecurity Robert Gough

Breakout 2019
3D Mapping, Plotting, and Printing in R with Rayshader Tyler Morgan-Wall

Breakout 2019
Functional Data Analysis for Design of Experiments Tom Donnelly

Breakout 2019
Test and Evaluation of Emerging Technologies Dr. Greg Zacharias, Chief Scientist Operational Test and Evaluation

Breakout 2019
Challenges in Test and Evaluation of AI: DoD’s Project Maven Jane Pinelis

Breakout 2019
Demystifying the Black Box: A Test Strategy for Autonomy Dan Porter

Breakout 2019
Satellite Affordability in LEO (SAL) Matthew Avery

Breakout 2019
Statistical Process Control and Capability Study on the Water Content Measurements in NASA Glenn’s Icing Research Tunnel Emily Timko

Breakout 2019
Reasoning about Uncertainty with the Stan Modeling Language John Haman

Breakout 2019
Target Location Error Estimation Using Parametric Models James Brownlow

Breakout 2019
Anatomy of a Cyberattack: Standardizing Data Collection for Adversarial and Defensive Analyses Jason Schlup

Breakout 2019
A Survey of Statistical Methods in Aeronautical Ground Testing Drew Landman

Breakout 2019
Your Mean May Not Mean What You Mean It to Mean Ken Johnson

Breakout 2019
A Causal Perspective on Reliability Assessment Lauren Hund

Breakout 2019
Hypergames for Control System Security Arnab Bhattacharya

Breakout 2019
Probabilistic Data Synthesis to Provide a Defensible Risk Assessment for Army Munition Kevin Singer

Breakout 2019
Using Bayesian Neural Networks for Uncertainty Quantification of Hyperspectral Image Target Detection Daniel Ries

Breakout 2019
Constructing Designs for Fault Location Erin Lanus

Breakout 2019
Accelerating Uncertainty Quantification for Complex Computational Models James Warner

Breakout 2019
When Validation Fails: Analysis of Data from an Imperfect Test Chamber Kendal Ferguson

Breakout 2019
Combining information for Realiability Assesment-Tuesday Morning Dr. Alyson WilsonN/A
Not available
North Carolina State University
Breakout
materials
2016
Reliability Growth in T&E – Summary of National Research Council’s Committee on National Statistics Report Finding-Tuesday Morning Dr. Art FriesN/A
Research Staff Member
IDA
Breakout
materials
2016
Design and Analysis of Margin Testing in Support of Product Qualification for High Reliability Systems Dr. Justin NewcomerN/A
Not available
Sandia National Lab
Breakout
materials
2016
Three Case Studies Comparing Traditional versus Modern Test Designs Dr. Ray HillN/A
Not available
Air Force instite of Technology
Breakout
materials
2016
Supersaturated Designs: Construction and Analysis Dr. David EdwardsN/A
Not available
Virginia Commonwealth University
Breakout
materials
2016
Statistically Defensible Experiment Design for Wind Tunnel Characterization of Subscale Parachutes for Mission to Mars Dr. Drew LandmanN/A
Not available
Old Dominion Univerity
Breakout
materials
2016
Managing Uncertainty in the Context of Risk Acceptance Decision Making at NASA: Thinking Beyond the Model Dr. Homayoon DezfuliN/A
Not available
NASA
Breakout
materials
2016
Acceptability of Radiation Detection Systems Dr. Dennis LeberN/A
Not available
NIST
Breakout
materials
2016
Risk Analysis for Orbital Debris Wire Harness Failure Assessment for the Joint Polar Satellite System Dr. Joel WilliamsenN/A
Not available
IDA
Breakout
materials
2016
Application of Statistical Engineering to Mixture Problems With Process Variables Dr. Roger HoerlN/A
Not available
Union College
Breakout
materials
2016
The Sixth Sense: Clarity through Statistical Engineering Dr. Jennifer Van-MullekomN/A
Not available
DuPont
Breakout
materials
2016
Case Studies for Statistical Engineering Applied to Powered Rotorcraft Wind-Tunnel Tests Dr. Sean CommoN/A
Not available
NASA
Breakout
materials
2016
Bayesian Adaptive Design for Conformance Testing with Bernoulli Trials Dr. Adamn PintarN/A
Not available
NIST
Breakout
materials
2016
Statistical Models for Combining Information: Styrker Reliability Case Study Dr. Rebecca DickinsonN/A
Not available
IDA
Breakout
materials
2016
Bayesian Estimation of Reliability Growth Dr. Jim BrownlowN/A
Not available
U.S. Air Force 812TSS/ENT
Breakout
materials
2016
Recent use of Statistical Methods in NASA Aeroscience Testing Research and Development Activities Dr. Eric WalkerN/A
Not available
NASA
Breakout
materials
2016
“High Velocity Analytics for NASA JPL Mars Rover Experimental Design” Dr. Jim WisnowskiN/A
Co-founder/Principle
Adsurgo
Breakout
materials
2016
“High Velocity Analytics for NASA JPL Mars Rover Experimental Design” Dr. Heath RushingN/A
Co-founder/Principle
Adsurgo
Breakout
materials
2016
An Engineer and a Statistician Walk into a Bar: A Statistical Engineering Negotiation Mr. Ken JohnsonN/A
Not available
NASA
Breakout
materials
2016
Making Statistically Defensible Testing ‘The way we do things around here’ Mr. Greg HuttoN/A
Not available
Air Force 96th Test Wing
Breakout
materials
2016
Using Sequential Testing to Address Complex Full-Scale Live Fire Test and Evaluation Dr. Darryl AhnerN/A
Not available
AFIT, STAT COE
Breakout
materials
2016
Aerospace Measurement and Experimental System Development Characterization Mr. Ray RhewN/A
Not available
NASA
Breakout
materials
2016
Leveraging Design for Variation to Improve both Testing and Design – A Case Study on Probabilistic Design of Bearings Dr. Jaime O’connellN/A
Not available
Pratt and Whitney
Breakout
materials
2016
Importance of Modeling and Simulation in Testing and the Need for Rigorous Validation Dr. Kelly McGinnityN/A
Not available
IDA
Breakout
materials
2016
Operational Cybersecurity Testing Mr. Alex HooverN/A
Not available
DHS
Breakout
materials
2016
Not available Dr. Tye BottingN/A
Research Staff Member
IDA
Breakout
materials
2016
Technical Leadership Panel-Tuesday Afternoon Dr. Catherine WarnerN/A
Science Advsior
DOT&E
Breakout-Chair
materials
2016
Technical Leadership Panel-Tuesday Afternoon Paul RobertsN/A
Chief Engineer
Engineering and Safety Center
Breakout-Tech panelist
materials
2016
Technical Leadership Panel-Tuesday Afternoon Frank PeriN/A
Deputy Director
Langley Engineering Directorate
Breakout-Tech panelist
materials
2016
Technical Leadership Panel-Tuesday Afternoon CAPT Peter MatisooN/A
Technical Director
COTF
Breakout-Tech panelist
materials
2016
Technical Leadership Panel-Tuesday Afternoon Jeff OlingerN/A
Technical Director
AFOTEC
Breakout-Tech panelist
materials
2016
Wednesday Keynote Speaker I Dr. Peter Parker
Team Lead, Advanced Measurement Systems
NASA
Keynote
2019
Tuesday Keynote Dr. David Chu
President
Institute for Defense Analyses
Keynote
2019
Thursday Keynote Speaker II Mr. Michael Little
Program Manager, Advanced Information Systems Technology
Earth Science Technology Office, NASA Headquarters
Keynote
2019
Thursday Keynote Speaker I Dr. Wendy Martinez
Director, Mathematical Statistics Research Center, Bureau of Labor Statistics
ASA President-Elect (2020)
Keynote
materials
2019
Wednesday Keynote Speaker II Dr. Laura Freeman
Associate Director, ISL
Hume Center for National Security and Technology, Virginia Tech
Keynote
2019
Thursday Lunchtime Keynote Speaker Dr. T. Charles Clancy
Bradley Professor of Electrical and Computer Engineering
Virginia Tech
Keynote
2019
Wednesday Keynote Speaker III Mr. Timothy Dare
Deputy Director, Developmental Test, Evaluation, and Prototyping
SES OUSD(R&E)
Keynote
2019
Wednesday Lunchtime Keynote Speaker Dr. Jared Freeman
Chief Scientist of Aptima and Chair of the Human Systems Division
National Defense Industry Association
Keynote
2019
Welcoming & Opening Keynote-Tuesday AM Dr. Mike GilmoreN/A
Director
DOT&E
Keynote
materials
2016
Lunch with Keynote Leadership Perspective Dr. Jon HolldayN/A
Not available
NASA
Keynote
materials
2016
STAT Engineering Keynote-Wednesday AM Dr. Christine Anderson CookN/A
Statistics
Los Alamos National Lab
Keynote
materials
2016
Lunch With Leadership Perspective-Wednesday PM Dr. David BrownN/A
Deputy Assistant
Secretary of Defense, Developmental Test & Evaluation
Keynote
materials
2016
The Bootstrap World Dr. Matt AveryN/A
Research Staff Member
IDA
Mini Tutorials
materials
2016
Not available Dr. Lance FiondellaN/A
Not available
Univeristy of Massachusetts, Dartmouth
Mini Tutorials
materials
2016
A Statistical Tool for Efficient and information-Rich Testing Dr. Bram LillardN/A
Research Staff Member
IDA
Mini Tutorials
materials
2016
Power Anyalysis Concepts Dr. Jim SimpsonN/A
Not available
JK Analytics
Mini Tutorials
materials
2016
Introduction to Survey Design Dr. Heather WojtonN/A
Research Staff Member
IDA
Mini Tutorials
materials
2016
Introduction to Survey Design Dr. Justin MaryN/A
Research Staff Member
IDA
Mini Tutorials
materials
2016
Introduction to Survey Design Mr. Jonathan SnavelyN/A
Not available
IDA
Mini Tutorials
materials
2016
Bayesian Data Analysis in R/STAN Dr. Kassandra FronczykN/A
Not available
IDA
Mini Tutorials
materials
2016
Bayesian Data Analysis in R/STAN Dr. James BrownlowN/A
Not available
U.S. Air Force 812TSS/ENT
Mini Tutorials
materials
2016
Presenting Complex Statistical Methodologies to Military Leadership Dr. Jane PinelisN/A
Not available
John Hopkins University, Applied Physics Lab
Mini Tutorials
materials
2016
Sensitivity Experiments Dr. Thomas JohnsonN/A
Research Staff Member
IDA
Mini Tutorials
materials
2016
Sensitivity Experiments Mr. Greg HuttonN/A
Not available
U.S. Air Force , 96 Test Wing
Mini Tutorials
materials
2016
Bayesian Analysis Dr. Robert Gramacy

Virginia Tech
Shortcourse
materials
2019
Categorical Data Analysis Dr. Christopher Franck

Virginia Tech
Shortcourse
materials
2019
Multivariate Data Analysis Dr. Doug Steinley

University of Missouri
Shortcourse
materials
2019
Statistical Methods for Modeling and Simulation Verification and Validation Dr. Jim Simpson, Dr. Jim Wisnowski, and Dr. Stargel Doane

JK Analytics LLC, Adsurgo LLC, Analytical Arts LLC
Shortcourse
materials
2019
Uncertainty Quantification Dr. Ralph Smith

North Carolina State University
Shortcourse
materials
2019
Design of Experiments Dr. Doug Montgomery and Dr. Caleb King

Arizona State University, JMP
Shortcourse 2019
Overview of Design of Experiments Dr. Doug MontgomeryN/A
Professor
Arizon State University
Shortcourse
materials
2016
Experiences in Reliability Analysis Dr. Bill MeekerN/A
Professor
Iowa State University
Shortcourse
materials
2016
Advanced Regression Dr. Geoff ViningN/A
Professor
Virginia Tech University
Shortcourse
materials
2016
Introduction to Bayesian Dr. Robert GramacyN/A
Associate Professor
University of Chicago
Shortcourse
materials
2016
Tutorial: Combinatorial Methods for Testing and Analysis of Critical Software and Security Systems Rick Kuhn, Dimitris Simos, and Raghu Kacker

National Institute of Standards & Technology
Tutorial 2019
Tutorial: Cyber Attack Resilient Weapon Systems Barry Horowitz
Professor, Systems Engineering
University of Virginia
Tutorial 2019
Tutorial: Learning Python and Julia Douglas Hodson
Associate Professor
Air Force Institute of Technology
Tutorial 2019
Tutorial: Statistics Boot Camp Kelly Avery

IDA
Tutorial 2019
Tutorial: Reproducible Research Andrew Flack, Kevin Kirshenbaum, and John Haman

IDA
Tutorial 2019
Tutorial: Developing Valid and Reliable Scales Heather Wojton & Shane Hall

IDA / USARMY ATEC
Tutorial 2019
Name Organization Type Yr

Peter Parker

NASA Workshop Organizer 2016

Laura Freeman

IDA Workshop Organizer 2016

Rebecca Medlin

IDA Logistics 2019

David Greene

IDA Logistics 2019

Heather Wojton

IDA Co-Chair 2019

Ronald Fricker

Department of Statistics,Virginia Tech Co-Chair 2019

Amy Braverman

Jet Propulsion Laboratory,California Institute of Technology Co-Chair 2019

Laura Freeman

Virginia Tech University Co-Chair 2019

Jonathan Rathsam

NASA Co-Chair 2019

Jane Pinelis

John Hopkins University Applied Physics Laboratory Co-Chair 2019

Julia Shirley

IDA Logistics 2018

Heather Wojton

IDA Logistics 2018

Kendall Beebe

IDA Logistics 2018

Jonathan Rathsam

IDA Co-Chair 2018

Jane Pinelis

IDA Co-Chair 2018

Laura Freeman

IDA Co-Chair 2018

Alyson Wilson

North Carolina State University Co-Chair 2018

Alyson Wilson

North Carolina State University Co-Chair 2019

Diane Quarles

Army Research Lab TPC 2019

Laura Castro-Schilo

JMP TPC 2019

Poornima Madhavan

IDA TPC 2019

Adi Zolotov

CNA TPC 2019

Earl Lawrence

LANL TPC 2019

Lance Fiondella

UMASS Dartmouth TPC 2019

Wendy Martinez

BLS TPC 2019

Scott Nestler

Unversity of Notre Dame TPC 2019

Eric Walker

NASA Langley Research Center TPC 2019

Dave Beyrodt

COTF TPC 2019

Melissa Jablonski

US Army RDECOM ARDEC TPC 2019

Dr. David Chu

IDA Advisory 2019

Dr. Pete Parker

NASA Langley Research Center Advisory 2019

Lt Col Brian Stone

AFOTEC TPC 2019

Dave Webb

ATEC TPC 2019

Justin Newcomer

Sandia National Laboratories TPC 2019

Kassie Fronczyk

LLNL TPC 2019

Ray Hill

Research Consortium/AFIT TPC 2019

Sarah Burke

STAT COE/AFIT TPC 2019

Doug Steinley

University of Missouri TPC 2019

Sara Wilson

NASA/Langley Research Center TPC 2019

David Harrison

LMCO/Lockheed Martin Space TPC 2019

Duane Steffy

Expnent TPC 2019

Ashley Llorens

JHU/APL TPC 2019

Reed Young

JHU/APL TPC 2019

Mr. Allen Kilgore

NASA Langley Research Center Advisory 2019

Mr. Dave Duma

DOT&E Advisory 2019
Theme Yr

1: Verification, Validation, and Uncertainty Quantification

These sessions will focus on model verification and validation including case study examples as well as the use of physics and computational based modeling and simulation to benefit system evaluation.
2019

2: Data Integration and Sequential Testing

These sessions will focus on integrating, to the extent possible all available information, including previous test outcomes, to sequentially update and refine future testing.
2019

3: Autonomy, Artificial Intelligence, Machine Learning

These sessions will focus on introducing new tools for evaluating how operators interact with autonomous systems and demonstrate how members of the defense and aerospace communities have applied statistical approaches to evaluate autonomous system performance.
2019

4: Data Curation and Engineering

These sessions will focus on best practices for storing, curating, cleaning and making data ready for analysis.
2019

5: Improving System Cybersecurity

These sessions will focus on methods for evaluating cyber survivability, specifically cyber-attack resiliency for weapon systems.
2019

6: Human-System Integration

These sessions demonstrate the importance of human-centered design in defense and aerospace systems and introduce the range of test design and statistical methods available for evaluating human-system integration.
2019

1: Statistical Engineering for Defense and Aerospace

2018

2: Statistical Engineering for Defense and Aerospace

2018

3: Humans are Part of the System: Implications for Test Planning and Analysis

2018

4: Rigorous Use of Modeling and Simulation

2018

5: Statistical Engineering for Autonomous Systems

2018

6: Data Science

2018

1: Improving Computational Modeling: CFD Vision 2030

This session will focus on the statistics in improving existing and developing new computational modeling capabilities.
2017

2: Experimental Design Methods for System Design and Characterization

This session will focus on the value of a structured experimental design process in both the design and evaluation of systems.
2017

3: Statistical Engineering for Defense and Aerospace

This session will include cases studies that illustrate how straightforward statistical approaches linked together in the right way and targeted towards answering the right question can be useful in addressing the complex data and design challenges in defense and aerospace.
2017

4: Rigorous Use of Modeling and Simulation

This session will focus on the use of physics and computational based modeling and simulation to benefit system evaluation and group/flight/live testing.
2017

5: Improving System Reliability and Reliability Test Planning

This session will focus on advanced techniques in testing long term system reliability.
2017

6: Humans are Part of the System: Implications for test planning and analysis.

This session will focus on the design and test methods for assessing the coupled interaction of the human and the system.
2017