Friday, July 29, 2016

Augmented Immersive Team Training

Augmented Immersive Team Training is a live simulated training system for observer training that augments or replaces indirect fires and aircraft sorties required to certify or sustain observer skills. Observers of ground and air delivered fires are critical to coordinating fire support on the battlefield. Each Service has unique training simulations to help train observers. AITT takes observer training out of classroom or fixed sites and allows for training on actual ranges and training areas.

How AITT works:

  • Advanced software algorithms and multiple sensors accurately determine the trainee’s viewpoint. Virtual aircraft, targets, and munitions effects are inserted into the real world view using a Head Worn Display.
  • An Enhanced Instructor Station drives training content. Metrics-based performance assessment, scenario generation, and scenario adaptation strategies are rooted in the latest scientific research.

AITT combines information from a number of sensors to precisely track the user’s head at every instant. The sensors include video cameras, inertial measurement units, GPS receivers, magnetometers, and air pressures sensors.  The video based tracking is inspired by techniques animals and humans use to navigate visually.  All sensor inputs are combined to precisely calculate the direction that a person is looking.  Realistic virtual elements are then combined with the real world scenes. For AITT, these elements include fixed and rotary wing aircraft, targets such as insurgents, tanks and buildings, and weapon effects, to include artillery and mortar fire. The resulting images will be displayed both in an COTS Head Worn Display and in simulated tactical equipment such as binoculars and the Vector 21B laser range finder.

An easy-to-use instructor station will allow the instructor to select and control the evolution of scenarios.  An important component of AITT is the Enhanced Instructor Station (EIS), which leverages emerging theoretical research and technical advances to optimize a trainee’s experience and improve performance outcomes.  The EIS supports metrics-based performance assessment, scenario generation, and scenario adaptation.

What it will achieve

AITT will enable observer training in the field even if aircraft, artillery, mortars are not available.  The AITT observer training system will allow more repetitions of observer “calls for fire” at a fraction of the cost of live training.  Successful development will change the way observers are trained, qualified and sustained, saving the military millions of dollars. It will also improve instructor and trainee efficiency and effectiveness.

Research Challenges and Opportunities

  • Can augmented virtual targets, munition effects, and simulated aircraft be convincing enough to support training?
  • Can the AITT system replace some, or all live training resources required to certify and sustain observer training requirements.
  • Can Commercial Off the Shelf Head Worn Displays provide sufficient performance? (Field of view, resolution, weight, brightness, etc.)
  • Can simulation-based training be tailored before and during scenario execution based on trainee performance metrics?




Project Overview

PDF of the AITT Overview

Project Sponsor
Office of Naval Research

ONR Logo 



Project Lead
Patricia Bockelman

Visiting Faculty