Cognitive Agent Evaluation for Synthetic Pilot Training

The utilization of Computer Generated Forces (CGFs) represents a valuable tool in facilitating the training, analysis and development of emerging technologies, particularly within the context of a Beyond Visual Range (BVR) encounters. In this paper, a cognitive model of a tactical pilot, based on the principles of Situational Awareness (SA) and used to represent authentic air forces in tactical training, is subjected to a unique multi-stage validation procedure that allows defining its suitability as a substitute for a human pilot in simulated operational scenarios. The proposed validation focuses on the analysis of information comprehension using Working Memory (WM) models for measured and synthesized flight deck scan patterns, including the non-parametric Kolmogorov-Smirnov test, with the aim of investigating the similarity of the scan duration distribution across a pair of eye fixation samples. The WM analysis also addresses the cell activation process in light of the latest cognitive science metrics. Finally, a tactical simulation framework for an iterative evaluation of authentic agent behavior is presented, confirming the importance of using a cognitive agent model with natural behavioral variability to increase the realism of simulated missions.