Flight simulator evaluation of pilot performance with the runway awareness and advisory system (RAAS)

This paper provides an overview of a human factors evaluation to objectively assess pilot performance and the operational safety benefits of the runway awareness and advisory system (RAAS). This evaluation was the last one of a series that formed a critical element of the iterative design process adopted to develop the RAAS. The purpose of the RAAS is to enhance flight crew position awareness during aircraft surface operations and on final approach. Factors such as effect of RAAS on pilot spatial (position) awareness, decision-making, workload, overall pilot acceptability and ease of learning the RAAS functionality were evaluated. A non-RAAS group served as the reference group A Boeing 737-400 flight simulator was used in a between-subjects experiment design. Crews were subjected to a range of operational scenarios that included both normal and, non-normal conditions associated with runway incursions. Evaluation data show that RAAS improved pilot position awareness during surface operations and on approach to landing. RAAS resulted in earlier pilot recognition of potential position awareness related conflicts. Furthermore, RAAS improved pilot decision-making and did not increase workload. There were no RAAS-induced crew errors observed in any of the scenarios. Subjects were able to satisfactorily complete all flight deck tasks, execute crew procedures and crew co-ordination associated with all scenarios with the aid of RAAS. Ratings for overall pilot acceptability and learnability of RAAS were very favorable. Overall, these data indicate a favorable impact of RAAS on crew performance and operational safety.