Analysis of Flight Data Using Clustering Techniques for Detecting Abnormal Operations
- 1 September 2015
- journal article
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 12 (9), 587-598
- https://doi.org/10.2514/1.i010329
Abstract
The airline industry is moving toward proactive risk management, which aims to identify and mitigate risks before accidents occur. However, existing methods for such efforts are limited. They rely on predefined criteria to identify risks, leaving emergent issues undetected. This paper presents a new method, cluster-based anomaly detection to detect abnormal flights, which can support domain experts in detecting anomalies and associated risks from routine airline operations. The new method, enabled by data from the flight data recorder, applies clustering techniques to detect abnormal flights of unique data patterns. Compared with existing methods, the new method no longer requires predefined criteria or domain knowledge. Tests were conducted using two sets of operational data consisting of 365 B777 flights and 25,519 A320 flights. The performance of cluster-based anomaly detection to detect abnormal flights was compared with those of multiple kernel anomaly detection, which is another data-driven anomaly detection algorithm in recent years, as well as with exceedance detection, which is the current method employed by the airline industry. Results showed that both cluster-based anomaly detection to detect abnormal flights and multiple kernel anomaly detection were able to identify operationally significant anomalies, surpassing the capability of exceedance detection. Cluster-based anomaly detection to detect abnormal flights performed better with continuous parameters, whereas multiple kernel anomaly detection was more sensitive toward discrete parameters.Keywords
This publication has 27 references indexed in Scilit:
- Discovering Anomalous Aviation Safety Events Using Scalable Data Mining AlgorithmsJournal of Aerospace Information Systems, 2013
- Anomaly detectionACM Computing Surveys, 2009
- Unsupervised Anomaly Detection for Liquid-Fueled Rocket Propulsion Health MonitoringJournal of Aerospace Information Systems, 2009
- Anomaly Detection and Diagnosis Algorithms for Discrete Symbol Sequences with Applications to Airline SafetyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2008
- Error Prevention as Developed in AirlinesInternational Journal of Radiation Oncology*Biology*Physics, 2008
- A Survey of Outlier Detection MethodologiesArtificial Intelligence Review, 2004
- DAMAGE DETECTION USING OUTLIER ANALYSISJournal of Sound and Vibration, 2000
- Intrusion detection using sequences of system callsJournal of Computer Security, 1998
- Network intrusion detectionIEEE Network, 1994
- Novelty detection and neural network validationIEE Proceedings - Vision, Image, and Signal Processing, 1994