Although appropriate feature extraction can improve the performance of anomaly detection, it is a challenging task due to the complex interaction between features, the mixture of irrelevant features and relevant features, and the unavailability of data tags. When conventional anomaly detection methods deal with the problem of high dimensional data, the performance of anomaly detection will be degraded due to the existence of irrelevant features. This paper proposed a method of feature extraction and anomaly detection for high dimensional data based on elastic network, which can filter irrelevant features and improve the accuracy and efficiency of anomaly detection. In this paper, an outlier scoring method was used to score the outliers of the original data, and then outliers and the original data were input into the elastic network for sparse regression. Those irrelevant features to abnormal data are ignored after extraction. Finally, high-dimensional data are detected efficiently according to extracted features. In the experimental stage, we used the high-dimensional anomaly dataset provided by ODDS to detect the performance of the proposed method based on detection accuracy (AUC), ROC curve, feature number, convergence speed and other indicators. The results show that the proposed method not only can effectively extract the features related to high-dimensional anomaly data, but also the detection accuracy of outliers has been greatly improved.
Authors: yang shen (State Grid Liaoning Electric Power Supply Co, LTD), jue bo (State Grid Liaoning Electric Power Supply Co, LTD), kexin li (College of Computer Science and Technology, Nanjing University of Aeronautics and Astro-nautics), shuo chen (State Grid Liaoning Electric Power Supply Co, LTD), lin qiao (State Grid Liaoning Electric Power Supply Co, LTD), jing li (College of Computer Science and Technology, Nanjing University of Aeronautics and Astro-nautics),
Hide Authors & Abstract