Trajectory Outlier Detection Algorithm Based on Bi-LSTM Model

HAN Zhaorong; HUANG Tinglei; REN Wenjuan; XU Guangluan

doi:10.12000/JR18039

Volume 8 Issue 1

Mar. 2019

Turn off MathJax

Article Contents

Abstract

References

Article Navigation > Journal of Radars > 2019 > 8(1): 36-43

XIA Deping, ZHANG Liang, WU Tao, et al. A multiple interference suppression algorithm based on airborne bistatic polarization radar[J]. Journal of Radars, 2022, 11(3): 399–407. doi: 10.12000/JR21212

Citation:

HAN Zhaorong, HUANG Tinglei, REN Wenjuan, et al. Trajectory outlier detection algorithm based on Bi-LSTM model[J]. Journal of Radars, 2019, 8(1): 36–43. doi: 10.12000/JR18039

Citation:

HAN Zhaorong, HUANG Tinglei, REN Wenjuan, et al. Trajectory outlier detection algorithm based on Bi-LSTM model[J]. Journal of Radars, 2019, 8(1): 36–43. doi: 10.12000/JR18039

PDF( 873 KB)

Trajectory Outlier Detection Algorithm Based on Bi-LSTM Model

DOI: 10.12000/JR18039

HAN Zhaorong^{1,2,3
,},
HUANG Tinglei^{2,3
,
,},
REN Wenjuan^{2,3
,},
XU Guangluan^{2,3
,}

①.
University of Chinese Academy of Sciences, Beijing 100049, China
②.
Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China
③.
Key Laboratory of Technology in Geo-Spatial Information Processing and Application System, Chinese Academy of Sciences, Beijing 100190, China

Funds: The National Natural Science Foundation of China (61725105, 61331017)

More Information

Corresponding author: HUANG Tinglei, tlhuang@mail.ie.ac.cn
Received Date: 2018-05-14
Rev Recd Date: 2018-05-30

Available Online: 2018-07-09

Publish Date: 2019-02-28

Abstract

Abstract

The rapid advances in positioning technology have created huge spatio-temporal trajectory data, and there are always obvious aberrant outliers in trajectory data. Detecting outliers in the trajectory is critical to improving data quality and the accuracy of subsequent trajectory data mining tasks. In this paper, we propose a trajectory outlier detection algorithm based on a Bidirectional Long Short-Term Memory (Bi-LSTM) model. First, a six-dimensional motion feature vector is extracted for each trajectory point, and then we construct a Bi-LSTM model. The model input is the trajectory data feature vector of a certain sequence length, and its output is the class type of the current track point. In addition, a combination method of undersampling and oversampling is applied to mitigate the effect of data distribution imbalance on detection performance. The Bi-LSTM model can automatically learn the difference between the normal points and adjacent abnormal points in the motion characteristics by combining the LSTM unit and the bidirectional network. Experimental results based on a real ship trajectory annotation data show that the detection performance of our proposed algorithm significantly exceeds those of the constant velocity threshold algorithm, non-sequential classical machine learning classification algorithms, and convolutional neural network model. Especially, the recall value of the proposed algorithm reaches 0.902, which verifies its effectiveness.
- Trajectory data,
- Outlier detection,
- Feature extraction,
- Bidirectional Long Short-Term Memory (Bi-LSTM) networks

FullText(HTML)

References(24)

References

[1]	LEE J G, HAN J W, and WHANG K Y. Trajectory clustering: A partition-and-group framework[C]. Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, Beijing, China, 2007: 593–604.
[2]	李万春, 黄成峰. 基于角度和多普勒频率的外辐射源定位系统的接收器最优航迹分析[J]. 雷达学报, 2014, 3(6): 660–665. doi: 10.12000/JR14118 LI Wan-chun and HUANG Cheng-feng. Optimal trajectory analysis for the receiver of passive location systems using direction of arrival and Doppler measurements[J]. Journal of Radars, 2014, 3(6): 660–665. doi: 10.12000/JR14118
[3]	齐林, 王海鹏, 刘瑜. 基于统计双门限的中断航迹配对关联算法[J]. 雷达学报, 2015, 4(3): 301–308. doi: 10.12000/JR14077 QI Lin, WANG Hai-peng, and LIU Yu. Track segment association algorithm based on statistical binary thresholds[J]. Journal of Radars, 2015, 4(3): 301–308. doi: 10.12000/JR14077
[4]	ZHENG Y, LIU L K, WANG L H, et al. Learning transportation mode from raw GPS data for geographic applications on the web[C]. Proceedings of the 17th International Conference on World Wide Web, Beijing, China, 2008: 247–256. doi: 10.1145/1367497.1367532.
[5]	BAO J, ZHENG Y, and MOKBEL M F. Location-based and preference-aware recommendation using sparse geo-social networking data[C]. Proceedings of the 20th International Conference on Advances in Geographic Information Systems, Redondo Beach, California, 2012: 199–208. doi: 10.1145/2424321.2424348.
[6]	ZHANG D Q, LI N, ZHOU Z H, et al. iBAT: Detecting anomalous taxi trajectories from GPS traces[C]. Proceedings of the 13th International Conference on Ubiquitous Computing, Beijing, China, 2011: 99–108. doi: 10.1145/2030112.2030127.
[7]	ZHENG Y and ZHOU X F. Computing with Spatial Trajectories[M]. New York: Springer Science & Business Media, 2011.
[8]	HAWKINS D M. Identification of Outliers[M]. Dordrecht: Springer, 1980.
[9]	HAN J W, KAMBER M, and PEI J. Data Mining: Concepts and Techniques[M]. Amsterdam: Elsevier, 2011.
[10]	ALVARES L O, OLIVEIRA G, and BOGORNY V. A framework for trajectory data preprocessing for data mining[C]. Proceedings of the 21st Interantional Conference on Software Engineering & Knowledge Engineering, SEKE, Boston, USA, 2009, 21: 698–702.
[11]	CHEN L, LV M Q, YE Q, et al. A personal route prediction system based on trajectory data mining[J]. Information Sciences, 2011, 181(7): 1264–1284. doi: 10.1016/j.ins.2010.11.035
[12]	ZHENG Y, XIE X, and MA W Y. Geolife: A collaborative social networking service among user, location and trajectory[J]. IEEE Data Engineering Bulletin, 2010, 33(2): 32–39.
[13]	CHEN X J, CUI T T, FU J H, et al. Trend-residual dual modeling for detection of outliers in low-cost GPS trajectories[J]. Sensors, 2016, 16(12): 2036. doi: 10.3390/s16122036
[14]	胡晶. 基于AIS的船舶轨迹分析与应用系统的设计与实现[D]. [硕士论文], 华中师范大学, 2015. HU Jing. Design and implementation of vessel trajectory analysis and application system based on AIS[D]. [Master dissertation], Central China Normal University, 2015.
[15]	吴建华, 吴琛, 刘文, 等. 舶舶AIS轨迹异常的自动检测与修复算法[J]. 中国航海, 2017, 40(1): 8–12, 101. doi: 10.3969/j.issn.1000-4653.2017.01.003 WU Jian-hua, WU Chen, LIU Wen, et al. Automatic detection and restoration algorithm for trajectory anomalies of ship AIS[J]. Navigation of China, 2017, 40(1): 8–12, 101. doi: 10.3969/j.issn.1000-4653.2017.01.003
[16]	BESSA A, DE MESENTIER SILVA F, NOGUEIRA R F, et al. RioBusData: Outlier detection in bus routes of rio de janeiro[OL]. arXiv: 160106128, 2016.
[17]	FERNANDO T, DENMAN S, SRIDHARAN S, et al. Soft+ hardwired attention: An lstm framework for human trajectory prediction and abnormal event detection[OL]. arXiv: 1702.05552, 2017.
[18]	HOCHREITER S and SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1735–1780. doi: 10.1162/neco.1997.9.8.1735
[19]	GRAVES A and SCHMIDHUBER J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures[J]. Neural Networks, 2005, 18(5/6): 602–610. doi: 10.1016/j.neunet.2005.06.042
[20]	SRIVASTAVA N, HINTON G, KRIZHEVSKY A, et al. Dropout: A simple way to prevent neural networks from overfitting[J]. Journal of Machine Learning Research, 2014, 15: 1929–1958.
[21]	BATISTA G E A P A, PRATI R C, and MONARD M C. A study of the behavior of several methods for balancing machine learning training data[J]. ACM SIGKDD Explorations Newsletter, 2004, 6(1): 20–29. doi: 10.1145/1007730.1007735
[22]	周志华. 机器学习[M]. 北京: 清华大学出版社, 2016. ZHOU Zhi-hua. Machine Learning[M]. Beijing: Tsinghua University Press, 2016.
[23]	FAWCETT T. An introduction to ROC analysis[J]. Pattern Recognition Letters, 2006, 27(8): 861–874. doi: 10.1016/j.patrec.2005.10.010
[24]	PEDREGOSA F, VAROQUAUX G, GRAMFORT A, et al. Scikit-learn: Machine learning in python[J]. Journal of Machine Learning Research, 2011, 12: 2825–2830.

Relative Articles

[1]	LAN Lan, ZHANG Xiang, XU Jingwei, LIAO Guisheng. Main-lobe Deceptive Jammers with Array Radars Using Space-time Multidimensional Coding[J]. Journal of Radars, 2025, 14(2): 439-455. doi: 10.12000/JR24229
[2]	LAN Xiaoyu, HU Jiyan, LIANG Mingshen, MA Shuang. Sparse DOA Estimation Method Based on Riemann Averaging under Strong Intermittent Jamming[J]. Journal of Radars, 2025, 14(2): 280-292. doi: 10.12000/JR24175
[3]	SU Hanning, PAN Jiameng, BAO Qinglong, GUO Fucheng, HU Weidong. Anti-interrupted Sampling Repeater Jamming Method in the Waveform Domain before Matched Filtering[J]. Journal of Radars, 2024, 13(1): 240-252. doi: 10.12000/JR23149
[4]	LI Zhongyu, GUI Liang, HAI Yu, WU Junjie, WANG Dangwei, WANG Anle, YANG Jianyu. Ultrahigh-resolution ISAR Micro-Doppler Suppression Methodology Based on Variational Mode Decomposition and Mode Optimization[J]. Journal of Radars, 2024, 13(4): 852-865. doi: 10.12000/JR24043
[5]	ZHAO Kaifa, SONG Hu, LIU Rong, WANG Xinhai. Distributed Radar Main-lobe Interference Suppression Method Via Joint Optimization of Array Configuration and Subarray Element Number[J]. Journal of Radars, 2024, 13(6): 1355-1369. doi: 10.12000/JR24192
[6]	CHEN Zirui, JI Yifei, LIU Xiwang, ZHANG Yongsheng, DONG Zhen, CHEN Alei, LIU Weijian. Transient Interference Suppression Algorithm Based on Time Frequency Sparse Prior for Skywave OTHR[J]. Journal of Radars, 2024, 13(6): 1157-1169. doi: 10.12000/JR24188
[7]	CHEN Yan, WANG Zhanling, PANG Chen, LI Yongzhen, WANG Zhuang. Radar Active Deception Jamming Recognition Method Based on the Time-varying Polarization-conversion Metasurface[J]. Journal of Radars, 2024, 13(4): 929-940. doi: 10.12000/JR24028
[8]	WANG Rongqing, XIE Jingyang, TIAN Biao, XU Shiyou, CHEN Zengping. Integrated Jamming Perception and Parameter Estimation Method for Anti-interrupted Sampling Repeater Jamming[J]. Journal of Radars, 2024, 13(6): 1337-1354. doi: 10.12000/JR24153
[9]	NIE Lin, WEI Shunjun, LI Jiahui, ZHANG Hao, SHI Jun, WANG Mou, CHEN Siyuan, ZHANG Xinyan. Active Blanket Jamming Suppression Method for Spaceborne SAR Images Based on Regional Feature Refinement Perceptual Learning[J]. Journal of Radars, 2024, 13(5): 985-1003. doi: 10.12000/JR24072
[10]	DU Siyu, LIU Zhixing, WU Yaojun, SHA Minghui, QUAN Yinghui. Dense-repeated Jamming Suppression Algorithm Based on the Support Vector Machine for Frequency Agility Radar[J]. Journal of Radars, 2023, 12(1): 173-185. doi: 10.12000/JR22065
[11]	HAN Zhaoyun, CEN Xi, CUI Jiahe, LI Yachao, ZHANG Peng. Self-supervised Learning Method for SAR Interference Suppression Based on Abnormal Texture Perception[J]. Journal of Radars, 2023, 12(1): 154-172. doi: 10.12000/JR22168
[12]	GAI Jiyu, JIANG Wei, ZHANG Kaixiang, LIANG Zhennan, CHEN Xinliang, LIU Quanhua. A Method for Interrupted-Sampling Repeater Jamming Identification and Suppression Based on Differential Features[J]. Journal of Radars, 2023, 12(1): 186-196. doi: 10.12000/JR22058
[13]	XIA Deping, ZHANG Liang, WU Tao, MENG Xiangdong. A Multiple Interference Suppression Algorithm Based on Airborne Bistatic Polarization Radar[J]. Journal of Radars, 2022, 11(3): 399-407. doi: 10.12000/JR21212
[14]	ZOU Kun, LAI Lei, LUO Yanbo, LI Wei. Suppression of Non-Gaussian Clutter from Subspace Interference[J]. Journal of Radars, 2020, 9(4): 715-722. doi: 10.12000/JR19050
[15]	LIU Pingyu, LYU Xiaode, LIU Zhongsheng, ZHANG Hanliang. Research on Co-channel Interference Suppression Method for Passive Radar Based on the Jiont Processing of Primary and Reference Channels[J]. Journal of Radars, 2020, 9(6): 974-986. doi: 10.12000/JR19047
[16]	HUANG Yan, ZHAO Bo, TAO Mingliang, CHEN Zhanye, HONG Wei. Review of Synthetic Aperture Radar Interference Suppression[J]. Journal of Radars, 2020, 9(1): 86-106. doi: 10.12000/JR19113
[17]	MENG Zhichao, LU Jingyue, ZHANG Lei. Forward-looking Multi-channel SAR Adaptive Identification to Suppress Deception Jamming[J]. Journal of Radars, 2019, 8(1): 82-89. doi: 10.12000/JR18081
[18]	Zhou Chunhui, Li Fei, Li Ning, Zheng Huifang, Wang Xiangyu. Modified Eigensubspace-based Approach for Radio-frequency Interference Suppression of SAR Image[J]. Journal of Radars, 2018, 7(2): 235-243. doi: 10.12000/JR17025
[19]	Li Yongzhen, Hu Wanqiu, Sun Dou, Li Zhongwei. Scheme for Polarization Detection and Suppression of TRAD[J]. Journal of Radars, 2016, 5(6): 666-672. doi: 10.12000/JR16115
[20]	Zhang Chi, Li Yue-li, Zhou Zhi-min. Wall Clutter Mitigation in Through-the-Wall Imaging Radar with Sparse Array Antenna Based on Independent Component Analysis[J]. Journal of Radars, 2014, 3(5): 524-532. doi: 10.3724/SP.J.1300.2014.14066

Supplements(0)

Cited By

Cited by

Periodical cited type(5)

1.	王沙飞，朱梦韬，李云杰，杨健，李岩. 对先进多功能雷达系统行为的识别、推理与预测：综述与展望. 信号处理. 2024(01): 17-55 .
2.	陈士超，魏靖彪，范俊，魏玺章，王泽朝，孙谦，刘明. 基于判别性无穷模糊受限玻尔兹曼机模型的HRRP序列识别. 兵工学报. 2024(S1): 43-50 .
3.	赵娟娟. 基于统计模型的电子信息产业企业成长性分析. 中国电子商情. 2024(04): 64-66 .
4.	苏海龙，水鹏朗. 采用双迭代寻优算法的舰船复HRRP估计. 西安电子科技大学学报. 2023(06): 105-119 .
5.	赵春雷，姚嘉嵘，李京效，戚张行，魏汇赞. 地基雷达空中目标识别方法研究综述. 空天预警研究学报. 2023(05): 313-320+334 .

Other cited types(10)

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Get Citation

PDF

XML

Article views(5800) PDF downloads(526)