A Survey of Anomalous Behavior Detection Techniques in Video Surveillance

Liang Ni

doi:10.62677/IJETAA.2601146

Authors

Liang Ni Liaoning Dalian Tieda Comprehensive Market Management Co., Ltd., China Author

DOI:

https://doi.org/10.62677/IJETAA.2601146

Keywords:

Anomalous behavior detection, Video surveillance, Deep learning, Spatiotemporal features, Multimodal fusion

Abstract

Anomalous behavior detection in video surveillance is a central research problem in the field of intelligent security. With the large-scale deployment of surveillance cameras in public spaces, the need for automatic identification of anomalous events---such as fighting, falling, and unattended objects---from massive video streams has become increasingly urgent. This paper systematically reviews the mainstream technical approaches in this domain, encompassing traditional methods based on optical flow and background modeling, deep learning methods based on convolutional neural networks (CNNs) and long short-term memory networks (LSTMs), unsupervised anomaly detection methods based on autoencoders and generative adversarial networks (GANs), and the recently emerged Transformer and graph neural network (GNN) approaches. The paper further surveys widely adopted benchmark datasets---including UCF-Crime and ShanghaiTech---along with evaluation metrics such as frame-level area under the curve (AUC). The latest advances in multimodal fusion and edge deployment are discussed, and key challenges including high annotation costs, weak cross-scene generalization, and insufficient model interpretability are analyzed. Finally, the paper provides an outlook on frontier directions including vision-language large models and few-shot learning, aiming to serve as a comprehensive technical reference for researchers in this field.

Downloads

Download data is not yet available.

References

G. Sreenu and M. A. S. Durai, "Intelligent video surveillance: A review through deep learning techniques for crowd analysis," J. Big Data, vol. 6, no. 1, p. 48, 2019. DOI: 10.1186/s40537-019-0212-5

B. Ramachandra, M. J. Jones, and R. R. Vatsavai, "A survey of single-scene video anomaly detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 5, pp. 2293–2312, May 2022. DOI: 10.1109/TPAMI.2020.3040591

W. Luo, W. Liu, and S. Gao, "Remembering history with convolutional LSTM for anomaly detection," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Hong Kong, China, 2017. DOI: 10.1109/ICME.2017.8019325

Q. Yang, C. Wang, P. Liu, Z. Jiang, and J. Li, "Video anomaly detection via self-supervised and spatio-temporal proxy tasks learning," Pattern Recognit., vol. 158, p. 111021, 2025. DOI: 10.1016/j.patcog.2024.111021

Y. Cong, J. Yuan, and J. Liu, "Sparse reconstruction cost for abnormal event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Colorado Springs, CO, USA, 2011, pp. 3449–3456. DOI: 10.1109/CVPR.2011.5995434

K.-W. Cheng, Y.-T. Chen, and W.-H. Fang, "Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation," IEEE Trans. Image Process., vol. 24, no. 12, pp. 5288–5301, Dec. 2015. DOI: 10.1109/TIP.2015.2479561

W. Liu, W. Luo, D. Lian, and S. Gao, "Future frame prediction for anomaly detection — A new baseline," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Salt Lake City, UT, USA, 2018, pp. 6536–6545. DOI: 10.1109/CVPR.2018.00684

M. Hasan, J. Choi, J. Neumann, A. K. Roy-Chowdhury, and L. S. Davis, "Learning temporal regularity in video sequences," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Las Vegas, NV, USA, 2016, pp. 733–742. DOI: 10.1109/CVPR.2016.86

W. Sultani, C. Chen, and M. Shah, "Real-world anomaly detection in surveillance videos," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Salt Lake City, UT, USA, 2018, pp. 6479–6488. DOI: 10.1109/CVPR.2018.00678

X. Zeng, Y. Jiang, W. Ding, H. Li, Y. Hao, and Z. Qiu, "A hierarchical spatio-temporal graph convolutional neural network for anomaly detection in videos," IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 1, pp. 200–212, Jan. 2023. DOI: 10.1109/TCSVT.2021.3134410

M. Abdalla, S. Javed, M. Al Radi et al., "Video anomaly detection in 10 years: A survey and outlook," Neural Comput. Appl., vol. 37, pp. 26321–26364, 2025. DOI: 10.1007/s00521-025-11659-8

Y. Tian, G. Pang, Y. Chen, R. Singh, J. W. Verjans, and G. Carneiro, "Weakly-supervised video anomaly detection with robust temporal feature magnitude learning," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Montreal, QC, Canada, 2021, pp. 4955–4966. DOI: 10.1109/ICCV48922.2021.00493

D. Gong et al., "Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Seoul, South Korea, 2019, pp. 1705–1714. DOI: 10.1109/ICCV.2019.00179

H. Park, J. Noh, and B. Ham, "Learning memory-guided normality for anomaly detection," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Seattle, WA, USA, 2020, pp. 14360–14369. DOI: 10.1109/CVPR42600.2020.01438

N.-C. Ristea, N. Madan, R. T. Ionescu, K. Nasrollahi, F. S. Khan, T. B. Moeslund, and M. Shah, "Self-supervised predictive convolutional attentive block for anomaly detection," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), New Orleans, LA, USA, 2022, pp. 13576–13586. DOI: 10.1109/CVPR52688.2022.01321

C. Yan, S. Zhang, Y. Liu, G. Pang, and W. Wang, "Feature prediction diffusion model for video anomaly detection," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Paris, France, 2023, pp. 5504–5514. DOI: 10.1109/ICCV51070.2023.00509

H. Lv, C. Zhou, Z. Cui, C. Xu, Y. Li, and J. Yang, "Localizing anomalies from weakly-labeled videos," IEEE Trans. Image Process., vol. 30, pp. 4505–4515, 2021. DOI: 10.1109/TIP.2021.3072863

Y. Chen, Z. Liu, B. Zhang, W. Fok, X. Qi, and Y.-C. Wu, "MGFN: Magnitude-contrastive glance-and-focus network for weakly-supervised video anomaly detection," in Proc. AAAI Conf. Artif. Intell., Washington, DC, USA, 2023, vol. 37, no. 1, pp. 387–395. DOI: 10.1609/aaai.v37i1.25112

P. Wu, X. Zhou, G. Pang, L. Zhou, Q. Yan, P. Wang, and Y. Zhang, "VadCLIP: Adapting vision-language models for weakly supervised video anomaly detection," in Proc. AAAI Conf. Artif. Intell., Vancouver, BC, Canada, 2024, vol. 38, no. 6, pp. 6074–6082. DOI: 10.1609/aaai.v38i6.28423

F. A. Croitoru, N.-C. Ristea, D. Dăscălescu, R. T. Ionescu, F. S. Khan, and M. Shah, "Lightning fast video anomaly detection via multi-scale adversarial distillation," Comput. Vis. Image Underst., vol. 247, p. 104074, 2024. DOI: 10.1016/j.cviu.2024.104074

W. Luo, W. Liu, and S. Gao, "Normal graph: Spatial temporal graph convolutional networks based prediction network for skeleton based video anomaly detection," Neurocomputing, vol. 444, pp. 332–337, 2021. DOI: 10.1016/j.neucom.2019.12.148

O. Hirschorn and S. Avidan, "Normalizing flows for human pose anomaly detection," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Paris, France, 2023, pp. 13499–13508. DOI: 10.1109/ICCV51070.2023.01246

H. Lv, Z. Yue, Q. Sun, B. Luo, Z. Cui, and H. Zhang, "Unbiased multiple instance learning for weakly supervised video anomaly detection," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Vancouver, BC, Canada, 2023, pp. 8022–8031. DOI: 10.1109/CVPR52729.2023.00775

W. Li, V. Mahadevan, and N. Vasconcelos, "Anomaly detection and localization in crowded scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 1, pp. 18–32, Jan. 2014. DOI: 10.1109/TPAMI.2013.111

Z. Liu, Y. Nie, C. Long, Q. Zhang, and G. Li, "A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction," in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Montreal, QC, Canada, 2021, pp. 13568–13577. DOI: 10.1109/ICCV48922.2021.01333

W. Sultani, C. Chen, and M. Shah, "Real-world anomaly detection in surveillance videos," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Salt Lake City, UT, USA, 2018, pp. 6479–6488. DOI: 10.1109/CVPR.2018.00678

P. Wu, J. Liu, Y. Shi, Y. Sun, F. Shao, Z. Wu, and Z. Yang, "Not only look, but also listen: Learning multimodal violence detection under weak supervision," in Proc. European Conf. Comput. Vis. (ECCV), Glasgow, UK, 2020, pp. 322–339. DOI: 10.1007/978-3-030-58577-8_20

F. Caetano, P. Carvalho, and J. S. Cardoso, "Unveiling the performance of video anomaly detection models — A benchmark-based review," Intell. Syst. Appl., vol. 18, p. 200236, 2023. DOI: 10.1016/j.iswa.2023.200236

Y. Fan, Y. Yu, W. Lu, and Y. Han, "Weakly-supervised video anomaly detection with snippet anomalous attention," IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 7, pp. 5480–5492, Jul. 2024. DOI: 10.1109/TCSVT.2024.3350084

P. Wu, J. Liu, Y. Shi, Y. Sun, F. Shao, Z. Wu, and Z. Yang, "Not only look, but also listen: Learning multimodal violence detection under weak supervision," in Proc. European Conf. Comput. Vis. (ECCV), Glasgow, UK, 2020, pp. 322–339. DOI: 10.1007/978-3-030-58577-8_20

M. Xu, D. Li, R. Wu, H. Ding, K. Huang, and C. Chu, "MTC-Net: Multi-granular temporal cascade learning for weakly supervised video anomaly detection," in Proc. Int. Conf. Image Process. Comput. Vis. Mach. Learn. (ICICML), Shenzhen, China, 2024, pp. 881–886. DOI: 10.1109/ICICML63543.2024.10958105

H. Lv, Z. Yue, Q. Sun, B. Luo, Z. Cui, and H. Zhang, "Unbiased multiple instance learning for weakly supervised video anomaly detection," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), Vancouver, BC, Canada, 2023, pp. 8022–8031. DOI: 10.1109/CVPR52729.2023.00775

J. Dalvi, A. Dabouei, G. Dhanuka, and M. Xu, "Distilling aggregated knowledge for weakly-supervised video anomaly detection," in Proc. IEEE/CVF Winter Conf. Appl. Comput. Vis. (WACV), Tucson, AZ, USA, 2025, pp. 5439–5448. DOI: 10.1109/WACV61041.2025.00531

C. Zhang, G. Li, Y. Qi, H. Ye, L. Qing, M.-H. Yang, and Q. Huang, "Dynamic erasing network with adaptive temporal modeling for weakly supervised video anomaly detection," IEEE Trans. Neural Netw. Learn. Syst., vol. 36, pp. 16706–16720, 2025. DOI: 10.1109/TNNLS.2025.3553556

H. T. Duong, V. T. Le, and V. T. Hoang, "Deep learning-based anomaly detection in video surveillance: A survey," Sensors, vol. 23, no. 11, p. 5024, 2023. DOI: 10.3390/s23115024