Person Re-Identification for Intelligent Visual Surveillance
Large networks of cameras are increasingly deployed in public places like airports, railway stations, college campuses and office buildings. These cameras typically span large geospatial areas and have non-overlapping fields-of-views (FOVs) to provide enhanced coverage. Such networks provide huge amounts of video data, which is either manually monitored by law enforcement officers or utilized after the fact for forensic purposes. Human monitoring of these videos is erroneous, time consuming and expensive, thereby severely reducing the effectiveness of surveillance. Automated analysis of large amounts of video data can not only process the data faster but significantly improve the quality of surveillance. Video analysis can enable long term activity and behavior characterization of people in a scene. Such analysis is required for high-level surveillance tasks like suspicious activity detection or undesirable event prediction for timely alerts to security personnel making surveillance more pro-active.
Understanding of a surveillance scene through computer vision requires the ability to track people across multiple cameras, perform crowd movement analysis and activity detection. Tracking people across multiple cameras is essential for wide area scene analytics and person re-identification is a fundamental aspect of multi-camera tracking. Re-identification (Re-ID) is defined as a process of establishing correspondence between images of a person taken from different cameras. It is used to determine whether instances captured by different cameras belong to the same person, in other words, assign a stable ID to different instances of the person.
Methdology
Collaborators
Students
Selected Publications
- N. Pervaiz, M. M. Fraz, M. Shahzad , “Person Re-Identification Using Hybrid Representation Reinforced by Metric Learning”, IEEE Access, Vol. 7 , No. 1, Dec, 2018. IF: 4.098
- N. Pervaiz, M. M. Fraz, M. Shahzad , “Hierarchical Refined Local Associations for Robust Person Re-Identification”, Proceedings of the International Conference on Robotics and Automation in Industry (ICRAI), Oct, 2019, Islamabad , Pakistan.
- S. Batool, M. Z. Ali ; M. Shahzad and M. M. Fraz , “End to End Person Re-Identification for Automated Visual Surveillance”, Proceedings of the International Conference on Image Processing, Applications and Systems (IPAS), Dec, 2018, Sophia Antipolis , France.
- W. Anser, M M Fraz, M Shahzad , , “Two Stream Deep CNN-RNN Attentive Pooling Architecture for Video-based Person Re-identification”, Proceedings of the 23rd Iberoamerican Congress on Pattern Recognition, Nov, 2018, Madrid , Spain.
- Naima Mubariz, Saba Mumtaz, M. M. Hamayun and M. M. Fraz , , “Optimization of Person Re-Identification through Visual Descriptors”, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Jan, 2018, Funchal, Madeira , Portugal.
- S. Mumtaz, N. Mubariz , S. Saleem, M. M. Fraz , , “Weighted hybrid features for person re-identification”, Proceedings of the 7th International Conference on Image Processing Theory, Tools and Applications (IPTA), 2017 , Dec, 2017, Montreal, QC , Canada.
- Perwaiz, M. M. Fraz, M. Shahzad. “Smart surveillance with simultaneous person detection and re-identification”, In Multimedia tools and applications 83 (5), 15461-15482 6 (2024) https://doi.org/10.1007/s11042-022-13458-y
- Zahra, N. Perwaiz, M. Shahzad, M. M. Fraz. “Person re-identification: A retrospective on domain specific open challenges and future trends”, In Pattern Recognition 142, 109669 (2023) https://doi.org/10.1016/j.patcog.2023.109669
- Pervaiz, M. M. Fraz, M. Shahzad. “Per-former: rethinking person re-identification using transformer augmented with self-attention and contextual mapping” In The Visual Computer 39 (9), 4087-4102 (2023) https://doi.org/10.1007/s00371-022-02577-0
- Perwaiz, M. Shahzad, M. M. Fraz. “TransPose Re-ID: transformers for pose invariant person Re-identification”, In Journal of Experimental & Theoretical Artificial Intelligence, 1-14 (2023) https://doi.org/10.1080/0952813X.2023.2214570
- Perwaiz, M. Shahzad, M. M. Fraz. “Ubiquitous vision of transformers for person re-identification”, In Machine Vision and Applications 34 (2), 27 (2023) https://doi.org/10.1007/s00138-023-01376-4
- Perwaiz, M. Shahzad, M. M. Fraz. “Unveiling the potential of vision transformer architecture for person re-identification”, In 24th International Multitopic Conference (INMIC), 1-6 (2022) https://doi.org/10.1109/INMIC56986.2022.9972908
- Faizan, M. M. Fraz, M. Shahzad. “IAB-Net: Informative and attention based person re-identification”, In International Conference on Digital Futures and Transformative Technologies (2021) https://doi.org/10.1109/ICoDT252288.2021.9441480
- Perwaiz, M. M. Fraz, M. Shahzad. “Stochastic attentions and context learning for person re-identification”, In PeerJ Computer Science 7, e447 (2021) https://doi.org/10.7717/peerj-cs.447
- Perwaiz, M. M. Fraz, M. Shahzad. “Smart visual surveillance: Proactive person re-identification instead of impulsive person search”, In IEEE 23rd international multitopic conference (INMIC), 1-6 (2020) https://doi.org/10.1109/INMIC50486.2020.9318107
- Perwaiz, M. M. Fraz, M. Shahzad. “Hierarchical refined local associations for robust person re-identification”, In International conference on robotics and automation in industry (ICRAI) (2019) https://doi.org/10.1109/ICRAI47710.2019.8967389
- Ansar, M. M. Fraz, M. Shahzad, I. Gohar, S. Javed, S. K. Jung. “Two stream deep CNN-RNN attentive pooling architecture for video-based person re-identification”, In Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications: 23rd Iberoamerican Congress (2019) https://doi.org/10.1007/978-3-030-13469-3_76
- Batool, M. Z. Ali, M. Shahzad, M. M. Fraz. “End to end person re-identification for automated visual surveillance”, In IEEE International Conference on Image Processing, Applications and Systems (IPAS) (2018) https://doi.org/10.1109/IPAS.2018.8708882
- Perwaiz, M. M. Fraz, M. Shahzad. “Person re-identification using hybrid representation reinforced by metric learning”, In IEEE Access 6, 77334-77349 (2018) https://doi.org/10.1109/ACCESS.2018.2882254
- Mubariz, S. Mumtaz, M. M. Hamayun, M. M. Fraz. “Optimization of Person Re-Identification through Visual Descriptors.”, In VISIGRAPP (4: VISAPP), 348-355 (2018) https://doi.org/10.5220/0006613303480355
- Mumtaz, N. Mubariz, S. Saleem, M. M. Fraz. “Weighted hybrid features for person re-identification”, In Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA) (2017) https://doi.org/10.1109/IPTA.2017.8310107