Loading [MathJax]/extensions/MathMenu.js
Lord of the Rings: Hanoi Pooling and Self-Knowledge Distillation for Fast and Accurate Vehicle Reidentification | IEEE Journals & Magazine | IEEE Xplore

Lord of the Rings: Hanoi Pooling and Self-Knowledge Distillation for Fast and Accurate Vehicle Reidentification


Abstract:

Vehicle reidentification has seen increasing interest, thanks to its fundamental impact on intelligent surveillance systems and smart transportation. The visual data acqu...Show More

Abstract:

Vehicle reidentification has seen increasing interest, thanks to its fundamental impact on intelligent surveillance systems and smart transportation. The visual data acquired from monitoring camera networks come with severe challenges, including occlusions, color and illumination changes, as well as orientation issues (a vehicle can be seen from the side/front/rear due to different camera viewpoints). To deal with such challenges, the community has spent much effort in learning robust feature representations that hinge on additional visual attributes and part-driven methods, but with the side effects of requiring extensive human annotation labor as well as increasing computational complexity. In this article, we propose an approach that learns a feature representation robust to vehicle orientation issues without the need for extra-labeled data and adding negligible computational overheads. The former objective is achieved through the introduction of a Hanoi pooling layer exploiting ring regions and the image pyramid approach yielding a multiscale representation of vehicle appearance. The latter is tackled by transferring the accuracy of a deep network to its first layers, thus reducing the inference effort by the early stop of a test example. This is obtained by means of a self-knowledge distillation framework encouraging multiexit network decisions to agree with each other. Results demonstrate that the proposed approach significantly improves the accuracy of early (i.e., very fast) exits while maintaining the same accuracy of a deep (slow) baseline. Moreover, our solution obtains the best existing performance on three benchmark datasets. 1

[Online]. Available: https://github.com/iN1k1/.

Published in: IEEE Transactions on Industrial Informatics ( Volume: 18, Issue: 1, January 2022)
Page(s): 87 - 96
Date of Publication: 25 March 2021

ISSN Information:

Funding Agency:

Author image of Niki Martinel
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Niki Martinel (Member, IEEE) received the M.Sc. degree in multimedia communication and Ph.D. degree in industrial engineering from the University of Udine, Udine, Italy, in 2010 and 2014, respectively.
He is currently an Assistant Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His research interests include unsupervised/self-supervised machine learning, hierarchical learni...Show More
Niki Martinel (Member, IEEE) received the M.Sc. degree in multimedia communication and Ph.D. degree in industrial engineering from the University of Udine, Udine, Italy, in 2010 and 2014, respectively.
He is currently an Assistant Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His research interests include unsupervised/self-supervised machine learning, hierarchical learni...View more
Author image of Matteo Dunnhofer
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Matteo Dunnhofer received the B.Sc. and M.Sc. degrees in computer science in 2016 and 2018, respectively, from the University of Udine, Udine, Italy, where he currently working toward the Ph.D. degree in industrial and information engineering.
His research interests include the application of deep learning techniques to computer vision and medical image analysis problems.
Matteo Dunnhofer received the B.Sc. and M.Sc. degrees in computer science in 2016 and 2018, respectively, from the University of Udine, Udine, Italy, where he currently working toward the Ph.D. degree in industrial and information engineering.
His research interests include the application of deep learning techniques to computer vision and medical image analysis problems.View more
Author image of Rita Pucci
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Rita Pucci received the M.Sc. degree in computer science and the Ph.D. degree in machine learning from the University of Pisa, Pisa, Italy, in 2013 and 2017, respectively.
She subsequently joined the University of Edinburgh, Edinburgh, Scotland, and then, she joined the Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy, where she currently collaborates with the AViReS Group. Her re...Show More
Rita Pucci received the M.Sc. degree in computer science and the Ph.D. degree in machine learning from the University of Pisa, Pisa, Italy, in 2013 and 2017, respectively.
She subsequently joined the University of Edinburgh, Edinburgh, Scotland, and then, she joined the Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy, where she currently collaborates with the AViReS Group. Her re...View more
Author image of Gian Luca Foresti
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Gian Luca Foresti (Senior Member, IEEE) received the M.Sc. and Ph.D. degrees in electrical engineering from the University of Genoa, Genova, Italy, in 1990 and 1994, respectively.
He is a Full Professor of computer science with the University of Udine, Udine, Italy, and a Director of the Department of Mathematics, Computer Science, and Physics. His research interests include computer vision and image processing, multisenso...Show More
Gian Luca Foresti (Senior Member, IEEE) received the M.Sc. and Ph.D. degrees in electrical engineering from the University of Genoa, Genova, Italy, in 1990 and 1994, respectively.
He is a Full Professor of computer science with the University of Udine, Udine, Italy, and a Director of the Department of Mathematics, Computer Science, and Physics. His research interests include computer vision and image processing, multisenso...View more
Author image of Christian Micheloni
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Christian Micheloni (Member, IEEE) received the M.Sc. and Ph.D. degrees in computer science from the University of Udine, Udine, Italy, in 2002 and 2006, respectively.
He is currently an Associate Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His current research interests include active vision for the wide area scene analysis, resource-aware camera networks, pattern reco...Show More
Christian Micheloni (Member, IEEE) received the M.Sc. and Ph.D. degrees in computer science from the University of Udine, Udine, Italy, in 2002 and 2006, respectively.
He is currently an Associate Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His current research interests include active vision for the wide area scene analysis, resource-aware camera networks, pattern reco...View more

I. Introduction

The extensive deployment of traffic monitoring cameras has generated a great amount of visual data for various applications such as intelligent surveillance systems [1], smart transportation [2], and urban informatics [3]. A paramount problem in such analytics is the association of targets among disjoint cameras. When targets to reassociate are vehicles, the problem is known as vehicle reidentification (VeRe-ID). As shown in [4], the problem is extremely challenging since vehicles present a high intraclass variability (caused by the diversity of car shapes from different viewpoints) tied with a small interclass variability (models produced by various manufacturers are limited in their shapes and colors).

Author image of Niki Martinel
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Niki Martinel (Member, IEEE) received the M.Sc. degree in multimedia communication and Ph.D. degree in industrial engineering from the University of Udine, Udine, Italy, in 2010 and 2014, respectively.
He is currently an Assistant Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His research interests include unsupervised/self-supervised machine learning, hierarchical learning methods, and video understanding.
Niki Martinel (Member, IEEE) received the M.Sc. degree in multimedia communication and Ph.D. degree in industrial engineering from the University of Udine, Udine, Italy, in 2010 and 2014, respectively.
He is currently an Assistant Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His research interests include unsupervised/self-supervised machine learning, hierarchical learning methods, and video understanding.View more
Author image of Matteo Dunnhofer
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Matteo Dunnhofer received the B.Sc. and M.Sc. degrees in computer science in 2016 and 2018, respectively, from the University of Udine, Udine, Italy, where he currently working toward the Ph.D. degree in industrial and information engineering.
His research interests include the application of deep learning techniques to computer vision and medical image analysis problems.
Matteo Dunnhofer received the B.Sc. and M.Sc. degrees in computer science in 2016 and 2018, respectively, from the University of Udine, Udine, Italy, where he currently working toward the Ph.D. degree in industrial and information engineering.
His research interests include the application of deep learning techniques to computer vision and medical image analysis problems.View more
Author image of Rita Pucci
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Rita Pucci received the M.Sc. degree in computer science and the Ph.D. degree in machine learning from the University of Pisa, Pisa, Italy, in 2013 and 2017, respectively.
She subsequently joined the University of Edinburgh, Edinburgh, Scotland, and then, she joined the Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy, where she currently collaborates with the AViReS Group. Her research interests include neural networks based on capsules applied on computer vision.
Rita Pucci received the M.Sc. degree in computer science and the Ph.D. degree in machine learning from the University of Pisa, Pisa, Italy, in 2013 and 2017, respectively.
She subsequently joined the University of Edinburgh, Edinburgh, Scotland, and then, she joined the Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy, where she currently collaborates with the AViReS Group. Her research interests include neural networks based on capsules applied on computer vision.View more
Author image of Gian Luca Foresti
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Gian Luca Foresti (Senior Member, IEEE) received the M.Sc. and Ph.D. degrees in electrical engineering from the University of Genoa, Genova, Italy, in 1990 and 1994, respectively.
He is a Full Professor of computer science with the University of Udine, Udine, Italy, and a Director of the Department of Mathematics, Computer Science, and Physics. His research interests include computer vision and image processing, multisensor data and information fusion, cybersecurity, pattern recognition, and machine learning.
Gian Luca Foresti (Senior Member, IEEE) received the M.Sc. and Ph.D. degrees in electrical engineering from the University of Genoa, Genova, Italy, in 1990 and 1994, respectively.
He is a Full Professor of computer science with the University of Udine, Udine, Italy, and a Director of the Department of Mathematics, Computer Science, and Physics. His research interests include computer vision and image processing, multisensor data and information fusion, cybersecurity, pattern recognition, and machine learning.View more
Author image of Christian Micheloni
Department of Mathematics, Computer Science, and Physics, University of Udine, Udine, Italy
Christian Micheloni (Member, IEEE) received the M.Sc. and Ph.D. degrees in computer science from the University of Udine, Udine, Italy, in 2002 and 2006, respectively.
He is currently an Associate Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His current research interests include active vision for the wide area scene analysis, resource-aware camera networks, pattern recognition, camera network self-reconfiguration, video object tracking, image super-resolution, person reidentification, and machine learning.
Christian Micheloni (Member, IEEE) received the M.Sc. and Ph.D. degrees in computer science from the University of Udine, Udine, Italy, in 2002 and 2006, respectively.
He is currently an Associate Professor with the Department of Mathematics, Computer Science, and Physics, University of Udine. His current research interests include active vision for the wide area scene analysis, resource-aware camera networks, pattern recognition, camera network self-reconfiguration, video object tracking, image super-resolution, person reidentification, and machine learning.View more
Contact IEEE to Subscribe

References

References is not available for this document.