Searching for people using semantic soft biometric descriptions

Denman, Simon, Halstead, Michael, Fookes, Clinton B., & Sridharan, Sridha (2015) Searching for people using semantic soft biometric descriptions. Pattern Recognition Letters, 68(Part 2), pp. 306-315.

[img] Accepted Version (PDF 7MB)
Administrators only until December 2017 | Request a copy from author

View at publisher


It is not uncommon to hear a person of interest described by their height, build, and clothing (i.e. type and colour). These semantic descriptions are commonly used by people to describe others, as they are quick to communicate and easy to understand. However such queries are not easily utilised within intelligent video surveillance systems, as they are difficult to transform into a representation that can be utilised by computer vision algorithms. In this paper we propose a novel approach that transforms such a semantic query into an avatar in the form of a channel representation that is searchable within a video stream. We show how spatial, colour and prior information (person shape) can be incorporated into the channel representation to locate a target using a particle-filter like approach. We demonstrate state-of-the-art performance for locating a subject in video based on a description, achieving a relative performance improvement of 46.7% over the baseline. We also apply this approach to person re-detection, and show that the approach can be used to re-detect a person in a video steam without the use of person detection.

Impact and interest:

3 citations in Scopus
Search Google Scholar™
1 citations in Web of Science®

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 85119
Item Type: Journal Article
Refereed: Yes
Additional Information: Special Issue on “Soft Biometrics”
Keywords: Semantic Search, Object Tracking, Localisation, Channel Representation, Person Re-detection
DOI: 10.1016/j.patrec.2015.06.015
ISSN: 0167-8655
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Computer Vision (080104)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Pattern Recognition and Data Mining (080109)
Divisions: Current > Schools > School of Electrical Engineering & Computer Science
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: Copyright 2015 Elsevier
Copyright Statement: Licensed under the Creative Commons Attribution; Non-Commercial; No-Derivatives 4.0 International. DOI: 10.1016/j.patrec.2015.06.015
Deposited On: 06 Jul 2015 02:31
Last Modified: 28 Apr 2016 23:14

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page