Tracking via object reflectance using a hyperspectral video camera

TitleTracking via object reflectance using a hyperspectral video camera
Publication TypeConference Papers
Year of Publication2010
AuthorsNguyen H V, Banerjee A, Chellappa R
Conference Name2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Date Published2010/06/13/18
ISBN Number978-1-4244-7029-7
KeywordsComputer vision, electronic design, hyperspectral datacubes, hyperspectral image analysis, Hyperspectral imaging, Hyperspectral sensors, hyperspectral video camera, Image motion analysis, Image sensors, lighting, Motion estimation, motion prediction, Object detection, object reflectance tracking, random projection, Reflectivity, robust methods, Robustness, sensor design, spectral detection, Surveillance, tracking, Video surveillance

Recent advances in electronics and sensor design have enabled the development of a hyperspectral video camera that can capture hyperspectral datacubes at near video rates. The sensor offers the potential for novel and robust methods for surveillance by combining methods from computer vision and hyperspectral image analysis. Here, we focus on the problem of tracking objects through challenging conditions, such as rapid illumination and pose changes, occlusions, and in the presence of confusers. A new framework that incorporates radiative transfer theory to estimate object reflectance and the mean shift algorithm to simultaneously track the object based on its reflectance spectra is proposed. The combination of spectral detection and motion prediction enables the tracker to be robust against abrupt motions, and facilitate fast convergence of the mean shift tracker. In addition, the system achieves good computational efficiency by using random projection to reduce spectral dimension. The tracker has been evaluated on real hyperspectral video data.