Interacting Multiview Tracker

Ju Hong Yoon, Ming Hsuan Yang, Kuk Jin Yoon

Research output: Contribution to journalArticlepeer-review

28 Citations (Scopus)


A robust algorithm is proposed for tracking a target object in dynamic conditions including motion blurs, illumination changes, pose variations, and occlusions. To cope with these challenging factors, multiple trackers based on different feature representations are integrated within a probabilistic framework. Each view of the proposed multiview (multi-channel) feature learning algorithm is concerned with one particular feature representation of a target object from which a tracker is developed with different levels of reliability. With the multiple trackers, the proposed algorithm exploits tracker interaction and selection for robust tracking performance. In the tracker interaction, a transition probability matrix is used to estimate dependencies between trackers. Multiple trackers communicate with each other by sharing information of sample distributions. The tracker selection process determines the most reliable tracker with the highest probability. To account for object appearance changes, the transition probability matrix and tracker probability are updated in a recursive Bayesian framework by reflecting the tracker reliability measured by a robust tracker likelihood function that learns to account for both transient and stable appearance changes. Experimental results on benchmark datasets demonstrate that the proposed interacting multiview algorithm performs robustly and favorably against state-of-the-art methods in terms of several quantitative metrics.

Original languageEnglish
Article number7226831
Pages (from-to)903-917
Number of pages15
JournalIEEE transactions on pattern analysis and machine intelligence
Issue number5
Publication statusPublished - 2016 May 1

Bibliographical note

Funding Information:
This work was supported by the ICT R&D program of MSIP/IITP [B0101-15-0552], an NRF grant funded by the MSIP (No. NRF-2015R1A2A1A01005455), the Giga KOREA Project [GK130100], and the Global Frontier Project (CISS- 2011-0031868). M.-H. Yang was supported in part by US National Science Foundation CAREER Grant 1149783 and IIS Grant 1152576.

Publisher Copyright:
© 2015 IEEE.

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics


Dive into the research topics of 'Interacting Multiview Tracker'. Together they form a unique fingerprint.

Cite this