Multi-camera Tracklet association and fusion using ensemble of visual and geometric cues

Overview & Synopsis

Data association and fusion is pivot for object tracking in multi-camera network. We present a novel framework for solving online multi-object tracking in partially overlapping multi-camera network by modelling tracklet association as combinatorial optimization problem hypothesized on ensemble of cues such as appearance, motion and geometry information. Our method learns discriminant weight as a measure of consistency and discriminancy of feature patterns to make ensemble feature selection and combination between local and global tracking information. Our approach contributes uniquely in the way tracklet selection, association and fusion is done. Once multi-view correspondences are established using planar homography, Dynamic Time Warping algorithm is used to make tracklet selection for which similarity has to be calculated i.e overlapping tracklets and subtracklets. Then trajectory similarities are computed for these selective tracklets and subtracklets using ensemble of appearance and motion cues weighted by online learnt discriminative function. Later on, we tackle the association problem by building a k-partite graph and association rules to match all the pair-wise trackets. Finally, from outcome of hungarian algorithm, the associated trajectories are later fused. Fusion is done based on calculated individual tracklet reliability criteria. Experimental results demonstrate our system achieve performance that significantly improve the state of the art on PETS 2009.