@alex_ruff

Modeling temporal coherence for optical flow

, , , and . Computer Vision (ICCV), 2011 IEEE International Conference on, page 1116-1123. (November 2011)
DOI: 10.1109/ICCV.2011.6126359

Abstract

Despite the fact that temporal coherence is undeniably one of the key aspects when processing video data, this concept has hardly been exploited in recent optical flow methods. In this paper, we will present a novel parametrization for multi-frame optical flow computation that naturally enables us to embed the assumption of a temporally coherent spatial flow structure, as well as the assumption that the optical flow is smooth along motion trajectories. While the first assumption is realized by expanding spatial regularization over multiple frames, the second assumption is imposed by two novel first- and second-order trajectorial smoothness terms. With respect to the latter, we investigate an adaptive decision scheme that makes a local (per pixel) or global (per sequence) selection of the most appropriate model possible. Experiments show the clear superiority of our approach when compared to existing strategies for imposing temporal coherence. Moreover, we demonstrate the state-of-the-art performance of our method by achieving Top 3 results at the widely used Middlebury benchmark.

Description

IEEE Xplore Abstract - Modeling temporal coherence for optical flow

Links and resources

Tags

community

  • @dblp
  • @alex_ruff
  • @vonolfen
@alex_ruff's tags highlighted