Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox


Continuous 3D Label Stereo Matching using Local Expansion Moves

Oct 17, 2017
Tatsunori Taniai, Yasuyuki Matsushita, Yoichi Sato, Takeshi Naemura


Share this with someone who'll enjoy it:


We present an accurate stereo matching method using local expansion moves based on graph cuts. This new move-making scheme is used to efficiently infer per-pixel 3D plane labels on a pairwise Markov random field (MRF) that effectively combines recently proposed slanted patch matching and curvature regularization terms. The local expansion moves are presented as many alpha-expansions defined for small grid regions. The local expansion moves extend traditional expansion moves by two ways: localization and spatial propagation. By localization, we use different candidate alpha-labels according to the locations of local alpha-expansions. By spatial propagation, we design our local alpha-expansions to propagate currently assigned labels for nearby regions. With this localization and spatial propagation, our method can efficiently infer MRF models with a continuous label space using randomized search. Our method has several advantages over previous approaches that are based on fusion moves or belief propagation; it produces submodular moves deriving a subproblem optimality; it helps find good, smooth, piecewise linear disparity maps; it is suitable for parallelization; it can use cost-volume filtering techniques for accelerating the matching cost computations. Even using a simple pairwise MRF, our method is shown to have best performance in the Middlebury stereo benchmark V2 and V3.

* IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 11, pp. 2725-2739, 2018 
* 14 pages. An extended version of our preliminary conference paper [39], Taniai et al. "Graph Cut based Continuous Stereo Matching using Locally Shared Labels" in the proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014). Our results were submitted to Middlebury Stereo Benchmark Version 2 on April 22, 2015, and to Version 3 on July 4, 2017 


   Access Paper Source



Share this with someone who'll enjoy it: