Alert button

Learning Local Implicit Fourier Representation for Image Warping

Jul 05, 2022
Jaewon Lee, Kwang Pyo Choi, Kyong Hwan Jin

Figure 1 for Learning Local Implicit Fourier Representation for Image Warping
Figure 2 for Learning Local Implicit Fourier Representation for Image Warping
Figure 3 for Learning Local Implicit Fourier Representation for Image Warping
Figure 4 for Learning Local Implicit Fourier Representation for Image Warping

Share this with someone who'll enjoy it:

Image warping aims to reshape images defined on rectangular grids into arbitrary shapes. Recently, implicit neural functions have shown remarkable performances in representing images in a continuous manner. However, a standalone multi-layer perceptron suffers from learning high-frequency Fourier coefficients. In this paper, we propose a local texture estimator for image warping (LTEW) followed by an implicit neural representation to deform images into continuous shapes. Local textures estimated from a deep super-resolution (SR) backbone are multiplied by locally-varying Jacobian matrices of a coordinate transformation to predict Fourier responses of a warped image. Our LTEW-based neural function outperforms existing warping methods for asymmetric-scale SR and homography transform. Furthermore, our algorithm well generalizes arbitrary coordinate transformations, such as homography transform with a large magnification factor and equirectangular projection (ERP) perspective transform, which are not provided in training.

* ECCV 2022 camera-ready version (https://ipl.dgist.ac.kr/LTEW.pdf)  
View paper onarxiv icon

Share this with someone who'll enjoy it: