Home
Scholarly Works
Enabling Trimap-Free Image Matting With a...
Journal article

Enabling Trimap-Free Image Matting With a Frequency-Guided Saliency-Aware Network via Joint Learning

Abstract

This paper presents a strategic approach to tackling trimap-free natural image matting. Specifically, to address the false detection issue of existing trimap-free matting algorithms when the foreground object is not uniquely defined, we design a novel tangled structure (TangleNet) to handle foreground detection and matting prediction simultaneously. TangleNet enables information exchange between foreground segmentation and alpha prediction, producing high-quality alpha mattes for the most salient foreground object based on RGB inputs alone. TangleNet boosts network performance with a frequency-guided attention mechanism utilizing wavelet data. Additionally, we pretrain for salient object detection to aid in the foreground segmentation. Experimental results demonstrate that TangleNet is on par with the state-of-the-art matting methods requiring additional inputs, and outperforms all previous trimap-free algorithms in terms of both qualitative and quantitative results.

Authors

Dai L; Song X; Liu X; Li C; Shi Z; Chen J; Brooks M

Journal

IEEE Transactions on Multimedia, Vol. 25, , pp. 4868–4879

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Publication Date

January 1, 2023

DOI

10.1109/tmm.2022.3183403

ISSN

1520-9210

Contact the Experts team