AAII Day Presentation 7: Jiaxu Miao

Gif - images of a person with a bicycle shown at different angles, relating to the research paper

Image: The global map memory mechanism and The local map memory and forgetting mechanism. Jiaxu Miao, Yunchao Wei, and Yi Yang

Memory Aggregation Networks for Efficient Interactive Video Object Segmentation

TIME: 2:00pm - 2:20pm

SPEAKER: Jiaxu Miao, Australian Artificial Intelligence Institute

ABSTRACT: 
Interactive video object segmentation (iVOS) aims at efficiently harvesting high-quality segmentation masks of the target object in a video with user interactions. Most previous state-of-the-arts tackle the iVOS with two independent networks for conducting user interaction and temporal propagation, respectively, leading to inefficiencies during the inference stage.

In this work, we propose a unified framework, named Memory Aggregation Networks (MANet), to address the challenging iVOS in a more efficient way. Our MA-Net integrates the interaction and the propagation operations into a single network, which significantly promotes the efficiency of iVOS in the scheme of multi-round interactions. More importantly, we propose a simple yet effective memory aggregation mechanism to record the informative knowledge from the previous interaction rounds, improving the robustness in discovering challenging objects of interest greatly.

We conduct extensive experiments on the validation set of DAVIS Challenge 2018 benchmark. In particular, our MA-Net achieves the J@60 score of 76.1% without any bells and whistles, outperforming the state-of-the-arts with more than 2.7%.

Back to AAII Events
Acknowledgement of Country

UTS acknowledges the Gadigal people of the Eora Nation, the Boorooberongal people of the Dharug Nation, the Bidiagal people and the Gamaygal people, upon whose ancestral lands our university stands. We would also like to pay respect to the Elders both past and present, acknowledging them as the traditional custodians of knowledge for these lands.