Mask Generation with Meta-Learning Classifier Weight Transformer Network for Few-Shot Image Segmentation

Fong Ci Jhou, Kai Wen Liang, Chung Hsun Lo, Chien Yao Wang, Yung Fang Chen, Jia Ching Wang, Pao Chi Chang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

This paper proposes a meta-learning classification weight transfer network to generate masks as a few-shot image segmentation architecture. It generates good prior masks via a pretrained classification weight transfer architecture, and uses a pretrained feature extraction architecture on query images and support images. The network architecture exploits a top-down path in a feature augmentation module to adaptively transfer information from fine to coarse features for extracting features from query images. Finally, the classification module predicts the segmentation of the query image. The experimental results show that using the mean intersection of joints (mIOU) as the evaluation mechanism, the accuracy of the 1-shot experimental results is 1.7% higher than that of the baseline. In the 5-shot experimental results, the accuracy is also improved by 2.6%. Therefore, compared with the baseline, it clearly shows that the mask generated by the meta-learning classification weight transfer network can effectively help improve the performance of few-shot image segmentation system.

Original languageEnglish
Title of host publication2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages457-458
Number of pages2
ISBN (Electronic)9798350324174
DOIs
StatePublished - 2023
Event2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Pingtung, Taiwan
Duration: 17 Jul 202319 Jul 2023

Publication series

Name2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Proceedings

Conference

Conference2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023
Country/TerritoryTaiwan
CityPingtung
Period17/07/2319/07/23

Keywords

  • few-shot image segmentation
  • few-shot learning
  • meta-learning
  • semantic segmentation

Fingerprint

Dive into the research topics of 'Mask Generation with Meta-Learning Classifier Weight Transformer Network for Few-Shot Image Segmentation'. Together they form a unique fingerprint.

Cite this