Few-Shot Image Segmentation Using Generating Mask with Meta-Learning Classifier Weight Transformer Network

Jian Hong Wang, Phuong Thi Le, Fong Ci Jhou, Ming Hsiang Su, Kuo Chen Li, Shih Lun Chen, Tuan Pham, Ji Long He, Chien Yao Wang, Jia Ching Wang, Pao-Chi Chang

研究成果: 雜誌貢獻期刊論文同行評審

1 引文 斯高帕斯(Scopus)

摘要

With the rapid advancement of modern hardware technology, breakthroughs have been made in many areas of artificial intelligence research, leading to the direction of machine replacement or assistance in various fields. However, most artificial intelligence or deep learning techniques require large amounts of training data and are typically applicable to a single task objective. Acquiring such large training datasets can be particularly challenging, especially in domains like medical imaging. In the field of image processing, few-shot image segmentation is an area of active research. Recent studies have employed deep learning and meta-learning approaches to enable models to segment objects in images with only a small amount of training data, allowing them to quickly adapt to new task objectives. This paper proposes a network architecture for meta-learning few-shot image segmentation, utilizing a meta-learning classification weight transfer network to generate masks for few-shot image segmentation. The architecture leverages pre-trained classification weight transfers to generate informative prior masks and employs pre-trained feature extraction architecture for feature extraction of query and support images. Furthermore, it utilizes a Feature Enrichment Module to adaptively propagate information from finer features to coarser features in a top-down manner for query image feature extraction. Finally, a classification module is employed for query image segmentation prediction. Experimental results demonstrate that compared to the baseline using the mean Intersection over Union (mIOU) as the evaluation metric, the accuracy increases by 1.7% in the one-shot experiment and by 2.6% in the five-shot experiment. Thus, compared to the baseline, the proposed architecture with meta-learning classification weight transfer network for mask generation exhibits superior performance in few-shot image segmentation.

原文???core.languages.en_GB???
文章編號2634
期刊Electronics (Switzerland)
13
發行號13
DOIs
出版狀態已出版 - 7月 2024

指紋

深入研究「Few-Shot Image Segmentation Using Generating Mask with Meta-Learning Classifier Weight Transformer Network」主題。共同形成了獨特的指紋。

引用此