Journal article 45 views 15 downloads
A Contrastive Model with Local Factor Clustering for Semi-Supervised Few-Shot Learning
,
Yukun Liu ,
Daming Shi,
Cheng Cheng
Mathematics, Volume: 11, Issue: 15, Start page: 3394
Swansea University Author:
Cheng Cheng
-
PDF | Version of Record
© 2023 by the authors. This is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Download (1.44MB)
DOI (Published version): 10.3390/math11153394
Abstract
Learning novel classes with a few samples per class is a very challenging task in deep learning. To mitigate this issue, previous studies have utilized an additional dataset with extensively labeled samples to realize transfer learning. Alternatively, many studies have used unlabeled samples that or...
| Published in: | Mathematics |
|---|---|
| ISSN: | 2227-7390 |
| Published: |
MDPI AG
2023
|
| Online Access: |
Check full text
|
| URI: | https://cronfa.swan.ac.uk/Record/cronfa65944 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract: |
Learning novel classes with a few samples per class is a very challenging task in deep learning. To mitigate this issue, previous studies have utilized an additional dataset with extensively labeled samples to realize transfer learning. Alternatively, many studies have used unlabeled samples that originated from the novel dataset to achieve few-shot learning, i.e., semi-supervised few-shot learning. In this paper, an easy but efficient semi-supervised few-shot learning model is proposed to address the embeddings mismatch problem that results from inconsistent data distributions between the novel and base datasets, where samples with the same label approach each other while samples with different labels separate from each other in the feature space. This model emphasizes pseudo-labeling guided contrastive learning. We also develop a novel local factor clustering module to improve the ability to obtain pseudo-labels from unlabeled samples, and this module fuses the local feature information of labeled and unlabeled samples. We report our experimental results on the mini-ImageNet and tiered-ImageNet datasets for both five-way one-shot and five-way five-shot settings and achieve better performance than previous models. In particular, the classification accuracy of our model is improved by approximately 11.53% and 14.87% compared to the most advanced semi-supervised few-shot learning model we know in the five-way one-shot scenario. Moreover, ablation experiments in this paper show that our proposed clustering strategy demonstrates accuracy improvements of about 4.00% in the five-way one-shot and five-way five-shot scenarios compared to two popular clustering methods. |
|---|---|
| Keywords: |
few-shot learning; clustering; semi-supervised learning; local features; contrastive learning |
| College: |
Faculty of Science and Engineering |
| Funders: |
This work is supported by Ministry of Science and Technology China (MOST) Major Program on New Generation of Artificial Intelligence 2030 No. 2018AAA0102200. It is also supported by Natural Science Foundation China (NSFC) Major Projects No. U22A2097 and No. 61827814, as well as Shenzhen Science and Technology Innovation Commission (SZSTI) project No. JCYJ20190808153619413. |
| Issue: |
15 |
| Start Page: |
3394 |