Novel Instance Mining with Pseudo-Margin Evaluation for Few-Shot Object Detection

示意图

摘要

Few-shot object detection (FSOD) enables the detector to recognize novel objects only using limited training samples, which could greatly alleviate model’s dependency on data. Most existing methods include two training stages, namely base training and fine-tuning. However, the unlabeled novel instances in the base set were untouched in previous works, which can be re-used to enhance the FSOD performance. Thus, a new instance mining model is proposed in this paper to excavate the novel samples from the base set. The detector is thus fine-tuned again by these additional free novel instances. Meanwhile, a novel pseudo-margin evaluation algorithm is designed to address the quality problem of pseudo-labels brought by those new novel instances. The experimental results on MS COCO dataset show the effectiveness of the proposed model, which does not require any additional training samples or parameters. Our code is available at: https://github.com/liuweijie19980216/NimPme.

出版物
In 2022 IEEE International Conference on Acoustics, Speech and Signal Processing
刘伟杰
刘伟杰
硕士生

研究方向为少样本目标检测,提出动态关联学习与伪标签距离评估方法,并具有人脸检测、文本识别等工程实践经验。

王 翀
王 翀
副教授

研究兴趣:人机交互、人工智能、计算机视觉、多媒体计算.

郁盛浩
郁盛浩
硕士生

研究兴趣:计算机视觉,行为识别,异常行为检测.

陶晨晨
陶晨晨
硕士生

研究方向为视频异常检测与行为识别,关注特征重构、事件提示学习和大规模监控视频建模在异常检测中的应用。