PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
October 10, 20250 citationsOpen Access

Referring Expression Comprehension for Small Objects

View Full Paper
KGKanoko GotoTHTakumi HiroseMUMahiro Ukai

Key Points

  • Significant improvement in referring expression comprehension for small objects using a novel dataset and method.
  • The SOREC dataset includes 100,000 pairs of expressions and bounding boxes aimed at driving contexts.
  • PIZA, a new adapter module, enables progressive zooming, enhancing accuracy for small object localization tasks.
  • Experiments show that PIZA significantly enhances performance in REC tasks on the SOREC dataset.

Abstract

Referring expression comprehension (REC) aims to localize the target object described by a natural language expression. Recent advances in vision-language learning have led to significant performance improvements in REC tasks. However, localizing extremely small objects remains a considerable challenge despite its importance in real-world applications such as autonomous driving. To address this issue, we introduce a novel dataset and method for REC targeting small objects. First, we present the small object REC (SOREC) dataset, which consists of 100,000 pairs of referring expressions and corresponding bounding boxes for small objects in driving scenarios. Second, we propose the progressive-iterative zooming adapter (PIZA), an adapter module for parameter-efficient fine-tuning that enables models to progressively zoom in and localize small objects. In a series of experiments, we apply PIZA to GroundingDINO and demonstrate a significant improvement in accuracy on the SOREC dataset. Our dataset, codes and pre-trained models are publicly available on the project page.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Goto et al. (2025) studied this question.

synapsesocial.com/papers/68e865117ef2f04ca37e4dc5https://doi.org/10.48550/arxiv.2510.03701
Ask AI
Helpful
Bookmark
Share
View Full Paper