Skip to main navigation Skip to search Skip to main content

CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentation

  • Prantik Howlader
  • , Hoang Nguyen-Canh
  • , Srijan Das
  • , Jingyi Xu
  • , Hieu Le
  • , Dimitris Samaras
  • Stony Brook University
  • University of North Carolina at Charlotte

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Reasoning segmentation seeks pixel-accurate masks for targets referenced by complex, often implicit instructions, requiring context-dependent reasoning over the scene. Recent multimodal language models have advanced instruction following segmentation, yet generalization remains limited. The key bottleneck is the high cost of curating diverse, high-quality pixel annotations paired with rich linguistic supervision leading to brittle performance under distribution shift. Therefore, we present CORA, a semi-supervised reasoning segmentation framework that jointly learns from limited labeled data and a large corpus of unlabeled images. CORA introduces three main components: 1) conditional visual instructions that encode spatial and contextual relationships between objects; 2) a noisy pseudo-label filter based on the consistency of Multimodal LLM's outputs across semantically equivalent queries; and 3) a token-level contrastive alignment between labeled and pseudo-labeled samples to enhance feature consistency. These components enable CORA to perform robust reasoning segmentation with minimal supervision, outperforming existing baselines under constrained annotation settings. CORA achieves state-of-the-art results, requiring as few as 100 labeled images on Cityscapes, a benchmark dataset for urban scene understanding, surpassing the baseline by +2.3%. Similarly, CORA improves performance by +2.4% with only 180 labeled images on PanNuke, a histopathology dataset.

Original languageEnglish
Title of host publicationProceedings - 2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5934-5944
Number of pages11
ISBN (Electronic)9798331555115
DOIs
StatePublished - 2026
Event2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026 - Tucson, United States
Duration: Mar 6 2026Mar 10 2026

Publication series

NameProceedings - 2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026

Conference

Conference2026 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2026
Country/TerritoryUnited States
CityTucson
Period03/6/2603/10/26

Keywords

  • multimodal
  • segmentation
  • semi-supervised

Fingerprint

Dive into the research topics of 'CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentation'. Together they form a unique fingerprint.

Cite this