Abstract
Detection Transformer (DETR)-based models leverage key modules such as self-attention, cross-attention, and feedforward networks to extract discriminative features from individual images. Despite their strong performance, these approaches mainly emphasize feature learning driven by single-image statistics, whereas dataset-level semantic regularities shared across training samples have yet to be fully exploited. To address these issues, we present a Global-Context-Aware-based DEtection TRansformer (GCA-DETR). First, to capture global feature distributions, GCA-DETR uses a global-distribution-extraction (GDE) module. This module extracts per-image data distributions and preserves an aggregated global distribution throughout training, thereby providing a dataset-level contextual prior beyond individual images for subsequent feature modelling. During the evaluation stage, the global data distributions remain fixed. Second, a global-distribution-fusion (GDF) module is designed to adjust the distributions of candidate target tokens in the decoder by leveraging the preserved global context, facilitating more effective global reasoning. Comprehensive experiments demonstrate that the proposed GCA-DETR achieves significant improvements in COCO 2017, requiring only minimal additional computational overhead. The code is available at https://github.com/sleevewind/GCA-DETR.
| Original language | English |
|---|---|
| Article number | 123468 |
| Number of pages | 15 |
| Journal | Information Sciences |
| Volume | 747 |
| Early online date | 4 Apr 2026 |
| DOIs | |
| Publication status | Published - 15 Aug 2026 |
Bibliographical note
Publisher Copyright:© 2026
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 62176027; in part by the Chongqing Talent Program under Grant cstc2024ycjh-bgzxm0082; in part by the Chongqing New YC Project under Grant CSTB2024YCJH-KYXM0126; and in part by the Fundamental Research Funds for the Central Universities of the Ministry of Education of China under Grant 2025CDJZKZCQ-11. Sam Tak WU Kwong reports that financial support was provided by Lingnan University.
Keywords
- DETR
- Global distribution extraction
- Global distribution fusion
Fingerprint
Dive into the research topics of 'GCA-DETR: Global-context-aware-based detection transformer'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver