Frequency Feature Pyramid Network With Global-Local Consistency Loss for Crowd-and-Vehicle Counting in Congested Scenes

Xiaoyuan YU, Yanyan LIANG, Xuxin LIN, Jun WAN, Tian WANG, Hong-Ning DAI

Research output: Journal PublicationsJournal Article (refereed)peer-review

11 Citations (Scopus)


Context prediction plays a crucial role in implementing autonomous driving applications. As one of important context-prediction tasks, crowd-and-vehicle counting is critical for achieving real-time traffic and crowd analysis, consequently facilitating decision-making processes for autonomous vehicles. However, the completion of crowd-and-vehicle counting also faces challenges, such as large-scale variations, imbalanced data distribution, and insufficient local patterns. To tackle these challenges, we put forth a novel frequency feature pyramid network (FFPNet) in this paper. Our proposed FFPNet extracts the multi-scale information by frequency feature pyramid module, which can tackle the issue of large-scale variations. Meanwhile, the frequency feature pyramid module uses different frequency branches to obtain different scale information. We also adopt the attention mechanism to strength the extraction of different scale information. Moreover, we devise a novel loss function, namely global-local consistency loss, to address the existing problems of imbalanced data distribution and insufficient local patterns. Furthermore, we conduct extensive experiments on six datasets to evaluate our proposed FFPNet. It is worth mentioning that we also construct a novel crowd-and-vehicle dataset (CROVEH), which is the only dataset that contains both crowd-and-vehicle annotations. The experimental results show that FFPNet achieves the best performance on different backbones, e.g., 52.69 mean absolute error (MAE) on P2PNet with FFP module. The codes are available at:
Original languageEnglish
Pages (from-to)9654-9664
Number of pages11
JournalIEEE Transactions on Intelligent Transportation Systems
Issue number7
Early online date10 Jun 2022
Publication statusPublished - Jul 2022

Bibliographical note

Publisher Copyright:
© 2000-2011 IEEE.


  • Context prediction
  • Convolution
  • Correlation
  • Data mining
  • Feature extraction
  • Frequency-domain analysis
  • Kernel
  • Task analysis
  • discrete cosine transformation
  • frequency feature pyramid
  • global-local consistency loss


Dive into the research topics of 'Frequency Feature Pyramid Network With Global-Local Consistency Loss for Crowd-and-Vehicle Counting in Congested Scenes'. Together they form a unique fingerprint.

Cite this