Distribution-aware Activity Boundary Representation for Online Detection of Action Start in Untrimmed Videos

摘要

The Online Detection of Action Start (ODAS) has attracted the attention of researchers because of its practical applications in areas such as security and emergency response. However, online detection of activity boundaries remains a challenging task due to the inherent ambiguity of boundary definition and the significant imbalance in the number of boundaries and nonboundary points. To address this issue, this study proposes a novel Distribution-aware Activity Boundary Representation (DABR) method that utilizes a continuous probability density function to smooth the probability of moments near activity boundaries. The proposed DABR reduces the penalty for detecting moments near ground-truth boundary points, while increasing the number of samples related to boundary points. Additionally, we introduce a two-stage framework that incorporates class-informed information in temporal localization for more efficient activity boundary localization. Extensive experiments demonstrate that our method achieves state-of-the-art results on two standard datasets, particularly exhibiting a significant improvement of 11.5% at average p-mAP on the THUMOS'14 dataset.

出版物
In IEEE Signal Processing Letters
Xuejiao Hu(胡雪娇)
博士(2019-2024)

简略介绍

Shijie Wang(王师捷)
Shijie Wang(王师捷)
硕士(2022-)

简略介绍

Ming Li(李明)
硕博连读(2017-2024)

简略介绍

Yang Li(李杨)
Yang Li(李杨)
副教授

简略介绍

Sidan Du(都思丹)
Sidan Du(都思丹)
教授

简略介绍