Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

HOTVCOM: Generating Buzzworthy Comments for Videos

About

In the era of social media video platforms, popular ``hot-comments'' play a crucial role in attracting user impressions of short-form videos, making them vital for marketing and branding purpose. However, existing research predominantly focuses on generating descriptive comments or ``danmaku'' in English, offering immediate reactions to specific video moments. Addressing this gap, our study introduces \textsc{HotVCom}, the largest Chinese video hot-comment dataset, comprising 94k diverse videos and 137 million comments. We also present the \texttt{ComHeat} framework, which synergistically integrates visual, auditory, and textual data to generate influential hot-comments on the Chinese video dataset. Empirical evaluations highlight the effectiveness of our framework, demonstrating its excellence on both the newly constructed and existing datasets.

Yuyan Chen, Yiwen Qian, Songzhou Yan, Jiyuan Jia, Zhixu Li, Yanghua Xiao, Xiaobo Li, Ming Yang, Qingpei Guo• 2024

Related benchmarks

TaskDatasetResultRank
Video CaptioningMSR-VTT (test)
CIDEr104.2
121
Video CaptioningMSVD (test)
CIDEr66.3
111
Video Comment GenerationTikTok English
Info Score83.46
8
Video Comment GenerationLivebot (test)
R@120.34
7
Video Comment GenerationHOTVCOM original (test)
Informativeness93.54
6
Video Comment GenerationVideoIC (test)
R@137.24
6
Video Comment RetrievalMovieLC
R@110.34
5
Video CaptioningHOTVCOM 1.0 (test)
BLEU41.21
4
Showing 8 of 8 rows

Other info

Follow for update