足球视频的语义颜色提取与语义镜头分割

doi:10.3969/j.issn.1001-2400.2010.04.006

Abstract

Abstract:

Based on the color feature analysis, this paper considers the shot segmentation issue from the perspective of semantic analysis, i.e., the semantic shot segmentation. In most prior works they segment and classify the shot by using the dominant color of the field for soccer video, which can not properly utilize the plenty of color information on sports video. In this paper, we expand one dominant color in to several semantic colors, and define the Color Ratio Feature (CRF). Then, the Support Vector Machine (SVM) framework is used for shot classification. The precision of shot classification shows that the color ratio feature is useful to improve the performance. Further, considering the temporal variations in the semantic color due to environment, this paper gives an adaptive semantic color extraction algorithm, and we evaluate the influence of classification precision on the number of semantic colors.

Key words: semantic analysis, shot segmentation, color ratio feature, support vector machine

NIU Zhen-xing;LI Jie;GAO Xin-bo. Semantic color extraction and semantic shot segmentation for soccer video[J].J4, 2010, 37(4): 613-618.

References

[1] Hanjalic A. Shot-boundary Detection: Unraveled and Resolved [J]. IEEE Trans on Circuits and Systems for Video Technology, 2002(12): 90-105.
[2] Xu P, Xie L, Chang S F, et al. Algorithms and Systems for Segmentation and Structure Analysis in Soccer Video[C]//IEEE International Conference on Multimedia ＆ Expo. Tokyo: Springer, 2001: 928-931.
[3] Xie L, Chang S F, Divakaran A, et al. Structure Analysis of Soccer Video with Hidden Markov Models[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 4. Orlando: IEEE, 2002: 4096-4099.
[4] Ren R, Jose J.M. Football Video Segmentation Based on Video Production Strategy[C]//27th European Conference on Information Retrieval. Santiago de: Springer, 2005: 433-446.
[5] Wang F, Ma Y F, Zhang H J, et al. Dynamic Bayesian Network Based Event Detection for Soccer Highlight Extraction[C]//IEEE International Conference on Image Processing: Vol 1. Singapore: IEEE, 2004: 633-636.
[6] Wang L, Zeng B Y, Lin S, et al. Automatic Extraction of Semantic Colors in Sports Video[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 3. Montreal: IEEE, 2004: 617-620.
[7] Ekin A, Tekalp A M. Shot Type Classification By Dominant Color for Sports Video Segmentation and Summarization[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 3. Hongkong: IEEE, 2003: 173-176.
[8] Ekin A, Tekalp A M. Robust Dominant Color Detection and Color-based Application for Sports Video[C]//IEEE International Conference on Image Processing: Vol 1. Barcelona: IEEE, 2003: 21-24.
[9] Burke B, Shook F. Sports Photography and Reporting[M]. 2nd Edition. New York: Longman Publisher, 1996.
[10] Roberts S J, Husmeier D, Rezek I, et al. Bayesian Approaches to Gaussian Mixture Modeling[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 1998, 20(11): 1133-1142.
[11] Snoek C G M, Worring M, Geusebroek J M, et al. The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 2006, 28(10): 1678-1689.
[12] Campbell M, Ebadollahi S, Naphade M, et al. IBM Research TRECVID-2006 Video Retrieval System[J/OL]. [2006-11-12]. http://www.nlpir.nist.gov/projects/tvpubs/tv6.papers/ibm.pdf.
[13] Yanagawa A, Chang S.F, Hsu W. Columbia University's Baseline Detectors for 374 LSCOM Semantic Visual Concepts[J/OL]. [2007-08-10]. http://www.ee.columbia.edu/dvmm/Columbia-374.
[14] Vapnik V. The Nature of Statistical Learning Theory[M]. 2nd Edition. New York: Springer-Verlag, 2000.
[15] Platt J. Probabilities for SV Machines[M]. Boston: MIT Press, 2000: 61-74.
[16] Chang C C, Lin C J. LIBSVM: a Library for Support Vector Machines[J/OL]. [2001-10-20]. http://www.csie.ntu.edu.tw/.cjlin/libsvm.

Semantic color extraction and semantic shot segmentation for soccer video

PDF (PC)

Like

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 10

[1]	WANG Junxiang,HUANG Lin,ZHANG Ying,NI Jiangqun,LIN Lang. Algorithm for the detection of a low complexity contrast enhanced image source [J]. Journal of Xidian University, 2021, 48(1): 96-106.
[2]	LI Hai,SHANG Jinlei,SUN Tingyi,FENG Qing,ZHUANG Zibo. Method for hydrometeor classification based on MC-DTSVMs [J]. Journal of Xidian University, 2020, 47(4): 132-140.
[3]	AN Yali,ZHOU Shuisheng,CHEN Li,WANG Baojun. Robust support vector machines and their sparse algorithms [J]. Journal of Xidian University, 2019, 46(1): 64-72.
[4]	LI Meiling;HU Yaogai;ZHOU Chen;ZHAO Zhengyu;ZHANG Yuannong;LIU Jing;DENG Z X. On the short-term regional prediction of foF2 based on the support vector machine [J]. J4, 2015, 42(5): 147-153+206.
[5]	YAO Chao;LU Zhaoyang;LI Jing;JIANG Wei;FAN Zhihui. Hybrid classifier based method for similar handwritten Chinese character recognition [J]. J4, 2015, 42(5): 26-32.
[6]	CAI Yanyan;SONG Xiaodong. New fuzzy SVM model used in imbalanced datasets [J]. J4, 2015, 42(5): 120-124+160.
[7]	TONG Ming;WANG Shuo;DING Liwei;WANG Gang. Wonderful events automatic detection and location of the HCRF and webcast text [J]. J4, 2015, 42(4): 81-87.
[8]	JIANG Jianguo;ZHAO Yuan;MENG Hongwei;LI Bo. SVM decision-tree multi-classification strategy via electromagnetism-like mechanism [J]. J4, 2014, 41(6): 83-88.
[9]	MAO Shasha;XIONG Lin;JIAO Licheng;ZHANG Shuang;CHEN Bo. Isomerous multiple classifier ensemble via transformation of the rotating forest [J]. J4, 2014, 41(5): 48-53.
[10]	YANG Xi;LI Jie;HAN Bing;GAO Xinbo. Wavelet hierarchical model for aurora images classification [J]. J4, 2013, 40(2): 18-24.
[11]	. A Wavelet Hierarchical Model for Aurora Images Classification [J]. J4, 2013, 40(2): 18-24.
[12]	LIU Xiaopei;LU Zhaoyang;LI Jing. Complex scene text location method based on WTLBP and SVM [J]. J4, 2012, 39(4): 103-108.
[13]	FENG Yuejin;ZHANG Fengbin. Automatic matching algorithm for the latent semantic analysis based supply and demand information [J]. J4, 2012, 39(3): 126-130.
[14]	WANG Shiqiang;ZHANG Dengfu;BI Duyan;XUE Deyou;YONG Xiaoju. Research on recognizing the radar signal using the bispectrum cascade feature [J]. J4, 2012, 39(2): 127-132+191.
[15]	QIN Chuandong;LIU Sanyang;ZHANG Shifang. Method for extracting the tumor gene based on the support vector machine [J]. J4, 2012, 39(1): 191-196.