足球视频的语义颜色提取与语义镜头分割

doi:10.3969/j.issn.1001-2400.2010.04.006

J4 ›› 2010, Vol. 37 ›› Issue (4): 613-618.doi: 10.3969/j.issn.1001-2400.2010.04.006

足球视频的语义颜色提取与语义镜头分割

牛振兴;李洁;高新波

(西安电子科技大学电子工程学院，陕西西安 710071)

收稿日期:2009-04-07 出版日期:2010-08-20 发布日期:2010-10-11
通讯作者: 牛振兴
作者简介:牛振兴(1981-)，男，西安电子科技大学博士研究生，E-mail: zxniu@xidian.edu.cn．
基金资助:
国家自然科学基金资助项目(60702061);中科院自动化所模式识别国家重点实验室开放基金资助项目

Semantic color extraction and semantic shot segmentation for soccer video

NIU Zhen-xing;LI Jie;GAO Xin-bo

(School of Electronic Engineering, Xidian Univ., Xi'an 710071， China)

Received:2009-04-07 Online:2010-08-20 Published:2010-10-11
Contact: NIU Zhen-xing

摘要/Abstract

摘要：

在镜头颜色特征分析的基础上对足球视频的镜头进行了语义意义下的分割，即语义镜头分割．常用的基于主颜色的镜头分类方法只提取一种颜色作为分类特征，不能有效地处理语义颜色丰富的体育视频．将主颜色扩展为多个语义颜色，定义了颜色比例特征，再利用SVM对镜头进行分类，实验结果表明，颜色比例特征能够有效地提高镜头分类精度．考虑到视频语义颜色随时间和环境会发生变化，还给出了一种自适应的视频语义颜色提取算法，可以使语义颜色随环境的改变而自适应调整．

关键词: 视频语义分析, 镜头分割, 颜色比例特征, 支持矢量机

Abstract:

Based on the color feature analysis, this paper considers the shot segmentation issue from the perspective of semantic analysis, i.e., the semantic shot segmentation. In most prior works they segment and classify the shot by using the dominant color of the field for soccer video, which can not properly utilize the plenty of color information on sports video. In this paper, we expand one dominant color in to several semantic colors, and define the Color Ratio Feature (CRF). Then, the Support Vector Machine (SVM) framework is used for shot classification. The precision of shot classification shows that the color ratio feature is useful to improve the performance. Further, considering the temporal variations in the semantic color due to environment, this paper gives an adaptive semantic color extraction algorithm, and we evaluate the influence of classification precision on the number of semantic colors.

Key words: semantic analysis, shot segmentation, color ratio feature, support vector machine

牛振兴;李洁;高新波. 足球视频的语义颜色提取与语义镜头分割[J]. J4, 2010, 37(4): 613-618.

NIU Zhen-xing;LI Jie;GAO Xin-bo. Semantic color extraction and semantic shot segmentation for soccer video[J]. J4, 2010, 37(4): 613-618.

参考文献

[1] Hanjalic A. Shot-boundary Detection: Unraveled and Resolved [J]. IEEE Trans on Circuits and Systems for Video Technology, 2002(12): 90-105.
[2] Xu P, Xie L, Chang S F, et al. Algorithms and Systems for Segmentation and Structure Analysis in Soccer Video[C]//IEEE International Conference on Multimedia ＆ Expo. Tokyo: Springer, 2001: 928-931.
[3] Xie L, Chang S F, Divakaran A, et al. Structure Analysis of Soccer Video with Hidden Markov Models[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 4. Orlando: IEEE, 2002: 4096-4099.
[4] Ren R, Jose J.M. Football Video Segmentation Based on Video Production Strategy[C]//27th European Conference on Information Retrieval. Santiago de: Springer, 2005: 433-446.
[5] Wang F, Ma Y F, Zhang H J, et al. Dynamic Bayesian Network Based Event Detection for Soccer Highlight Extraction[C]//IEEE International Conference on Image Processing: Vol 1. Singapore: IEEE, 2004: 633-636.
[6] Wang L, Zeng B Y, Lin S, et al. Automatic Extraction of Semantic Colors in Sports Video[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 3. Montreal: IEEE, 2004: 617-620.
[7] Ekin A, Tekalp A M. Shot Type Classification By Dominant Color for Sports Video Segmentation and Summarization[C]//IEEE International Conference on Acoustics, Speech, and Signal Processing: Vol 3. Hongkong: IEEE, 2003: 173-176.
[8] Ekin A, Tekalp A M. Robust Dominant Color Detection and Color-based Application for Sports Video[C]//IEEE International Conference on Image Processing: Vol 1. Barcelona: IEEE, 2003: 21-24.
[9] Burke B, Shook F. Sports Photography and Reporting[M]. 2nd Edition. New York: Longman Publisher, 1996.
[10] Roberts S J, Husmeier D, Rezek I, et al. Bayesian Approaches to Gaussian Mixture Modeling[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 1998, 20(11): 1133-1142.
[11] Snoek C G M, Worring M, Geusebroek J M, et al. The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing[J]. IEEE Trans on Pattern Analysis and Machine Intelligence, 2006, 28(10): 1678-1689.
[12] Campbell M, Ebadollahi S, Naphade M, et al. IBM Research TRECVID-2006 Video Retrieval System[J/OL]. [2006-11-12]. http://www.nlpir.nist.gov/projects/tvpubs/tv6.papers/ibm.pdf.
[13] Yanagawa A, Chang S.F, Hsu W. Columbia University's Baseline Detectors for 374 LSCOM Semantic Visual Concepts[J/OL]. [2007-08-10]. http://www.ee.columbia.edu/dvmm/Columbia-374.
[14] Vapnik V. The Nature of Statistical Learning Theory[M]. 2nd Edition. New York: Springer-Verlag, 2000.
[15] Platt J. Probabilities for SV Machines[M]. Boston: MIT Press, 2000: 61-74.
[16] Chang C C, Lin C J. LIBSVM: a Library for Support Vector Machines[J/OL]. [2001-10-20]. http://www.csie.ntu.edu.tw/.cjlin/libsvm.

足球视频的语义颜色提取与语义镜头分割

Semantic color extraction and semantic shot segmentation for soccer video

PDF (PC)

赞

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 3

Metrics

本文评价

推荐阅读 10

[1]	同鸣;王硕;丁力伟;王纲 . HCRF和网络文本的精彩事件自动检测定位[J]. J4, 2015, 42(4): 81-87.
[2]	崔艳鹏;胡建伟;杨绍全;朱燕. 利用尺度不变量特征的ISAR二维像自动识别技术[J]. J4, 2009, 36(4): 725-729.
[3]	马建华;刘宏伟;保铮. 基于小波变换的雷达高分辨距离像识别[J]. J4, 2005, 32(6): 895-900.