Content Analysis


Overview

We have been working on semantic content analysis for media such as photos and videos. Such an analysis will enable more efficient and effective utiliziation of massive media, for example, search, organization, summarization, presentation and retrieval. We have worked on developing algorithms to automatically segment a home video into video segments based on events. As a first attempt, we focused on church wedding videos. The initial results was published in MIR 2007. The paper's title is Semantic-Event Based Analysis and Segmentation of Wedding Ceremony Videos. A more complete version of this work has been published as an IEEE TCSVT article in November 2008.

Recently, we have made efforts on collecting benchmarks for Region-of-Interest (ROI) of images using a collaborative game, called PhotoShoot. With the collected benchmark, we can compare exisiting ROI algorithms quantatively. The preliminary results are published in a CVPR 2009 paper.

We have also developed methods for learning landmark ontology from geotagged images of Flickr and Wikipedia article. The resultant ontology could be used in appliations such as automatic tag suggestion and content-relevant image re-ranking. The paper is published in MMM 2010.

Publications

Learning Landmarks by Exploting Social Media
Chia-Kai Liang, Yu-Ting Hsieh, Tien-Jung Chuang, Yin Wang, Ming-Fang Weng Yung-Yu Chuang
MMM 2010
A Collaborative Benchmark for Region of Interest Detection Algorithms
Tz-Huan Huang, Kai-Yin Cheng, Yung-Yu Chuang
IEEE CVPR 2009
Semantic Analysis for Automatic Event Recognition and Segmentation of Wedding Ceremony Videos
Wen-Huang Cheng, Yung-Yu Chuang, Yin-Tzu Lin, Chi-Chang Hsieh, Shao-Yen Fang, Bing-Yu Chen, Ja-Ling Wu
IEEE Transactions on Circuits and Systems for Video Technology, November 2008
Semantic-Event Based Analysis and Segmentation of Wedding Ceremony Videos
Wen-Huang Cheng, Yung-Yu Chuang, Bing-Yu Chen, Ja-Ling Wu, Shao-Yen Fang, Yin-Tzu Lin, Chi-Chang Hsieh, Chen-Ming Pan, Wei-Ta Chu, Min-Chun Tien
Proceedings of the 9th ACM SIGMM International Workshop on Multimedia Information Retrieval 2007


Support

This research is supported by:

cyy -a-t- csie.ntu.edu.tw