Winston H. Hsu 
RM 512, CSIE Building,
1 Roosevelt Road, Section 4,
Taipei 106, Taiwan
TEL: +886-2-3366-4888 ext. 512
Office Hour: 10am ~ 12pm, Tuesday, @R512
we believe in!
Dr. Winston Hsu is an active researcher dedicated to novel algorithms
and systems for large-scale image/video retrieval, social media mining/
recommendation, multimedia analytics, and mobile and cloud-based
multimedia applications. He has been recognized with technical awards
and best paper awards in multimedia research community. He is keen to
realizing advanced researches towards business deliverables. Other major
contributions include mobile visual search solutions, image/video
reranking, image classification models (e.g., Columbia374), and
large-scale multimedia ontologies (e.g., LSCOM). See more details in his
Citations. He delivered keynote speech and lectured several
state-of-the-art tutorials in top conferences. He is in the technical
committee for top conferences (e.g., ACM Multimedia, SIGIR, and WWW) and
the organizing committee for ACM Multimedia and ICME. He is on the
Editorial Board for IEEE
Multimedia Magazine and JMM.
He is an Associate Professor in CSIE
National Taiwan University and the founder of MiRA
Retrieval, and Analysis)
Research Group, in
Communication and Multimedia Lab (CMLab). He received his Ph.D.
(2007) degree from Columbia University, New York, under the supervision
Shih-Fu Chang. Before that, he worked for years as a founding
engineer in the multimedia software company, CyberLink
Corp., where experiencing Engineer, Project Leader, and R&D
Manager. He was experienced with software product/service shipping
processes. He is an ACM and IEEE Senior Member. He is recently awarded
2011 Ta-You Wu Memorial Award, a national and prestigious recognition
for young researchers. See more details in his CV.
The prevalence of capture devices and the advent of media-sharing
services have drastically increased the sheer amount of image and video
collections. Here arise the strong needs for effective multimedia
analysis and efficient multimedia retrieval. We have been devoted to
large-scale photo and video retrieval, knowledge discovery from
large-scale social media mining, distributed computation for multimedia
analysis and retrieval, and devised novel multimedia applications in
Though having observed very exciting applications in large-scale
multimedia analysis and retrieval, we further identify certain core
challenges and respond to them respectively:
- Semantic gap – bridging the low-level visual
features to satisfy semantic needs by proposing semantic ontology and
learning semantic representations in an automatic manner;
- User gap – helping users issue proper queries to
satisfy their intentions in different application scenarios and mobile
devices (e.g., by sketch, attribute, snapshot, speech, and
- Volume gap – learning ultra-large-scale photos and
videos by distributed learning
and efficient high-dimensional indexing (e.g., hash-based methods) for
real-time query response over big
photo/video data; balancing the technical strengths between
the mobiles and cloud servers.
- Privacy – conducting privacy-preserving mining for
large-scale photos and videos and addressing the privacy concerns as
sharing sensitive photos and videos (e.g., family albums) in the
- Industry needs – besides thorough algorithms for
academic researches, we also investigate practical methods for meeting
possible needs in industrial developments (e.g., technology transfer).
- We keep recruiting graduate students
(master or PhD) for the exciting projects
of both great theoretical interests and strong industrial demands.
Students have delivered brilliant results. See our news
or publication sections for more
are recruiting students to leverage a cloud
system (with 1000+ cores) for thousand-scale
recognizers and deep learning for photo/video recognition and
- Several image/video/audio retrieval projects are also good for undergraduate
Why having research projects in MiRA group? for CSIE undergraduates
and PhD students. Some quick demos:
Prof. Hsu for receiving 2013
National Outstanding IT Elite Award (傑出資訊人才獎)
to the group for winning ACM
Multimedia 2013 Grand Challenge Multimodal Award.
to Kuan-Ting Chen for being awarded NSC
Grants for PhD Research Abroad (「補助博士生赴國外研究」) in 2014; She
will have (12-month) research visit to Dr.
Jiebo Luo's group for social media mining in ultra-large-scale
to the group for the paper, 3D
Sub-Query Expansion for Improving Sketch-based Multi-View Image
Retrieval, accepted for ICCV
to the group for winning the FIRST
PRIZE in MSR-Bing
Image Retrieval Challenge 2013, hosted by Microsoft Research
(Redmond) and Bing and also awarded USD $10,000.
to the group for having one FULL, one SHORT, two Grand Challenge, and
one Workshop papers accepted for
ACM Multimedia 2013.
to Guan-Long Wu, Yin-Hsi
Kuo, and Tzu-Hsuan Chiu for their very work accepted for IEEE
Multimedia Magazine. It is a prominent (and probably the first) work
addressing scalable mobile video retrieval issues.
Prof. Hsu will serve in the Organizing Committee (Panel Co-Chair) and
Area Chair for ACM Multimedia 2013.
Chen and Yen-Liang
Lin for being awarded NSC Grants for PhD Research Abroad
(「補助博士生赴國外研究」) in 2013; Chen will have research visit to Prof.
Shih-Fu Chang, Columbia University; Lin will visit Prof.
Larry S. Davis, University of Maryland.
- Congratulations to Yan-Ying
Chen for winning the Doctoral
Symposium Best Paper Award in ACM
- Congratulations to Bor-Chun
Chen for receiving 2012 Best
Master Thesis Award of Taiwanese Association for Artificial
Intelligence (TAAI) 「101年度中華民國人工智慧學會碩士論文獎」
- Prof. Hsu is co-organizing 2012 MSRA Taiwan Academic Forum
in Taipei, Nov. 16, 2012.
- Congratulations to Yin-Hsu Kuo for receiving (very competitive) 2012
Microsoft Research Asia Fellowship Award (with $10K
USD cash Award) among 10 recipients in Asia and the only one
- Prof. Hsu will have a keynote speech at The
2nd ACM International Workshop on Interactive Multimedia on Mobile
and Portable Devices (IMMPD2012) with ACM
Multimedia 2012, Nara, Japan, Oct. 29 ~ Nov. 2, 2012.
- Congratulations to Yan-Ying Chen, Chun-Che Wu, and Yen-Liang Lin for
Multimedia 2012 Travel Grant.
- Prof. Hsu will co-host Greater
Tokyo Area Multimedia/Vision Workshop, Thursday, August 30th,
2012, in the University of Tokyo, Japan. We will feature three talks
from our PhD candidates, Yen-Liang
Kuo, and Yan-Ying
- Prof. Hsu was just approved as "IEEE Senior Member"
- Congratulations to the group for having one FULL, three SHORT and
two Doctoral Symposium ORAL papers, accepted for
ACM Multimedia 2012
- Congratulations Prof. Hsu for receiving 2012-2014 National
Science Council (NSC) Excellent Young Researcher Award
- Congratulations Prof. Hsu for receiving 2012 NTU EECS
Academic Contribution Award (學術貢獻獎)
- Our US patent, System
and method for inserting advertisement in contents of video program,
regarding Internet video advertisement, have been granted.
- Congratulations for receiving the research award in 2012
Microsoft Research Asia Windows Phone Theme Program
- Congratulations to "people team" for the work, Where is Who:
Large-Scale Photo Retrieval by Facial Attributes and Canvas Layout,
accepted for SIGIR
2012 (FULL paper, 89/483 ~= 20%) .
- Prof. Hsu has an invited demo in
Cloud Futures 2012, Berkeley, California, May 7-8, 2012.
- Prof. Hsu has an invited talk in
The Second Multimedia and Vision Meeting in Greater New York Area,
Columbia University, New York, June 15, 2012.
- Prof. Hsu has an invited talk in
AI Forum, Kaohsiung, Taiwan, May 12, 2012.
- Prof. Hsu had an invited talk in
Digital Media Analysis, Search and Management DMASM 2012
International Workshop, San Diego, Feb. 27-28, 2012.
- Congratulations to Kuo, Yin-Hsi for her work, Unsupervised
Semantic Feature Discovery for Image Object Retrieval and Tag
Refinement, accepted for IEEE Transactions on Multimedia 2012.
- Congratulations for cloud-based photo management system winning the
2nd Prize (with
180,000 NTD cash award) in Chunghwa Telecom Innovation Awards
- We won the prestigious award, First Prize in ACM Multimedia
Grand Challenge 2011 for the project -- "Photo Search by
Face Positions and Facial Attributes on Touch Devices"
- Congratulations to Prof. Hsu for receiving 2011 (NSC)
Ta-You Wu Memorial Award (國科會100年度吳大猷先生紀念獎), the most
prestigious Taiwan government award for young researchers
- ... more