Contact
| |
|
|
]
(
Short Bio
Dr. Winston Hsu is an active researcher dedicated to novel algorithms and systems for large-scale image/video retrieval, social media mining/ recommendation, multimedia analytics, and mobile and cloud-based multimedia applications. He has been recognized with technical awards and best paper awards in multimedia research community. He is keen to realizing advanced researches towards business deliverables. Other major contributions include mobile visual search solutions, image/video reranking, image classification models (e.g., Columbia374), and large-scale multimedia ontologies (e.g., LSCOM). See more details in his Google Citations. He delivered keynote speech and lectured several state-of-the-art tutorials in top conferences. He is in the technical committee for top conferences (e.g., ACM Multimedia, SIGIR, and WWW) and the organizing committee for ACM Multimedia and ICME. He is on the Editorial Board for IEEE Multimedia Magazine and JMM. He is an Associate Professor in CSIE & GINM, National Taiwan University and the founder of MiRA (Multimedia indexing, Retrieval, and Analysis) Research Group, in Communication and Multimedia Lab (CMLab). He received his Ph.D. (2007) degree from Columbia University, New York, under the supervision of Prof. Shih-Fu Chang. Before that, he worked for years as a founding engineer in the multimedia software company, CyberLink Corp., where experiencing Engineer, Project Leader, and R&D Manager. He was experienced with software product/service shipping processes. He is an ACM and IEEE Senior Member. He is recently awarded 2011 Ta-You Wu Memorial Award, a national and prestigious recognition for young researchers. See more details in his CV.
Research Focus
The prevalence of capture devices and the advent of media-sharing services have drastically increased the sheer amount of image and video collections. Here arise the strong needs for effective multimedia analysis and efficient multimedia retrieval. We have been devoted to large-scale photo and video retrieval, knowledge discovery from large-scale social media mining, distributed computation for multimedia analysis and retrieval, and devised novel multimedia applications in mobile devices.
Though having observed very exciting applications in large-scale multimedia analysis and retrieval, we further identify certain core challenges and respond to them respectively:
- Semantic gap – bridging the low-level visual features to satisfy semantic needs by proposing semantic ontology and learning semantic representations in an automatic manner;
- User gap – helping users issue proper queries to satisfy their intentions in different application scenarios and mobile devices (e.g., by sketch, attribute, snapshot, speech, and touch-based);
- Volume gap – learning ultra-large-scale photos and videos by distributed computation and efficient high-dimensional indexing (e.g., hash-based methods) for real-time query response over big photo/video data;
- Privacy – conducting privacy-preserving mining for large-scale photos and videos and addressing the privacy concerns as sharing sensitive photos and videos (e.g., family albums) in the public clouds.
- Industry needs – besides thorough algorithms for academic researches, we also investigate practical methods for meeting possible needs in industrial developments (e.g., technology transfer).
Recruiting
We
keep recruiting graduate students
(master or PhD) for the exciting projects
of both great theoretical interests and strong industrial demands.
Students have delivered brilliant results. See our news
or publication sections for more
details.
- Several image/video/audio retrieval projects are also good for undergraduate students.
 |
| Snapshots for the lab life!! |
Why having research projects in MiRA group? for CSIE undergraduates
and PhD students. Some quick demos:
- Effective and efficient product query by mobile phone
- Interactive video (Question and Answering)
- Realtime image retrieval over million-scale image collections
- Million-scale image graph construction and clustering by cloud
computation (MapReduce over 18 Hadoop servers).
- Flora Project: Flower Retrieval and Social Network
- Multimodal Fusion for Mobile Annotation – GPS, Compass, or Camera
- Indexing million-scale faces in sub-second response
- Real-time video retrieval and mobile question and answering
- Consumer
photo search by facial attributes and face layout on touch devices (US
patent pending #: 13/599,127)
+ FIRST PRIZE in ACM Multimedia Grand Challenge 2011
(presentation
video)
- Sketch-based
image retrieval on mobile devices using compact hash bits
- A
snapshot for the twitter activities among the world -- real-time
estimation from the sampled tweets; a toy demonstration for our
ongoing project in Big Data
Analytics.
News!!
- Congratulations
to Guan-Long Wu, Yin-Hsi
Kuo, and Tzu-Hsuan Chiu for their very work accepted for IEEE
Multimedia Magazine. It is a prominent (and probably the first) work
addressing scalable mobile video retrieval issues.
Prof. Hsu will serve in the Organizing Committee (Panel Co-Chair) and
Area Chair for ACM Multimedia 2013.
- Congratulations
to Yan-Ying
Chen and Yen-Liang
Lin for being awarded NSC Grants for PhD Research Abroad
(「補助博士生赴國外研究」) in 2013; Chen will have research visit to Prof.
Shih-Fu Chang, Columbia University; Lin will visit Prof.
Larry S. Davis, University of Maryland.
- Congratulations
to Yan-Ying
Chen for winning the Doctoral
Symposium Best Paper Award in ACM
Multimedia 2012.
- Congratulations
to Bor-Chun
Chen for receiving 2012 Best
Master Thesis Award of Taiwanese Association for Artificial
Intelligence (TAAI) 「101年度中華民國人工智慧學會碩士論文獎」
- Prof.
Hsu is co-organizing 2012 MSRA Taiwan Academic Forum
in Taipei, Nov. 16, 2012.
- Congratulations
to Yin-Hsu Kuo for receiving (very competitive) 2012
Microsoft Research Asia Fellowship Award (with $10K
USD cash Award) among 10 recipients in Asia and the only one
from Taiwan.
- Prof.
Hsu will have a keynote speech at The
2nd ACM International Workshop on Interactive Multimedia on Mobile
and Portable Devices (IMMPD2012) with ACM
Multimedia 2012, Nara, Japan, Oct. 29 ~ Nov. 2, 2012.
- Congratulations
to Yan-Ying Chen, Chun-Che Wu, and Yen-Liang Lin for receiving ACM
Multimedia 2012 Travel Grant.
- Prof. Hsu will co-host Greater Tokyo Area Multimedia/Vision Workshop, Thursday, August 30th, 2012, in the University of Tokyo, Japan. We will feature three talks from our PhD candidates, Yen-Liang Lin, Yin-Hsi Kuo, and Yan-Ying Chen.
-
Prof. Hsu was just approved as "IEEE Senior Member"
- Congratulations
to the group for having one FULL, three SHORT and two Doctoral
Symposium ORAL papers, accepted for
ACM Multimedia 2012
- Congratulations
Prof. Hsu for receiving 2012-2014 National Science Council
(NSC) Excellent Young Researcher Award (國科會優秀年輕學者研究計畫)
- Congratulations
Prof. Hsu for receiving 2012 NTU EECS Academic Contribution
Award (學術貢獻獎)
- Our
US patent, System
and method for inserting advertisement in contents of video program,
regarding Internet video advertisement, have been granted.
- Congratulations
for receiving the research award in 2012 Microsoft Research
Asia Windows Phone Theme Program
- Congratulations
to "people team" for the work, Where is Who: Large-Scale Photo
Retrieval by Facial Attributes and Canvas Layout, accepted for SIGIR
2012 (FULL paper, 89/483 ~= 20%) .
- Prof. Hsu has an invited demo in Cloud Futures 2012, Berkeley, California, May 7-8, 2012.
- Prof. Hsu has an invited talk in The Second Multimedia and Vision Meeting in Greater New York Area, Columbia University, New York, June 15, 2012.
- Prof. Hsu has an invited talk in AI Forum, Kaohsiung, Taiwan, May 12, 2012.
- Prof. Hsu had an invited talk in Digital Media Analysis, Search and Management DMASM 2012 International Workshop, San Diego, Feb. 27-28, 2012.
- Congratulations to Kuo, Yin-Hsi for her work, Unsupervised Semantic Feature Discovery for Image Object Retrieval and Tag Refinement, accepted for IEEE Transactions on Multimedia 2012.
- Congratulations for cloud-based photo management system winning the
2nd Prize (with
180,000 NTD cash award) in Chunghwa Telecom Innovation Awards
(2011 電信創新應用大賽雲端應用校園組亞軍)
- We won the prestigious award, First Prize in ACM Multimedia Grand Challenge 2011 for the project -- "Photo Search by Face Positions and Facial Attributes on Touch Devices"
- Congratulations to Prof. Hsu for receiving 2011 (NSC) Ta-You Wu Memorial Award (國科會100年度吳大猷先生紀念獎), the most prestigious Taiwan government award for young researchers
- ... more
