Winston H. Hsu [chinese name] (CV)

RM 512, CSIE Building,
1 Roosevelt Road, Section 4,
Taipei 106, Taiwan

TEL: +886-2-3366-4888 ext. 512
FAX: +886-2-3366-4898

E-mail: e-mail

MiRAcle we believe in!

Short Bio

Dr. Winston Hsu is an active researcher dedicated to novel algorithms and systems for large-scale image/video retrieval, social media mining, visual recognition, and machine intelligence – both in mobile and cloud-based platforms. He is keen to realizing advanced researches towards business deliverables via academia-industry collaborations and co-founding startups. Till November 2015, he has 3000+ Google Citations among his research publications (self-maintained list and DBLP) (since 2004).

He is a Professor in the Department of Computer Science and Information Engineering and Graduate Institute of Networking and Multimedia, National Taiwan University. He is affiliated with Communication and Multimedia Lab (CMLab) and the founder of MiRA (Multimedia indexing, Retrieval, and Analysis) Research Group. He was a Visiting Researcher at Microsoft Research Redmond (Summer 2014). He received his Ph.D. degree (2007) from Columbia University, New York, under the supervision of Prof. Shih-Fu Chang. Before that, he worked for years as a founding engineer in the multimedia software company, CyberLink Corp., where experiencing Engineer, Project Leader, and R&D Manager.

He has been recognized with technical awards and best paper awards in multimedia research community (e.g., ACM Multimedia 2006 Best Paper Runner-Up, First Prize in ACM Multimedia Grand Challenge 2011, First Place in MSR-Bing Image Retrieval Challenge 2013, ACM Multimedia 2013/2014 Grand Challenge Multimodal Award, etc.). He is on the Editorial Board for IEEE Multimedia Magazine and the Associate Editor for IEEE Transactions on Multimedia. He is in the organizing committee for ACM Multimedia (2010/2012/2013/2016), ICMR 2015/2016, ICME 2009, PCM 2013/2014, MMM 2013. He is in the technical committee for major conferences (ACM Multimedia 2009-2015, SIGIR 2011/2013/2015, WWW 2011, ICCV 2015, CVPR 2016, CIKM 2011, ICME 2006-2016, IJCAI 2015). He is a Senior Member of both the IEEE and the ACM. He was awarded 2011 Ta-You Wu Memorial Award (吳大猷先生紀念獎), a national and prestigious recognition for young researchers, and 2013 National Outstanding IT Elite Award (資訊月傑出資訊人才獎), for his contributions in advanced research and industry collaborations. See more details in his CV.


Research Focus

The prevalence of capture devices and the advent of media-sharing services have drastically increased the sheer amount of image and video collections. Here arise the strong needs for effective multimedia analysis and efficient multimedia retrieval. We have been devoted to large-scale photo and video retrieval, knowledge discovery from large-scale social media mining, distributed computation for multimedia analysis and retrieval, and devised novel multimedia applications in mobile devices.

Recently, we focus on numerous Deep Convolutional Neural Network methods for large-scale image/video analysis and retrieval projects, sponsored by leading industry partners (Microsoft Research, MediaTek, HTC, Intel, IBM TJ Watson, etc.). We investigate effective CNN methods for image/video applications such as image search, video event detection, face recognition,  facial/clothing attributes, image/video captioning, surveillance applications, etc. Especially, we aim for effective training strategies by leveraging web-scale data and scalable learning algorithms compliant with mobile or IoT devices.

Though having observed very exciting applications in large-scale multimedia analysis and retrieval, we further identify certain core challenges and respond to them respectively:

  facial/clothing attribute detection/search
web-scale indexing & feature learning
large-scale photo/video recognition
web-scale facial image retrieval
mobile visual recognition

multimodal deep neural network
social media mining
big data analytics and visualization
first-person/wearable cameras
consumer photo retrieval


Snapshots for the lab life!!

>> Why having research projects in MiRA group? for CSIE undergraduates and PhD students. Some quick demos: