Publications

Journal Articles

  1. Hung-Yi Lee, Sz-Rung Shiang, Ching-Feng Yeh, Yun-Nung Chen, Yu Huang, and Lin-Shan Lee, "Spoken Knowledge Organization by Semantic Structuring and a Prototype Coutse Lecture System for Personalized Learning," in IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 2014.
    paper ieee acm bib

Peer-Reviewed Conference Papers

    2017

  1. Guang-He Lee and Yun-Nung Chen "MUSE: Modulizing Unsupervised Sense Embeddings," (to appear) Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP 2017), Copenhagen, Denmark, September 7-11, 2017.
    arXiv (preprint) code
  2. Bo Ru Lu, Frank Shyu, Yun-Nung Chen, Hung-Yi Lee, and Lin-Shan Lee, "Order-Preserving Abstractive Summarization for Spoken Content Based on Connectionist Temporal Classification," (to appear) Proceedings of The 18th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2017), Stockholm, Sweden, August 20-24, 2017. ISCA.
  3. Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng, "Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access," (to appear) Proceedings of The 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), Vancouver, Canada, July 30-Augest 4, 2017. ACL. (oral paper acceptance rate: 11.5%)
    arXiv (prior version) code
  4. Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, and Asli Celikyilmaz, "Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems," arXiv preprint arXiv: 1703.07055, 2017.
    arXiv code
  5. Xiujun Li, Yun-Nung Chen, Lihong Li, and Jianfeng Gao, "End-to-End Task-Completion Neural Dialogue Systems," arXiv preprint arXiv: 1703.01008, 2017.
    arXiv code
  6. Ting-Hao Kenneth Huang, Yun-Nung Chen, and Jeffery P. Bigham, "Real-Time On-Demand Crowd-powered Entity Extraction," in Proceedings of The 5th Edition of The Collective Intelligence Conference (CI 2017), New York, June 15-16, 2017.
    arXiv code demo slide
  7. Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul Crook, Xiujun Li, Jianfeng Gao, and Li Deng, "End-to-End Joint Learning of Natural Language Understanding and Dialogue Manager," in Proceedings of The 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2017), New Orleans, March 5-9, 2017.
    paper arXiv slide code bib

  8. 2016

  9. Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, and Yun-Nung Chen, "A User Simulator for Task-Completion Dialogues," arXiv preprint arXiv: 1612.05688, 2016.
    arXiv code
  10. Yun-Nung Chen, Dilek Hakkani-Tur, Gokan Tur, Asli Celikyilmaz, Jianfeng Gao, and Li Deng, "Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing," in Proceedings of 6th IEEE Workshop on Spoken Language Technology (SLT 2016), San Diego, December 13-16, 2016.
    paper bib
  11. Ming Sun, Aasish Pappu, Yun-Nung Chen, and Alexander I. Rudnicky, "Weakly Supervised User Intent Detection for Multi-Domain Dialogues," in Proceedings of 6th IEEE Workshop on Spoken Language Technology (SLT 2016), San Diego, December 13-16, 2016.
    paper code
  12. Yun-Nung Chen, Dilek Hakkani-Tur, Gokan Tur, Asli Celikyilmaz, Jianfeng Gao, and Li Deng, "Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks," arXiv preprint arXiv: 1609.03286, 2016.
    arXiv
  13. Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, and Li Deng, "End-to-End Reinforcement Learning of Dialogue Agents for Information Access," arXiv preprint arXiv: 1609.00777, 2016.
    arXiv
  14. Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Jianfeng Gao, and Li Deng, "End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding," Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016), San Francisco, September 8-12, 2016.
    paper slide code bib
  15. Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Chen, Jianfeng Gao, Li Deng, and Ye-Yi Wang, "Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM," Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016), San Francisco, September 8-12, 2016.
    paper code bib
  16. Yun-Nung Chen and Dilek Hakkani-Tur, "AIMU: Actionable Items for Meeting Understanding," in Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), Portoroz, Slovenia, May 23-28, 2016.
    paper data website bib
  17. Ming Sun, Yun-Nung Chen, Zhenhao Hua, Yulian Tamres-Rudnicky Arnab Dash, and Alexander I. Rudnicky, "AppDialogue: Multi-App Dialogues for Intelligent Assistants," Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), Portoroz, Slovenia, May 23-28, 2016.
    paper website bib
  18. Yun-Nung Chen, Dilek Hakkani-Tur, and Xiaodong He, "Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models," in Proceedings of The 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2016), Shanghai, China, March 20-25, 2016. IEEE.
    paper poster bib
  19. Yun-Nung Chen, Ming Sun, and Alexander I. Rudnicky, "Unsupervised User Intent Modeling by Feature-Enriched Matrix Factorization," in Proceedings of The 41st IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2016), Shanghai, China, March 20-25, 2016. IEEE.
    paper poster bib
  20. Ming Sun, Yun-Nung Chen, and Alexander I. Rudnicky, "An Intelligent Assistant for High-Level Task Understanding," in Proceedings of The 21st Annual Meeting of the Intelligent Interfaces Community (IUI 2016), pages 169-174, Sonoma, CA, March 7-10, 2016. ACM. (accetance rate: 24%)
    paper acm slide data bib
  21. Ming Sun, Yun-Nung Chen, and Alexander I. Rudnicky, "HELPR: A Framework to Break the Barrier across Domains in Spoken Dialog Systems," in Proceedings of the 7th International Workshop on Spoken Dialogue Systems (IWSDS 2016), Saariselka, Finland, January 13-16, 2016.
    paper slide data bib

  22. 2015

  23. Yun-Nung Chen, Dilek Hakkani-Tur, and Xiaodong He, "Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models," in Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015), pages 375-382, Scottsdale, AZ, December 13-17, 2016. IEEE.
    paper ieee poster bib
  24. Yun-Nung Chen, Sun Ming, Alexander I Rudnicky, and Anatole Gershman, "Leveraging Behavioral Patterns of Mobile Applications for Personalized Spoken Language Understanding," in Proceedings of The 17th ACM International Conference on Multimodal Interaction (ICMI 2015), pages 83-86, Seattle, WA, November 9-13, 2015. ACM. (oral paper acceptance rate: 18.9%)
    paper acm slide data bib
  25. Yun-Nung Chen, William Yang Wang, and Alexander I Rudnicky, "Learning Semantic Hierarchy with Distributed Representations for Unsupervised Spoken Language Understanding," in Proceedings of The 16th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2015), pages 1869-1873, Dresden, Germany, September 6-10, 2015. ISCA.
    paper isca poster data bib
  26. Ming Sun, Yun-Nung Chen, and Alexander I Rudnicky, "Learning OOV through Semantic Relatedness in Spoken Dialog Systems," in Proceedings of The 16th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2015), pages 1453-1457, Dresden, Germany, September 6-10, 2015. ISCA.
    paper isca poster bib
  27. Yun-Nung Chen, William Yang Wang, Anatole Gershman, and Alexander I Rudnicky, "Matrix Factorization with Knowledge Graph Propagation for Unsupervised Spoken Language Understanding," in Proceedings of The 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2015), pages 483-494, Beijing, China, July 26-31, 2015. ACL. (oral paper acceptance rate: 15.6%)
    paper acl slide video data bib
  28. Yun-Nung Chen, William Yang Wang, and Alexander I Rudnicky, "Jointly Modeling Inter-Slot Relations by Random Walk on Knowledge Graphs for Unsupervised Spoken Language Understanding," in Proceedings of 2015 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2015), pages 619-629, Denver, CO, May 31-June 5, 2015. ACL. (acceptance rate: 26%)
    paper acl OMM slide poster code data bib

  29. 2014

  30. Yun-Nung Chen, Dilek Hakkani-Tur, and Gokhan Tur, "Deriving Local Relational Surface Forms from Dependency-Based Entity Embeddings for Unsupervised Spoken Language Understanding," in Proceedings of the 5th IEEE Workshop on Spoken Language Technology (SLT 2014), pages 242-247, Lake Tahoe, CA, December 7-10, 2014. IEEE.
    paper ieee poster data bib
  31. Yun-Nung Chen and Alexander I. Rudnicky, "Dynamically Supporting Unexplored Domains in Conversational Interactions by Enriching Semantics with Neural Word Embeddings," in Proceedings of the 5th IEEE Workshop on Spoken Language Technology (SLT 2014), pages 590-595, Lake Tahoe, CA, December 7-10, 2014. IEEE.
    paper ieee poster bib
  32. Yun-Nung Chen, William Yang Wang, and Alexander I. Rudnicky, "Leveraging Frame Semantics and Distributional Semantics for Unsupervised Spoken Language Understanding," in Proceedings of the 5th IEEE Workshop on Spoken Language Technology (SLT 2014), pages 584-589, Lake Tahoe, CA, December 7-10, 2014. IEEE.
    paper poster data bib
  33. Yun-Nung Chen and Alexander I. Rudnicky, "Two-Stage Stochastic Natural Language Generation for Email Synthesis by Modeling Sender Style and Topic Structure," in Proceedings of the 8th International Natural Language Generation Conference (INLG 2014), pages 152-156, Philadelphia, PA, June 19-21, 2014. ACL.
    paper acl poster bib

  34. 2013

  35. Yun-Nung Chen, William Yang Wang, and Alexander I Rudnicky, "Unsupervised Induction and Filling of Semantic Slots for Spoken Dialogue Systems Using Frame-Semantic Parsing," in Proceedings of 2013 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2013), pages 120-125, Olomooc, Czech Republic, December 9-12, 2013. IEEE. (Best Student Paper Award: 1/~170; <0.6%)
    paper ieee poster slide data bib
  36. Sujay Kumar Jauhar, Yun-Nung Chen, and Florian Metze, "Prosody-Based Unsupervised Speech Summarization with Two-Layer Mutually Reinforced Random Walk," in Proceedings of The 6th International Joint Conference on Natural Language Processing (IJCNLP 2013), pages 648-654, Nagoya, Japan, October 14-18, 2013. ACL.
    paper acl slide bib
  37. Yun-Nung Chen and Florian Metze, "Multi-Layer Mutually Reinforced Random Walk with Hidden Parameters for Improved Multi-Party Meeting Summarization," in Proceedings of The 14th Annual Conference of the International Speech Communication Association (INTERSPEECH 2013), pages 485-489, Lyon, France, Auguest 25-29, 2013. ISCA.
    paper isca slide bib
  38. Yun-Nung Chen, William Yang Wang, and Alexander I. Rudnicky, "An Empirical Investigation of Sparse Log-Linear Models for Improved Dialogue Act Classification," in Proceedings of The 38th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), pages 8317-8321, Vancouver, Canada, May 26-31, 2013. IEEE.
    paper ieee poster bib
  39. Sunayana Sitaram, Sukhada Palkar, Yun-Nung Chen, Alok Parlikar, and Alan W. Black, "Bootstrapping Text-to-Speech for Speech Processing in Languages without An Orthography," in Proceedings of The 38th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), pages 7992-7996, Vancouver, Canada, May 26-31, 2013. IEEE.
    paper ieee bib

  40. 2012

  41. Yun-Nung Chen and Florian Metze, "Two-Layer Mutually Reinforced Random Walk for Improved Multi-Party Meeting Summarization," in Proceedings of the 4th IEEE Workshop on Spoken Language Technology (SLT 2012), pages 461-466, Miami, FL, December 2-5, 2012. IEEE.
    paper ieee poster code bib
  42. Yun-Nung Chen and Florian Metze, "Integrating Intra-Speaker Topic Modeling and Temporal-Based Inter-Speaker Topic Modeling in Random Walk for Improved Multi-Party Meeting Summarization," in Proceedings of the 13th Annual Conference of the International Speech Communication Association (INTERSPEECH 2012), pages 2346-2359, Portland, OR, September 9-13, 2012. ISCA. (Best Student Paper Shortlist: 10/~1300; <0.8%)
    paper isca poster bib
  43. Yun-Nung Chen, Kai-Min Chang, and Jack Mostow, "Towards Using EEG to Improve ASR Accuracy," in Proceedings of 2012 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2012), pages 382-385, Montreal, Canada, June 3-8, 2012. ACL.
    paper acl OMM slide poster bib
  44. Yun-Nung Chen and Florian Metze, "Intra-Speaker Topic Modeling for Improved Multi-Party Meeting Summarization with Integrated Random Walk," in Proceedings of 2012 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2012), pages 377-381, Montreal, Canada, June 3-8, 2012. ACL.
    paper acl OMM slide poster bib
  45. Yun-Nung Chen, Yu Huang, Hung-Yi Lee, and Lin-Shan Lee, "Unsupervised Two-Stage Keyword Extraction from Spoken Documents by Topic Coherence and Support Vector Machine," in Proceedings of the 37th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2012), pages 5041-5044, Kyoto, Japan, March 25-30, 2012. IEEE.
    paper ieee poster bib
  46. Hung-Yi Lee, Yun-Nung Chen, and Lin-Shan Lee, "Utterance-level Latent Topic Transition Modeling for Spoken Documents and Its Application in Automatic Summarization," in Proceedings of the 37th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2012), pages 5065-5068, Kyoto, Japan, March 25-30, 2012. IEEE.
    paper ieee poster bib

  47. 2011

  48. Hung-Yi Lee, Yun-Nung Chen, and Lin-Shan Lee, "Improved Speech Summarization and Spoken Term Detection with Graphical Analysis of Utterance Similarities," in Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011 (APSIPA ASC 2011), Xian, China, October 18-21, 2011.
    paper bib
  49. Yun-Nung Chen, Yu Huang, Ching-Feng Yeh, and Lin-Shan Lee, "Spoken Lecture Summarization by Random Walk over a Graph Constructed with Automatically Extracted Key Terms," in Proceedings of the 12th Annual Conference of the International Speech Communication Association (INTERSPEECH 2011), pages 933-936, Florence, Italy, August 28-31, 2011. ISCA.
    paper isca slide bib
  50. Yun-Nung Chen, Chia-Ping Chen, Hung-Yi Lee, Chun-An Chan, and Lin-Shan Lee, "Improved Spoken Term Detection with Graph-Based Re-Ranking in Feature Space," in Proceedings of the 36th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2011), pages 5644-5647, Prague, Czech Republic, May 22-27, 2011. IEEE.
    paper ieee poster bib

  51. 2010

  52. Yun-Nung Chen, Yu Huang, Sheng-Yi Kong, and Lin-Shan Lee, "Automatic Key Term Extraction from Spoken Course Lectures Using Branching Entropy and Prosodic/Semantic Features," in Proceedings of the 3rd IEEE Workshop on Spoken Language Technology (SLT 2010), pages 265-270, Berkeley, CA, December 12-15, 2010. IEEE. (Best Student Paper Award: 2/~150; <2%)
    paper ieee slide video bib

Workshop Paper / Conference Demo Paper / Position Paper

  1. Yun-Nung Chen, Ming Sun, and Alexander I. Rudnicky, "Towards Spoken Language Interfaces for Mobile Applications," in Proceedings of CHI 2016 Workshop on Designing Speech and Language Interaction for Mobile and Wearable Computing (CHI-DSLI 2016), San Jose, CA, May 7-8, 2016.
    paper
  2. Ming Sun, Yun-Nung Chen and Alexander I. Rudnicky, "Learning User Intentions Spanning Multiple Domains," in Proceedings of IUI 2016 Workshop on Interacting with Smart Objects (SmartObjects 2016), Sonoma, CA, March 10, 2016.
    paper
  3. Yun-Nung Chen, Dilek Hakkani-Tur, and Xiaodong He, "Learning Bidirectional Intent Embeddings by Convolutional Deep Structred Semantic Models for Spoken Language Understanding," in Extended Abstract of The 29th Annual Conference on Neural Information Processing Systems - Machine Learning for Spoken Language Understanding and Interactions Workshop (NIPS-SLU 2015), Montreal, Canada, December 11, 2015.
    paper spotlight poster
  4. Yun-Nung Chen, Ming Sun, and Alexander I. Rudnicky, "Matrix Factorization with Domain Knowledge and Behavioral Patterns for Intent Modeling," in Extended Abstract of The 29th Annual Conference on Neural Information Processing Systems - Machine Learning for Spoken Language Understanding and Interactions Workshop (NIPS-SLU 2015), Montreal, Canada, December 11, 2015.
    paper spolight poster
  5. Ming Sun, Yun-Nung Chen, and Alexander I. Rudnicky, "Understanding User's Cross-Domain Intentions in Spoken Dialog Systems," in Extended Abstract of The 29th Annual Conference on Neural Information Processing Systems - Machine Learning for Spoken Language Understanding and Interactions Workshop (NIPS-SLU 2015), Montreal, Canada, December 11, 2015.
    paper poster
  6. Ting-Hao Kenneth Huang, Yun-Nung Chen, and Lingpeng Kong, "ACBiMA: Advanced Chinese Bi-Character Word Morphological Analyzer," in Proceedings of The 8th SIGHAN Workshop on Chinese Language Processing (SIGHAN-8), Beijing, China, July 30-31, 2015. ACL. [paper ] [slide ] [toolkit ] [bib ]
    paper slide code
  7. Yun-Nung Chen and Alexander I. Rudnicky, "Two-Stage Stochastic Email Synthesizer," in Proceedings of the 8th International Natural Language Generation Conference (INLG 2014), Demo Session, pages 99-102, Philadelphia, Pennsylvania, June 19-21, 2014. Association for Computational Linguistics. [paper ] [bib ] [poster ]
    paper
  8. Seshadri Sridharan, Yun-Nung Chen, Kai-Min Chang, and Alexander I. Rudnicky, "NeuroDialog: An EEG-Enabled Spoken Dialog Interface," in Proceedings of The 14th ACM International Conference on Multimodal Interaction (ICMI 2012), Demo Session, Santa Monica, CA, October 22-26, 2012.
    paper video 1 video 2
  9. Sheng-Yi Kong, Miao-Ru Wu, Che-Kuang Lin, Yi-Sheng Fu, Yung-Yu Chung, Yu Huang, Yun-Nung Chen, Lin-shan Lee, "NTU Virtual Instructor - A Spoken Language System Offering Services of Learning on Demand Using Video/Audio/Slides of Course Lectures," in Show and Tell of the 34th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2009), Taipei, Taiwan, R.O.C., April, 2009. (System available at NTU Virtural Instructor)

Thesis

  1. Yun-Nung Chen, "Unsupervised Learning and Modeling of Knowledge and Intent for Spoken Dialogue Systems," Ph.D. Dissertation in Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA, USA, December 2015.
    Committee: Prof. Alexander I. Rudnicky (chair); Prof. Anatole Gershman (co-chair), Prof. Alan W Black, Dr. Dilek Hakkani-Tur (Microsoft Research)
    dissertation defense slide proposal proposal slide
    A thesis proposal in Proceedings of The 53rd Annual Meeting of the Association for Computational Linguistics and The 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing Student Research Workshop (ACL-IJCNLP SRW 2015), thesis proposal, Beijing, China, July 26-31, 2015. ACL. [paper ] [slide ] [poster ] [bib ]
  2. Yun-Nung Chen, "Automatic Key Term Extraction and Summarization from Spoken Course Lectures," M.S. Thesis in Computer Science, National Taiwan University, Taiwan, June 2011. (ACLCLP Thesis Award)
    Committee: Prof. Lin-Shan Lee (advisor); Prof. Sin-Horng Chen (NCTU), Prof. Hsiao-Chuan Wang (NTHU), Prof. Jen-Tzung Chien (NCKU), Dr. Chiu-Yu Tseng (Taiwan Academic Sinica)
    thesis slide
  3. Yun-Nung Chen and Yi-Hua Chen, "The Formulation and Analysis of Unlock Problem," High School Thesis in Math and Science Excellent Class, Taipei First Girls' High School, Taiwan, June 2004.
    Thesis advisor: Cheng-Kuei Li, Math and Science Gifted Program Subjects: Math and Arrangement Combination
    thesis (chinese)