Partner Event: Large Scale Pre-trained Language Models: Opportunities and Challenges
About the event
Abstract: Pre-trained language models (PLMs) have greatly changed the face of NLP research and become a new research paradigm. In recent years, while the sizes of the PLMs become larger and larger, PLMs not only refresh the state-of-the-art performance for many NLP tasks, but also obtain new abilities which did not exist in traditional NLP models, such as few-shot/zero-shot learning, multi-modal representation and processing, etc. Meanwhile, large size PLMs also bring a series of challenges regarding data, training, security, energy consuming, etc. In this talk, I will give a brief overview of the progress in this area, and then introduce our related research in Huawei Noah's Ark Lab.
Brief Speaker Bio: Prof. Dr. Qun Liu, an ACL Fellow, is the Chief Scientist of Speech and Natural Language Processing of Huawei. He was a Full Professor in Dublin City University and the Theme Leader of the ADAPT Centre, Ireland during July 2012 and June 2018. Before that, he was as a Professor in the Institute of Computing Technology (ICT), Chinese Academy of Sciences for 20 years, where he founded and led the ICT NLP Research Group. He obtained his B.Sc., M.Sc. and Ph.D. in computer science in the University of Science and Technology of China, Chinese Academy of Sciences, and Peking University respectively. His research interests lie in the areas of Natural Language Processing and Machine Translation. His main academic contributions are on Chinese language processing, syntax-based statistical machine translation, pre-trained language models (training, compression, applications), etc . He has authored or co-authored more than 300 peer-reviewed research publications, which have been cited more than 12,000 times. He has supervised more than 40 students to the completion of their M.Sc. or Ph.D. degrees. He has received Google Research Award (2012), ACL Best Long Paper Award (2018), ACL Outstanding Paper Award (2022), etc.
