Seminar của GS Timothy Baldwin từ MBZUAI và ĐH Melbourne với tiêu đề: Plumbing the Breadth and Depth of LLM Evaluation
Seminar về LLMs từ diễn giả là GS Timothy Baldwin từ MBZUAI and Đại học Melbourne – một cây đa cây đề trong làng NLP thế giới. Trân trọng kính mời các quý đồng nghiệp và các em sinh viên tham gia.
—————————-
– Topic: Plumbing the Breadth and Depth of LLM Evaluation
– Time: 14h30-16h00, Monday, Jan 8th, 2024
– Speaker: Prof. Tim Baldwin, Acting Provost and Professor of Natural Language Processing at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Melbourne Laureate Professor in the School of Computing and Information Systems, The University of Melbourne
– Hình thức: Hybrid
+ Offline at Room 504, B1 Building, HUST (maximum 40 slots)
+ Online via Zoom
– Abstract:
The recent surge in generative large language models (LLMs) has created even greater challenges for NLP evaluation. In this talk, I will cover a range of LLM evaluation initiatives covering issues including: LLM capabilities across a broad range of tasks; multilingual and multicultural capabilities; the ability of models to capture different aspects of negation; model calibration; and model safety.
– Speaker Bio:
Tim Baldwin is Acting Provost and Professor of Natural Language Processing at Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), in addition to being a Melbourne Laureate Professor in the School of Computing and Information Systems, The University of Melbourne.
Tim completed a BSc(CS/Maths) and BA(Linguistics/Japanese) at The University of Melbourne in 1995, and an MEng(CS) and PhD(CS) at the Tokyo Institute of Technology in 1998 and 2001, respectively. He joined MBZUAI at the start of 2022, prior to which he was based at The University of Melbourne for 17 years. His research has been funded by organisations including the Australian Research Council, Google, Microsoft, Xerox, ByteDance, SEEK, NTT, and Fujitsu, and has been featured in MIT Tech Review, Bloomberg, Reuters, CNN, IEEE Spectrum, The Times, ABC News, The Age/Sydney Morning Herald, and Australian Financial Review. He is the author of nearly 500 peer-reviewed publications across diverse topics in natural language processing and AI, with over 22,000 citations and an h-index of 72 (Google Scholar), in addition to being an ARC Future Fellow, and the recipient of a number of awards at top conferences.