AAII Research Seminar Series | Seminar 10
WHEN
30 April 2025
Wednesday
2.30pm - 3.30pm Australia/Sydney
WHERE
City campus
Meeting Room CB02.12.225
(Level 12, UTS Building 02)
COST
Free admission
CONTACT
Associate Professor Yi Zhang
Topic: Exploring Trustworthy Foundation Models: Benchmarking, Finetuning and Reasoning
Speaker: Dr Bo Han
Abstract
In the current landscape of machine learning, where foundation models must navigate imperfect real-world conditions such as noisy data and unexpected inputs, ensuring their trustworthiness through rigorous benchmarking, safety-focused finetuning, and robust reasoning is more critical than ever.
In this talk, I will focus on three recent research advancements that collectively advance these dimensions, offering a comprehensive approach to building trustworthy foundation models.
For benchmarking, I will introduce CounterAnimal, a dataset designed to systematically evaluate CLIP’s vulnerability to realistic spurious correlations, revealing that scaling models or data quality can mitigate these biases, yet scaling data alone does not effectively address them. Transitioning to finetuning, we delve deep into the process of unlearning undesirable model behaviors.
We propose a general framework to examine and understand the limitations of current unlearning methods and suggest enhanced revisions for more effective unlearning.
Furthermore, addressing reasoning, we investigate the reasoning robustness under noisy rationales by constructing the NoRa dataset and propose contrastive denoising with noisy chain-of-thought, a method that markedly improves denoising-reasoning capabilities by contrasting noisy inputs with minimal clean supervision.
Furthermore, l will introduce the newly established Trustworthy Machine Learning and Reasoning (TMLR) Group at Hong Kong Baptist University.
Speaker: Dr Bo Han
About Dr Bo Han
Bo Han is an Assistant Professor in Machine Learning at Hong Kong Baptist University, and a BAIHO Visiting Scientist at RIKEN AIP. He was a Visiting Research Scholar at MBZUAI MLD, a Visiting Faculty Researcher at Microsoft Research and Alibaba DAMO Academy, and a Postdoc Fellow at RIKEN AIP. He received his Ph.D. degree in Computer Science from University of Technology Sydney.
He has served as Senior Area Chair of NeurIPS, and Area Chairs of NeurIPS, ICML and ICLR. He has also served as Associate Editors of IEEE TPAMI, MLJ and JAIR, and Editorial Board Members of JMLR and MLJ.
He received Outstanding Paper Award at NeurIPS, Most Influential Paper at NeurIPS, and Outstanding Student Paper Award at NeurIPS Workshop. He received the RGC Early CAREER Scheme, IEEE AI's 10 to Watch Award, IJCAI Early Career Spotlight, RIKEN BAIHO Award, Dean’s Award for Outstanding Achievement, and Microsoft Research StarTrack Scholars Program.