Large Language Models
Evaluating and improving how large language models reason, generalize, and behave under distribution shift, with an emphasis on what their outputs actually reveal about their internal state.
PhD Student, Data Science Degree Program
National Taiwan University
I am a PhD student in the Data Science Degree Program at National Taiwan University, where I go by Anna. My research centers on large language models, in particular on understanding when they should be trusted and how reliably they can express what they do not know.
My earlier work approached machine learning from the systems side, on making deep networks cheaper to run through tensor decomposition, and on building speech recognition systems for languages with little training data. Those projects left me with a lasting interest in the gap between a model's reported confidence and its actual competence, the question I now work on directly.
If you are also a Christian speaking Chinese, welcome to see my Christian blog.
Recently I just started my journey on how to make some contribution (not trouble) in some open-source projects. (See my github)
Evaluating and improving how large language models reason, generalize, and behave under distribution shift, with an emphasis on what their outputs actually reveal about their internal state.
Calibration, confidence, and selective prediction: measuring when a model knows that it does not know, and turning that signal into systems that can abstain or defer rather than fail silently.