Hometown: Kuching, Sarawak, Malaysia
Graduation date: Fall 2023
Additional details: First-generation college student
FURI | Fall 2023
Diversity Measures: Domain-Independent Proxies for Failure in Language Model Queries
This research examines the correlation between a language model’s uncertainty — quantified via “diversity measures” — and its reasoning abilities. The research team evaluates aspects of the model’s diversity measures that are strong indicators of it being correct. Doing this provides valuable insights into the capabilities of language models and allows users to further improve the user’s prompts to enhance model performance.
Mentor: Paulo Shakarian