Kunal Handa

I am a Research Scientist and Member of the Technical Staff at Anthropic. I focus on improving the societal impact of AI systems.

Previously, I was an MSc by Research student student at the University of Oxford advised by Yarin Gal. Before that, I was a linguistics and computer science undergrad at Brown University working with Ellie Pavlick and Chen Sun. I also spent two summers at the Stanford NLP Group and Stanford CoCoLab advised by Diyi Yang, Dora Demszky, and Noah Goodman with whom I continue to collaborate frequently.

You can contact me at: kunal [underscore] handa [at] alumni [dot] brown [dot] edu.

Publications

Preprints

Clio: Privacy-Preserving Insights into Real-World AI Use
Alex Tamkin*, Miles McCain** denotes equal contribution., Kunal Handa, Esin Durmus, Liane Lovitt, Ankur Rathi, Saffron Huang, Alfred Mountfield, Jerry Hong, Stuart Ritchie, Michael Stern, Brian Clarke, Landon Goldberg, Theodore R. Sumers, Jared Mueller, William McEachen, Wes Mitchell, Shan Carter, Jack Clark, Jared Kaplan, Deep Ganguli. Under review, 2024.

Bayesian Preference Elicitation with Language Models
Kunal Handa, Yarin Gal, Ellie Pavlick, Noah Goodman, Jacob Andreas, Alex Tamkin*, Belinda Z Li*. Under review, 2024.

Conference Papers

“Mistakes Help Us Grow”: Facilitating and Evaluating Growth Mindset Supportive Language in Classrooms
Kunal Handa, Margarett Clapper, Jessica Boyle, Rose E Wang, Diyi Yang, David S Yeager, Dorottya Demszky. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023.

Emergence of Abstract State Representations in Embodied Sequence Modeling
Tian Yun*, Zilai Zeng*, Kunal Handa, Ashish V Thapliyal, Bo Pang, Ellie Pavlick, Chen Sun. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023.

Task Ambiguity in Humans and Language Models
Alex Tamkin*, Kunal Handa*, Avash Shrestha, Noah Goodman. In the International Conference on Learning Representations (ICLR), 2023.

Journal Articles

Peekbank: An open, large-scale repository for developmental eye-tracking data of children's word recognition
Martin Zettersten, Daniel Yurovsky, Tian Linger Xu, Sarp Uner, Angeline Sin Mei Tsui, Rose M. Schneider, Annissa N. Saleh, Stephan C. Meylan, Virginia A. Marchman, Jessica Mankewitz, Kyle MacDonald, Bria Long, Molly Lewis, George Kachergis, Kunal Handa, Benjamin deMayo, Alexandra Carstensen, Mika Braginsky, Veronica Boyce, Naiti S. Bhatt, Claire Augusta Bergey & Michael C. Frank.outside of the position of the first and the last author, authorship position was determined by sorting authors' last names in reverse alphabetical order. In Behavior Research Methods (BRM), 2022.

Other Writing

The Role of Technology in Elections: The Voyage of Voters' Data
Kunal Handa. In Conduit, the Brown University Computer Science Annual Magazine, Volume 32, 2022.

Trying to Give a Shit About "Give a Shit": A Compositional Semantics Perspective
Kunal Handa

Teaching

At Brown, I served as the Socially-Responsible Computing Teaching Assistant for CS1470: Deep Learning. I designed contentsome of which is available via the course website on deep learning's potential societal harms and conducted exercises that examined ethical frameworks, the cyclical nature of language models' biases, and the pros and cons of regulating ML advancements.

As a senior, I founded and led Brown's Explainable AI Reading Group. We presented and discussed topics across language modeling, reinforcement learning, computer vision, and multi-agent systems literature.

I also tutor incarcerated and previously incarcerated individuals in HiSET test preparation and essay writing. Intermittently, I teach group classes such as Applying to College and Introduction to Philosophy at juvenile detention centers.

Academic Service

I reviewed for Empirical Methods in Natural Language Processing (EMNLP), 2023; and, I reviewed for the Socially Responsible Language Modelling Research (SoLaR) Workshop at the Conference on Neural Information Processing Systems (NeurIPS), 2023.