Carolyn Rose, Kavčić-Moura Professor of Lang. Tech. and HCI, CMU

RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing We present RepoST, a scalable method to construct environments that provide execution feedback for repository-level code generation for both training and evaluation. Unlike existing works that aim to ...

Paper: arxiv.org/abs/2503.07358
Code: github.com/yiqingxyq/Re...

Work led by Yiqing Xie, with Alex Xie, Divyanshu Sheth, Pengfei Liu, @daniel-fried.bsky.social and @carolynrose.bsky.social

Amazon Nova AI Challenge returns with Nova Forge access for competing teams For the first time in an academic competition, students can customize frontier AI models to build trusted software agents

I'm excited to be participating in year 2 of this challenge: www.amazon.science/nova-ai-chal...

GitHub - EEElisa/LLM-Guardrails Contribute to EEElisa/LLM-Guardrails development by creating an account on GitHub.

[9/9] Big THANKS to my amazing collaborators @jiajiah.bsky.social @pigeonzow.bsky.social Motahhare Eslami, Jena Hwang @faebrahman.bsky.social, @carolynrose.bsky.social @maartensap.bsky.social from @ltiatcmu.bsky.social
Pareto.ai @sfu.ca @ai2.bsky.social ♥️
📂 github.com/EEElisa/LLM-Guardrails

I'm proud of my research group members, Zhen Wu, Ritam Dutt, Luke Breitfeller, Armineh Nourbakhsh, and Siddharth Parekh, for their Outstanding Paper Award at AACL-IJCNLP!! arxiv.org/abs/2508.01475

Finalist teams advance in the Amazon Nova AI Challenge: Trusted AI Track Top eight university teams move on to head-to-head finals focused on AI security for code generation.

Congratulations to the CMU team for the Amazon Trusted AI Challenge for making it to the finals! www.amazon.science/nova-ai-chal...

Amazon Nova AI Challenge accelerating the field of generative AI Inaugural global university competition focused on advancing secure, trusted AI-assisted software development.

I'm proud to serve as faculty lead along with Michael Hilton for the CMU team in the Amazon Trusted AI Challenge: www.amazon.science/amazon-nova-...

Do you have opinions about the current state of reviewing at *CL conferences? Do you want to help? We (@emnlpmeeting.bsky.social PCs) want to hear from you: forms.office.com/r/P68uvwXYqf

SNU-CMU HCAI Research Center Launch

The Seoul National University and Carnegie Mellon University (CMU) SNU-CMU Human-Centered AI Research Center (HCAI) officially launched last week! Learn more here: hcai.snu.ac.kr Kudos to my former PhD student and trail blazer for this effort, Gahgene Gweon.

Pleased to see our two certificates growing out of the Masters of Computational Data Science program (www.lti.cs.cmu.edu/academics/ma...) ramping up: Machine Learning and Data Science (www.cmu.edu/online/cds/) as well as Generative AI and Large Language Models (www.cmu.edu/online/gai-l...)

I'm excited to start a newly funded collaboration with John Stamper (CMU) and Gahgene Gweon (Seoul National University): “A deep exploration of collaboration and communication skills in group programming tasks with the use of Human-AI collaboration“

CRScore: Grounding Automated Evaluation of Code Review Comments in Code Claims and Smells The task of automated code review has recently gained a lot of attention from the machine learning community. However, current review comment evaluation metrics rely on comparisons with a human-writte...

NAACL 25: CRScore can produce valid, fine-grained scores of code review quality that have the greatest alignment with human judgment and release a corpus of 2.6k human-annotated review quality scores. arxiv.org/abs/2409.19801 See Atharva's other great work here: scholar.google.com/citations?us...

Congratulations to YiQing Xie for being selected as the recipient of the LTI Presidential Fellowship for 2024/2025! See YiQing's other great accomplishments: yiqingxyq.github.io and scholar.google.com/citations?us...

Investigating the Generalizability of Pretrained Language Models across Multiple Dimensions: A Case Study of NLI and MRC Ritam Dutt, Sagnik Ray Choudhury, Varun Venkat Rao, Carolyn Rose, V.G.Vinod Vydiswaran. Proceedings of the 2nd GenBench Workshop on Generalisation (Benchmarking) in NLP. 2024.

Congrats to Ritam Dutt for getting an Honorable mention at the EMNLP GenBench workshop. aclanthology.org/2024.genbenc...