It's been a journey of nearly 3 years, but I'm very excited to announce the CNTR AISLE Portal! 🚀 cntr-aisle.org It’s a new way to review and evaluate the 1,000+ AI bills introduced in the U.S. over the last three years. Check out the Bill Library and our Profiles#AIPolicy #OpenData
New post by @michelleding.bsky.social on resources for the Brown community in the aftermath of the shooting. open.substack.com/pub/michelle...
Serena Booth (@reniebird.bsky.social) reflects on the challenge of collecting human preferences to steer AI systems and wonders if we are doing it all wrong. cntr.brown.edu/news/2025-11...
This is part 1 of 3 of CNTR researcher reflections on COLM 2025.
Loving the illustrations!!!
Technologies like synthetic data, evaluations, and red-teaming are often framed as enhancing AI privacy and safety. But what if their effects lie elsewhere?
In a new paper with @realbrianjudge.bsky.social at #EAAMO25, we pull back the curtain on AI safety's toolkit. (1/n)
arxiv.org/pdf/2509.22872
💡We kicked off the SoLaR workshop at #COLM2025 with a great opinion talk by @michelleding.bsky.social & Jo Gasior Kavishe (joint work with @victorojewale.bsky.social and
@geomblog.bsky.social
) on "Testing LLMs in a sandbox isn't responsible. Focusing on community use and needs is."
Read our full opinion abstract here: cntr.brown.edu/news/2025-09...
Hi #COLM2025! 🇨🇦 I will be presenting a talk on the importance of community-driven LLM evaluations based on an opinion abstract I wrote with Jo Kavishe, @victorojewale.bsky.social and @geomblog.bsky.social tomorrow at 9:30am in 524b for solar-colm.github.io
Hope to see you there!
Screenshot of paper title and author list: Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, Inioluwa Deborah Raji
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling by @victorojewale.bsky.social @rbsteed.com @briana-v.bsky.social @abeba.bsky.social @rajiinio.bsky.social compares the landscape of AI audit tools (tools.auditing-ai.com) to the actual needs of AI auditors.
Very excited to see this piece out in @techpolicypress.bsky.social today. This was written together with @r-jy.bsky.social and Kate Elizabeth Creasey (a historian here at Brown), and calls out what we think is a scary and interesting rhetorical shift.
www.techpolicy.press/sovereignty-...
Join us for the Eval Eval Coalition Social at @facct.bsky.social tomorrow Tuesday June 24th from 4-4:30 pm during the coffee break! We would love to have you join us and we look forward to seeing you there!! #FAccT2025 #EvalEval
I'm incredibly fortunate to have had the opportunity to work with this team. Truly one of the best collaborative experiences I have had to date (special s/o to our MVP @mkgerchick.bsky.social for leading this)!
Check out Marissa's talk on our paper "auditing the audits" if you're at #FAccT2025!
⬇️
The welcome event and first keynote are getting started! 🎉🦉
Our first keynote is by Suresh Venkatasubramanian (Brown University) @geomblog.bsky.social
"Are we winning yet? FAccT, AI governance, and the shape of what comes next."
#FAccT2025
It was an honor and a pleasure to deliver this keynote. And perhaps one of the hardest talks I've had to design.
Please come see us at the RC Trust Networking Event!
You can sign up with the QR Codes around the venues and get some free drinks! 🙂↕️
#FAccT2025
Reminder that we have multiple social events happening this evening, all happening *outside* the conference venue!
Social: RC-Trust Networking Reception for the FAccT Community
Social: Generative AI Risks + Red-Teaming
Social: AI Workers' Inquiry
facctconference.org/2025/sociale...
The deadline for proposing a social for #FAccT2025 has been extended! Get your proposals in by Wednesday, May 21.
facctconference.org/2025/cfsocial
Social Chairs will provide assistance for accepted socials with coordination, translation, suggested venues, + other logistics to support your event.
The deadline to submit proposals for #FAccT2025 socials is tomorrow, May 9th! Please send us your ideas!
Super grateful for the mentorship from you and the OAT team Deb!!!
cc: @rbsteed.com @briana-v.bsky.social @abeba.bsky.social
So proud of Victor for attending his first CHI and presenting this work with such skill & confidence :)
It remains such a joy to be part of his academic journey!
go check out our paper if you're at #CHI2025
Proud to have worked on this with the dream team!
@rbsteed.com , @briana-v.bsky.social , @abeba.bsky.social , and @rajiinio.bsky.social .
Come for the talk! #CHI2025
P.S. Needed an excuse to post a picture of the Yokohama skyline lol
We argue for moving beyond ad-hoc toolkits to a common, sustainable AI accountability infrastructure. This requires a concerted effort from academia, industry, and policy makers to develop tools to support not only evaluation but also advocacy and policy change.
We taxonomized these tools based on their use in different stages of auditing—such as Harms Discovery, Transparency Infrastructure, & Audit Communciation—highlighting areas of oversaturation or neglect.
Through interviews with 35 practitioners and analysis of 450+ AI audit tools, we identify gaps between current tooling and effective accountability.
Despite many evaluation tools, there’s a need for systems supporting the full audit cycle, especially harms discovery and stakeholder communication
Excited to present "Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling" at #CHI2025 tomorrow(today)!
🗓 Tue, 29 Apr | 9:48–10:00 AM JST (Mon, 28 Apr | 8:48–9:00 PM ET)
📍 G401 (Pacifico North 4F)
📄 dl.acm.org/doi/10.1145/...
Hahaha, good one 🤣
Yaaaay
Welcome to Brown 🎉🎉🎉
Excited to be presenting a new paper with @harinisuresh.bsky.social on the extremely critical topic of technical prevention/governance of adult AI generated non-consensual intimate images aka "deepfake pornography" at #CHI2025 chi-staig.github.io on 4/27 10:15-11:15 JST arxiv.org/abs/2504.17663 🧵
