David Rein's Avatar

David Rein

@idavidrein

sentio ergo sum. developing the science of evals at METR. prev NYU, cohere

458
Followers
95
Following
6
Posts
27.04.2023
Joined
Posts Following

Latest posts by David Rein @idavidrein

Hey, study author here—I think this is an overgeneralization.

We find that *experienced, open-source developers working on projects they’re highly familiar with* are slowed down. This is consistent with many developers being sped up often, e.g. when writing one-off scripts

11.07.2025 00:30 👍 3 🔁 1 💬 1 📌 1

Uber driver is telling me how excited he is that he just got this new car because he totaled his previous one 😅

24.01.2025 05:34 👍 0 🔁 0 💬 0 📌 0

had a similar experience in africa—zebra and wildebeest were just chilling like right next to lions

28.11.2024 21:44 👍 2 🔁 0 💬 0 📌 0

Daily life at METR:

25.11.2024 19:35 👍 3 🔁 0 💬 0 📌 0

Testing, testing

25.11.2024 19:24 👍 12 🔁 3 💬 1 📌 1

If interpretability gave us as much info as transparent cases did, we’d be a lot further along than we currently are

27.04.2023 04:35 👍 2 🔁 0 💬 1 📌 0

omg so true, thanks for letting me know!!

27.04.2023 04:33 👍 1 🔁 0 💬 1 📌 0