Fred Heiding

Senator Josh Hawley sent an open letter to Dario Amodei this week, citing my work on how to best counter AI-powered scams: www.jec.senate.gov/public/_cach...

Anthropic takes security seriously, but securing AI systems is difficult

Our paper on AI-powered spear phishing, co-authored with @fredheiding.bsky.social , has been accepted at the ICML 2025 Workshop on Reliable and Responsible Foundation Models!
openreview.net/pdf?id=f0uFp...

AI-Enhanced Social Engineering Will Reshape the Cyber Threat Landscape The proliferation of artificial intelligence tools enables bad actors to conduct deceptive attacks more cheaply, quickly, and effectively.

The consequences of artificial intelligence supercharging deceptive content online will extend beyond cyberspace to exacerbate real world challenges. Alex O'Neill and @fredheiding.bsky.social look at how AI is contributing to a rise in social engineering attacks and what governments can do about it.

Human study on AI spear phishing campaigns — LessWrong TL;DR: We ran a human subject study on whether language models can successfully spear-phish people. We use AI agents built from GPT-4o and Claude 3.5…

I published a human study with @fredheiding.bsky.social
We use AI agents built from GPT-4o and Claude 3.5 Sonnet to search the web for available information on a target and use this for highly personalized phishing messages. achieved click-through rates above 50%
www.lesswrong.com/posts/GCHyDK...

AI Jesus might ‘listen’ to your confession, but it can’t absolve your sins − a scholar of Catholicism explains In the future, a program like AI Jesus could be used to hear confessions around the clock. But with no experience of having a human body, it cannot engage or absolve human sins.

"AI Jesus will listen, but can't absolve your sins"