Timo Kaufmann's Avatar

Timo Kaufmann

@timokauf

PhD Student at LMU Munich. Focus on RL, reward learning and learning from human preferences.

7
Followers
10
Following
9
Posts
26.03.2025
Joined
Posts Following

Latest posts by Timo Kaufmann @timokauf

Joint work with Yannick Metz, Daniel Keim, and Eyke HΓΌllermeier.

04.12.2025 21:06 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

Benefits: improved reward model generalization, better data efficiency, and stronger policies. Looking forward to seeing you at the poster!

Paper and more: timokaufmann.com/responserank/

04.12.2025 21:05 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

The key insight is that these signals only need to be locally valid and relative (e.g., within one annotator's comparisons). No need to model the exact relationship to strength. Just rank which comparisons are stronger.

04.12.2025 21:04 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

The core idea: Not all preferences are equal. ResponseRank learns preference strength from implicit signals in your data, like inter-annotator agreement, stated confidence, or response times.

04.12.2025 21:04 πŸ‘ 1 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0
Post image

Presenting ResponseRank at #NeurIPS2025! Come by poster #405 at 4:30pm today if you're in San Diego πŸ‘‹

04.12.2025 21:03 πŸ‘ 0 πŸ” 0 πŸ’¬ 1 πŸ“Œ 0

Just noticed the key deadlines for #ICLR2026 out! PSA for everyone else who's been waiting.

Full paper: Sept 24 AoE.

27.06.2025 09:12 πŸ‘ 0 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

A bit late to post on BlueSky, but I had a great time at our poster session. Very cool to see so much interest in ICAI :)

28.04.2025 09:19 πŸ‘ 1 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0
Post image

πŸ•΅πŸ»πŸ’¬ Introducing Feedback Forensics: a new tool to investigate pairwise preference data.

Feedback data is notoriously difficult to interpret and has many known issues – our app aims to help!

Try it at app.feedbackforensics.com

Three example use-cases πŸ‘‡πŸ§΅

17.03.2025 18:12 πŸ‘ 7 πŸ” 2 πŸ’¬ 1 πŸ“Œ 0
Post image Post image Post image Post image

Currently visiting @arduin.io in Cambridge. I didn't realize it's this beautiful!

Do I know anyone here that I haven't met up with yet?

26.03.2025 09:00 πŸ‘ 2 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0

πŸ‘‹ I'll start cross-posting from twitter for now.

26.03.2025 08:58 πŸ‘ 3 πŸ” 0 πŸ’¬ 0 πŸ“Œ 0