Miguel Vasco's Avatar

Miguel Vasco

@miguelvasco

Postdoc at @kthuniversity.bsky.social. Past: @gaipslab.bsky.social; Sony AI. Interested in all things RL and Multimodal. miguelvasco.com

2,108
Followers
277
Following
18
Posts
16.09.2024
Joined
Posts Following

Latest posts by Miguel Vasco @miguelvasco

Preview
RLVG Sessions @ RLC 2025 - YouTube Recorded sessions of the Reinforcement Learning and Video Games (RLVG) workshop at the Reinforcement Learning Conference (RLC), 2025. Recorded on August 5, 2025

Missed our workshop at @rl-conference.bsky.social?
Watch all keynote presentations and the panel discussion on YouTube:

youtube.com/playlist?lis...

Big thanks to our awesome speakers: @togelius.bsky.social, @jmac-ai.bsky.social, Roberta Raileanu, Michael Bowling and @pcastr.bsky.social!

25.09.2025 09:53 ๐Ÿ‘ 14 ๐Ÿ” 4 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 3
Post image

Conference rejections: hurts a bit but it's fine.
Radiohead rejections: I'll be crying in a corner all night

10.09.2025 19:14 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Post image

This one's been a long time coming.

In this post on Decisions & Dragons I answer "Should we abandon RL?"

The answer is obviously no, but people ask because they have a fundamental misunderstanding of what RL is.

RL is a problem, not an approach.

www.decisionsanddragons.com/posts/should...

15.08.2025 23:30 ๐Ÿ‘ 44 ๐Ÿ” 11 ๐Ÿ’ฌ 4 ๐Ÿ“Œ 3
Post image Post image Post image

The @rl-conference.bsky.social is always the best time of the year for a RL researcher!

This year I had a blast co-organizing the @rlvgworkshop.bsky.social, alongside amazing people! A huge thanks to our keynote speakers and everyone who joined the discussion.

Canโ€™t wait for Montreal next year!

12.08.2025 14:06 ๐Ÿ‘ 7 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Weโ€™re excited to announce our final keynote speaker: @michaelhbowling.bsky.social (University of Alberta). ๐ŸŽฒ๐Ÿƒ

In this talk, he will explore what drew him to explore using 40-year-old video games to test RL agents!

Join us at @rl-conference.bsky.social to find out more about the Atari Benchmark!

29.07.2025 14:45 ๐Ÿ‘ 8 ๐Ÿ” 3 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Post image

Weโ€™re excited to announce our next speaker: @pcastr.bsky.social (Google DeepMind, Mila) ๐ŸŽฎ๐Ÿ•น๏ธ

His research tackles core challenges in deep RL for real-world impact, like network scalability and plasticity loss!

Join us at @rl-conference.bsky.social to learn more about Pabloโ€™s work!

24.07.2025 18:10 ๐Ÿ‘ 7 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 2
Post image

Weโ€™re excited to announce our next keynote speaker:
@neuroai.bsky.social (Microsoft Research) ๐Ÿง 

Ida studies how humans and AI build world models for memory, exploration, and planning. Her talk will show how game-playing AI reveals insights into human and artificial cognition.

Join us at #RLC2025!

18.07.2025 10:24 ๐Ÿ‘ 16 ๐Ÿ” 5 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Weโ€™re excited to announce our next speaker: Roberta Raileanu ( Google DeepMind)!

Roberta will discuss the history and future of NetHack, the iconic roguelike that continues to challenge RL and LLM agents alike. โš”๏ธ

Join us to learn how we can develop agents capable of tackling open-endedness!

11.07.2025 15:56 ๐Ÿ‘ 6 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Weโ€™re excited to announce our first speaker: James MacGlashan (@jmac-ai.bsky.social), from Sony AI! ๐Ÿš€

James led the development of GT Sophy, a superhuman RL racing agent in Gran Turismo!

Join his talk to learn about how GT Sophy was used as an opponent in GT7 and whatโ€™s next for RL in gaming.

09.07.2025 15:40 ๐Ÿ‘ 5 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
a video game scene with crash bandicoot and a totem pole in the background ALT: a video game scene with crash bandicoot and a totem pole in the background

Two days left to submit to our Reinforcement Learning and Video Game workshop at @rl-conference.bsky.social !

Join us in discussing the bright future of RL and Video Games!

04.06.2025 13:48 ๐Ÿ‘ 5 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

โ€œA delayed paper is eventually good; a bad paper is forever badโ€
- Shigeru Miyamoto

One more week to submit to our amazing RL and video games workshop!

31.05.2025 20:06 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
a video game shows a checkered floor and a few players ALT: a video game shows a checkered floor and a few players

โ€ผ๏ธ Two days left to submit your contributions for our workshop!

Working on RL and video games? Join us! We will have amazing speakers, cool events and a ๐ŸŽฎspecial topical๐ŸŽฎ best paper award prize!

โŒ› Paper Submission Deadline: May 30th

Find out more here: sites.google.com/view/rlvg-wo...

28.05.2025 08:23 ๐Ÿ‘ 3 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Fantastic work on general utility MDPs by @pedrosantospps.bsky.social!

You can find a summary of the paper in his account (go follow him as well!).

27.05.2025 15:03 ๐Ÿ‘ 1 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
a couple of cartoon characters standing next to each other in a desert . ALT: a couple of cartoon characters standing next to each other in a desert .

One week left to submit your contributions for our workshop! โฐ๐ŸŽฎ

We welcome submissions on video games to benchmark open problems in RL and in applications of RL for video game development!

โŒ› Paper Submission Deadline: May 30th

Find out more here: sites.google.com/view/rlvg-wo...

23.05.2025 13:48 ๐Ÿ‘ 4 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
sonic the hedgehog is standing in front of a waterfall in a video game scene . ALT: sonic the hedgehog is standing in front of a waterfall in a video game scene .

Running out of time to submit your contributions for our workshop!

We welcome submissions on video games to benchmark open problems in RL and in applications of RL for video game development!

โŒ› Paper Submission Deadline: May 30th

Find out more here: sites.google.com/view/rlvg-wo...

13.05.2025 07:46 ๐Ÿ‘ 7 ๐Ÿ” 3 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

Happy to share that our paper "The Number of Trials Matters in Infinite-Horizon General-Utility Markov Decision Processes" got accepted as a spotlight poster at the International Conference on Machine Learning (ICML).

03.05.2025 08:34 ๐Ÿ‘ 5 ๐Ÿ” 1 ๐Ÿ’ฌ 2 ๐Ÿ“Œ 0
Preview
Human-Aligned Image Models Improve Visual Decoding from the Brain Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the represent...

๐ŸŽ‰Excited to share that our paper "๐‡๐ฎ๐ฆ๐š๐ง-๐€๐ฅ๐ข๐ ๐ง๐ž๐ ๐ˆ๐ฆ๐š๐ ๐ž ๐Œ๐จ๐๐ž๐ฅ๐ฌ ๐ˆ๐ฆ๐ฉ๐ซ๐จ๐ฏ๐ž ๐•๐ข๐ฌ๐ฎ๐š๐ฅ ๐ƒ๐ž๐œ๐จ๐๐ข๐ง๐  ๐Ÿ๐ซ๐จ๐ฆ ๐ญ๐ก๐ž ๐๐ซ๐š๐ข๐ง" has been accepted to #ICML2025!

๐Ÿ”— Preprint Link: arxiv.org/abs/2502.03081

Huge thanks to my co-authors!

02.05.2025 09:23 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Post image

This year I am co-organizing the 8th iteration of the Tractable Probabilistic Modeling #TPM workshop at #UAI2025 ๐ŸŒด Rio de Janeiro edition ๐ŸŒด

๐ŸŒ lnkd.in/dDK8T5Au
โฐ Submission deadline: May 23th AoE
๐ŸŒด Date: July 15th

๐Ÿงต๐Ÿ‘‡

30.04.2025 10:54 ๐Ÿ‘ 16 ๐Ÿ” 9 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 2

Join us at the Reinforcement Learning Conference 2025 for a Workshop on Reinforcement Learning and Video Games, celebrating a decade since the Atari Nature paper ๐ŸŽฎ ๐Ÿ•น๏ธ

Check out our webpage for more information: sites.google.com/view/rlvg-wo...

15.04.2025 16:08 ๐Ÿ‘ 2 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Itโ€™s been 10 years since the Atari DQN Nature paper! What better way to celebrate this milestone than with a dedicated workshop on RL and Video Games at @rl-conference.bsky.social? ๐ŸŽฎ๐ŸŽฎ

Join us to discuss how video games can be used to address fundamental RL problems and how RL can be used in Games!

15.04.2025 11:28 ๐Ÿ‘ 3 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

The reply-all button should be banned.

Especially when organization-wide mailing lists are in CC.

Rant over.

14.04.2025 13:20 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

The acknowledgement check for ICML reviews is a bit like global warming.

We see it, we promise we will change, but, in the end, nothing happens.

03.04.2025 15:52 ๐Ÿ‘ 8 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

So happy to finally see @kthuniversity.bsky.social in Bluesky!

Hope more European universities follow suit and expand their academic and research presence here.

18.03.2025 08:49 ๐Ÿ‘ 14 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
Preview
Andrew Barto and Richard Sutton are the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. Andrew Barto and Richard Sutton as the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. In a series of papers beginning...

Today is a historical day for the RL community (another one!).

Congratulations to Andrew and Rich! Well deserved!

awards.acm.org/about/2024-t...

05.03.2025 14:47 ๐Ÿ‘ 8 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0
RLC Keynote speakers: Leslie Kaelbling, Peter Dayan, Rich Sutton, Dale Schuurmans, Joelle Pineau, Michael Littman

RLC Keynote speakers: Leslie Kaelbling, Peter Dayan, Rich Sutton, Dale Schuurmans, Joelle Pineau, Michael Littman

Some extra motivation for those of you in RLC deadline mode: our line-up of keynote speakers -- as all accepted papers get a talk, they may attend yours!

@rl-conference.bsky.social

24.02.2025 11:16 ๐Ÿ‘ 38 ๐Ÿ” 10 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

Iโ€™m attending #NeurIPS in Vancouver from Tuesday to Sunday.
Iโ€™ll be presenting our paper โ€œAmplified Early Stopping Bias: Overestimated Performance with Deep Learningโ€ in the Scientific Methods for Understanding Deep Learning Workshop.
Letโ€™s meet especially if you are interested in Neuroscience!

11.12.2024 02:38 ๐Ÿ‘ 6 ๐Ÿ” 1 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 1

This work wouldnโ€™t be possible without our fantastic collaborators:
- Francisco S. Melo (Instituto Superior Tรฉcnico, Lisbon)
- Antรดnio H. Ribeiro (Uppsala University)
- Marten Bjรถrkman (KTH)
- Danica Kragic (KTH), whoโ€™s also giving a keynote at #NeurIPS2024!

11.12.2024 17:30 ๐Ÿ‘ 5 ๐Ÿ” 0 ๐Ÿ’ฌ 0 ๐Ÿ“Œ 0

Nona (@nonar.bsky.social) will present our workshop paper "Amplified Early Stopping Bias: Overestimated Performance with Deep Learning". A critical look at early stopping in low-data regimes.

Thread: bsky.app/profile/nona...
Poster: neurips.cc/virtual/2024...
Paper: openreview.net/forum?id=wbU...

11.12.2024 17:30 ๐Ÿ‘ 5 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0

Bernardo (@esteveste.bsky.social) will present NeuralSolver, our new approach to learn decision-making algorithms that scale to large inputs at test time.

Thread: bsky.app/profile/este...
Poster: neurips.cc/virtual/2024...
OpenReview: openreview.net/forum?id=IxR...

11.12.2024 17:30 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0
Preview
Can Transformers Smell Like Humans? The human brain encodes stimuli from the environment into representations that form a sensory perception of the world. Despite recent advances in understanding visual and auditory perception...

Farzaneh (@farzaneh-taleb.bsky.social) will present our spotlight paper "Can Transformers Smell Like Humans?". We explore the alignment between human olfactory perception and foundation model representations.

Poster: neurips.cc/virtual/2024...
Paper: openreview.net/forum?id=3f8...

11.12.2024 17:30 ๐Ÿ‘ 0 ๐Ÿ” 0 ๐Ÿ’ฌ 1 ๐Ÿ“Œ 0