When it’s cold I’m eepy when it’s hot I’m eepy. The eepydemic is real
24.04.2025 19:25
👍 0
🔁 0
💬 0
📌 0
When it’s cold I’m eepy when it’s hot I’m eepy. The eepydemic is real
Mentally I’m still at breakfast drinking my coffee
One coffee today
Excited to share our work with friends from MIT/Google on Learned Asynchronous Decoding! LLM responses often contain chunks of tokens that are semantically independent. What if we can train LLMs to identify such chunks and decode them in parallel, thereby speeding up inference? 1/N
