Seven Sketches in Compositionality: AnInvitation to Applied Category Theory by Brendan Fong and David Spivak.

Reading this as part of my work on Open Games.

chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://dspivak.net/7Sketches.pdf

#CategoryTheory #Compositionality #OpenGames

Measuring Additive Compositionality in Classic and Modern Embeddings

A new study’s two‑step framework shows Word2Vec retains linear signals, while transformer models’ compositionality peaks in middle layers then declines at top layer. getnews.me/measuring-additive-compo... #compositionality #word2vec #transformers

At IWCS soon, Matteo Radaelli shows 17 Norwegian LMs struggle to recover plausible covert events in complement coercion, in spite of positive (but not uniform across LMs) context effects 🤖💭 w/ Emmanuele Chersoni & Alessandro Lenci #compositionality #semantics
iwcs2025.github.io/program

Are you at #CoNLL2025 #ACL2025NLP? Check out Matteo Radaelli’s poster, showing 17 Norwegian LMs (BERT, GPT, LLAMA etc.) cannot reliably recover & rank plausible covert events in complement coercion 🤖💭 w/ Emmanuele Chersoni & Alessandro Lenci #compositionality
conll.org

Why is compositional generalization still such a hard problem for LLMs?
Compositionality requires mapping between two distinct representational spaces — often syntax and semantics.

But…
1/

#MetaAI #AIresearch #Compositionality

Key ideas:
• #EmergentReasoning — provably, no external logic engine needed.
• #GeometricLens — lift weights to a probability measure & watch training as a Wasserstein gradient flow; messy SGD turns into clean geometry.
• #Compositionality — small rules snap into big ones. (3/n)

Brilliant preprint by
@marcociapparelli.bsky.social
on compositionality in the semantic network. He used model-driven RSA to identify brain regions representing building blocks vs. compound meanings in concepts like cat-fish or cactus-beetle #compositionality #rsa Details below! 👇

In the Calls of Bonobos, Scientists Hear Hints of Language Hundreds of hours of recordings suggest that the apes can generate meaning by stringing sounds together in pairs. But some scholars are skeptical.

www.nytimes.com/2025/04/03/s...
#bonobos #compositionality
#primate-linguists

Check out Marco Ciapparelli’s recent PhD: ‘Multiple routes to conceptual combination: A distributional modeling approach’. It was a pleasure reading this awesome work. Congratulations to you + advisors Marco Marelli & Carlo Reverberi @ UniMi Bicocca #compositionality
boa.unimib.it/handle/10281...

Are you interested in #compositionality #analogy and #languageprocessing from a usage-based constructionist perspective? Then you can't miss my Element published with @cambridgeup.bsky.social . Don't miss the chance to get a free copy - only until the 14th!

A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices

Sania Sinha, Tanawan Premsri, Parisa Kordjamshidi

Action editor: Yonatan Bisk

https://openreview.net/forum?id=BXDxwItNqQ

#compositionality #compositional #ai

New #Survey Certification:

A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices

Sania Sinha, Tanawan Premsri, Parisa Kordjamshidi

https://openreview.net/forum?id=BXDxwItNqQ

#compositionality #compositional #ai

4yo to me: this is a police dog. You will be the police human.

#parenting #compositionality
#הורות