"Mission: Impossible" was featured in Quanta Magazine! Big thank you to @benbenbrubaker.bsky.social for the wonderful article covering our work on impossible languages. Ben was so thoughtful and thorough in all our conversations, and it really shows in his writing!
14.01.2025 23:55
๐ 13
๐ 3
๐ฌ 0
๐ 0
Finding linguistic structure in large language models
YouTube video by Chris Potts
I've posted the practice run of my LSA keynote. My core claim is that LLMs can be useful tools for doing close linguistic analysis. I illustrate with a detailed case study, drawing on corpus evidence, targeted syntactic evaluations, and causal intervention-based analyses: youtu.be/DBorepHuKDM
13.01.2025 02:41
๐ 74
๐ 20
๐ฌ 1
๐ 3
What are the broad open problems in your view?
26.11.2024 05:05
๐ 0
๐ 0
๐ฌ 1
๐ 0
i am now going to write a massive reply that will have no effect on this score you have given me
25.11.2024 08:35
๐ 12
๐ 0
๐ฌ 1
๐ 0
hmm bluesky feed is 80% reviewing complaints. twitter is slightly better in this regard
25.11.2024 07:10
๐ 27
๐ 0
๐ฌ 2
๐ 0
LANGUAGE AND LINGUISTICS >
I was reading Tim Bodt's new book on Proto-Western Kho-Bwa while waiting for code to run
www.ling.sinica.edu.tw/item/en?act=...
very nice work
25.11.2024 03:45
๐ 6
๐ 0
๐ฌ 0
๐ 0
e.g. Proto-Western Kho-Bwa *nฬฅa-jสทa-kสฐa "chin" (> Khoina Sartang nyjukสฐu) seems to be composed of
- PWKB *nฬฅa- "lower face" < Proto-Sino-Tibetan *s-na ~ s-naหr
- ?PST *g(j/w)ar "cheek, chin, jaw"
- PST *m/s-k(w)a-j "mouth, opening"
very interesting derivational morphology strat
25.11.2024 03:45
๐ 5
๐ 0
๐ฌ 1
๐ 1
it's pretty interesting how (some?) Sino-Tibetan languages, when they historically underwent too much degradation through sound change, just decided to make compounds with synonymous elements or stick semantic prefixes on everything
25.11.2024 03:45
๐ 11
๐ 0
๐ฌ 1
๐ 0
The cat is the mech interp researcher right
24.11.2024 22:14
๐ 1
๐ 0
๐ฌ 1
๐ 0
@avzaagzonunaada.bsky.social
23.11.2024 12:35
๐ 2
๐ 0
๐ฌ 1
๐ 0
added ๐ซก
22.11.2024 01:06
๐ 1
๐ 0
๐ฌ 0
๐ 0
added ๐ซก
22.11.2024 01:06
๐ 1
๐ 0
๐ฌ 0
๐ 0
made this thing, reply to be added
go.bsky.app/AKGJ82V
22.11.2024 00:26
๐ 12
๐ 1
๐ฌ 6
๐ 0
sus
21.11.2024 20:11
๐ 1
๐ 0
๐ฌ 0
๐ 0
caleb is so cool pls follow
20.11.2024 06:28
๐ 5
๐ 0
๐ฌ 1
๐ 0
Title: "Characterizing the Role of Similarity in the Property Inferences of Language Models"
Authors: Juan Diego Rodriguez, Aaron Mueller, Kanishka Misra
Left figure: "Given that dogs are daxable, is it true that corgis are daxable?" A language model could answer this either using taxonomic relations, illustrated by a taxonomy dog-corgi, dog-mutt, canine-wolf, etc., or by similarity relations (dogs are more similar to corgis than cats, wolves or shar peis).
Right figure: illustration of the causal model (and an example intervention) for distributed alignment search (DAS), which we used to find a subspace in the network responsible for property inheritance behavior. The bottom nodes are "property", "premise concept (A)" and "conclusion concept (B)" , the middle nodes are "A has property P", "B is a kind of A", and the top node is "B has property P".
How do language models organize concepts and their properties? Do they use taxonomies to infer new properties, or infer based on concept similarities? Apparently, both!
๐ New paper with my fantastic collaborators @amuuueller.bsky.social and @kanishka.bsky.social
08.11.2024 21:40
๐ 109
๐ 22
๐ฌ 4
๐ 6
so true
14.11.2024 02:00
๐ 0
๐ 0
๐ฌ 0
๐ 0
the fact that you are posting here (and not there) has significantly increased my desire to use this platform
14.11.2024 01:29
๐ 4
๐ 0
๐ฌ 1
๐ 1
i do like my username here
14.11.2024 01:27
๐ 6
๐ 0
๐ฌ 0
๐ 0
wow i have so many followers here somehow, is it time to start posting here too
14.11.2024 01:26
๐ 14
๐ 0
๐ฌ 3
๐ 0
I decided what we need to make blueskAI happen is a feed. Reply here to get added to the whitelist! Whitelisted users can post to the feed by adding the following keywords to a post:
๐ค
bskAI
blueskAI
05.01.2024 15:56
๐ 43
๐ 18
๐ฌ 63
๐ 2
๐ฎ
05.01.2024 18:29
๐ 1
๐ 0
๐ฌ 0
๐ 0
Hey @noviscl.bsky.social should we start shitposting here too
05.01.2024 04:21
๐ 0
๐ 0
๐ฌ 0
๐ 0
lol I think we talked about it the first time I reviewed (SIGMORPHON)
27.11.2023 03:18
๐ 0
๐ 0
๐ฌ 0
๐ 0
There will never be a random Burushaski speaker from Pakistan in my mentions here
26.07.2023 10:10
๐ 8
๐ 0
๐ฌ 2
๐ 0
So Threads got all the AI influencer accounts. This seems to be getting more of the linguists. But I don't think anything will be like Twitter tbh
26.07.2023 10:09
๐ 7
๐ 0
๐ฌ 1
๐ 0
Do I really need to read more than 600 posts a day? The answer is apparently yes
01.07.2023 21:44
๐ 4
๐ 0
๐ฌ 0
๐ 0
South Asian ling twitter check in ๐ซก
01.07.2023 21:38
๐ 0
๐ 0
๐ฌ 0
๐ 0