One underappreciated advantage of rule-based systems is that they were crappy enough that everyone could tell they were crap.
One underappreciated advantage of rule-based systems is that they were crappy enough that everyone could tell they were crap.
LMs need linguistics! New paper, with @futrell.bsky.social, on LMs and linguistics that conveys our excitement about what the present moment means for linguistics and what linguistics can do for LMs. Paper: arxiv.org/abs/2501.17047. ๐งตbelow.
a draft paper (for an invited talk at AAAI next month) with a philosophical analysis of work on mechanistic interpretability, with special attention to methods for propositional interpretability.
arxiv.org/abs/2501.15740
Correct link for my paper about LLMs and Language and Thought, that is probably wrong about most things, but maybe interesting.
Oops... here it is: danielrothschild.com/materials/la...
New Substack!
open.substack.com/pub/paulbloo...