Representational Momentum Transcends Motion
Dillon Plunkett & Jorge Morales (2025) Psychological Science
When we see something that's moving, our memories about it end up projected forward in time: We remember it further along than it was. In a new paper in ππ΄πΊπ€π©π°ππ°π¨πͺπ€π’π ππ€πͺπ¦π―π€π¦, out today and led by @dillonplunkett.bsky.social, we demonstrate that this happens even when there is π£π€ π’π€π©ππ€π£ π¬πππ©π¨π€ππ«ππ§.π§΅
09.12.2025 15:37
π 145
π 52
π¬ 10
π 8
It has been so so fun to think with some of my favorite scientists about what it means to understand!
26.11.2025 17:08
π 54
π 9
π¬ 0
π 1
Vase with Irises - 1890
https://botfrens.com/collections/46/contents/15543
31.10.2025 18:15
π 97
π 19
π¬ 1
π 2
New paper titled "Tracing the Representation Geometry of Language Models from Pretraining to Post-training" by Melody Z Li, Kumar K Agrawal, Arna Ghosh, Komal K Teru, Adam Santoro, Guillaume Lajoie, Blake A Richards.
LLMs are trained to compress data by mapping sequences to high-dim representations!
How does the complexity of this mapping change across LLM training? How does it relate to the modelβs capabilities? π€
Announcing our #NeurIPS2025 π that dives into this.
π§΅below
#AIResearch #MachineLearning #LLM
31.10.2025 16:19
π 60
π 12
π¬ 1
π 4
A gradient of complementary learning systems emerges through meta-learning
Long-term learning and memory in the primate brain rely on a series of hierarchically organized subsystems extending from early sensory neocortical areas to the hippocampus. The components differ in t...
Excited to share a new preprint w/ @annaschapiro.bsky.social! Why are there gradients of plasticity and sparsity along the neocortexβhippocampus hierarchy? We show that brain-like organization of these properties emerges in ANNs that meta-learn layer-wise plasticity and sparsity. bit.ly/4kB1yg5
16.07.2025 16:15
π 64
π 25
π¬ 0
π 3
https://tinyurl.com/heavyrnn
Connectome suggests brainβs synaptic weights follow heavy-tailed distributions, yet most analyses of RNNs assume Gaussian connectivity.Β
π§΅β¬οΈ Our @alleninstitute.org #NeurIPS2025 paper shows heavy-tailed weights can strongly affect dynamics, trade off robustness + attractor dimension.
30.10.2025 14:54
π 31
π 7
π¬ 3
π 2
**Discovering network dynamics**
One more on estimating dynamics of complex systems, this time with symbolic regression
doi.org/10.1038/s435...
30.10.2025 16:57
π 20
π 3
π¬ 0
π 0
This image combines 50 x 1" exposures, ISO 800, obtained with my CANON 5D Mark III attached at primary focus of my Skywatcher Black Diamond 80mm f600mm (F/7.5) during the Total Lunar Eclipse on Wednesday 26 May 2021, between 9:00pm and 9:04pm, Sydney local time.
The frames were manually aligned with Photoshop, then extracted as new frames to Lynkeos, that did the fine alignment. Drizzling x2 was also used. Then the combined image was taken to Photoshop, where the colour, highlights/shadows, and contrast were tuned. This got only the image of the eclipsed moon.
Additionally, I combined the full 266 x 1" images I took during totality using Siril to get the stellar background.
They two combined frames (eclipsed moon + stars) were combined with Photoshop with a bit of extra tuning to get a nice background.
The image taken at 9:03pm was used as reference for the alignment.
All the data were taken during the 4 hours ONLINE event "Conversaciones astronΓ³micas bajo la luna eclipsada" that I organised with the "Red Andaluza de AstronomΓa" (RAdA), "AgrupaciΓ³n AstronΓ³mica de CΓ³rdoba" (AAC), "AsociaciΓ³n de Lengua y Cultura EspaΓ±ola" (ALCE) de Australia and the "Spanish Researchers in Australia-Pacific" (SRAP-IEAP), that was followed by many schools in Spain.
I also want to thank Alicia Lozano (RAdA), HΓ©ctor Socas-Navarro (Instituto de AstrofΓsica de Canarias), MarΓa Ribes (Universidad de Alicante) and Alberto Aparici (In...
Total Lunar Eclipse - 26 May 2021 - From Γngel LΓ³pez-SΓ‘nchez - https://flic.kr/p/2m1PLyZ
16.10.2025 04:00
π 144
π 16
π¬ 1
π 1
A photo of the short story Everything and Nothing by Jorge Luis Borges, printed in a book.
A photo of the short story Everything and Nothing by Jorge Luis Borges, printed in a book.
A photo of the short story Borges and I by Jorge Luis Borges, printed in a book.
A photo of the short story On Exactitude in Science by Jorge Luis Borges, printed in a book.
Jorge Luis Borges
16.10.2025 04:18
π 3
π 1
π¬ 0
π 0
Happy birthday Kay Sage. The artist & poet, famous for her surrealist paintings, often referencing architecture & the built environment, was born today in 1898. #surrealism
25.06.2025 17:13
π 7
π 1
π¬ 0
π 0
The Eye of Silence
The Eye of Silence https://www.wikiart.org/en/max-ernst/the-eye-of-silence-1943
09.10.2025 15:31
π 16
π 9
π¬ 0
π 1
What do we talk about when we talk about "readout"?
I argued that our overly specialized, modular approach to studying the brain has given us a simplistic view of readout.
π§ π
13.10.2025 15:15
π 21
π 4
π¬ 1
π 0
A huge prominence erupted from the eastern limb of the Sun today, forming this towering wall of plasma around 8pm CST on October 26, 2010. The pale circle shows the size of Earth in comparison!
Image has been rotated 90ΒΊ ccw from the original.
See a video of this region in action here www.flickr.com/photos/lightsinthedark/5149863234/
Courtesy SDO (NASA) and the AIA consortium. Edited by J. Major.
Solar Dynamics Observatory main site: sdo.gsfc.nasa.gov/
www.lightsinthedark.com
Prominence 10-26-10 - From Jason Major (jpmajor.bsky.social) - https://flic.kr/p/8NkYgk
14.10.2025 09:00
π 89
π 15
π¬ 0
π 0
Credit: ESA/Rosetta/NAVCAM, CC BY-SA IGO 3.0 - Processing: Elisabetta Bonora & Marco Faccin / aliveuniverseimages.com
ESA ROSETTA 14 July 2015 - From 2di7 & titanio44 - https://flic.kr/p/vpqn2z
15.10.2025 09:00
π 33
π 8
π¬ 0
π 1
Mimas and Epimetheus captured along the main rings. This natural color narrow-angle image shows just how much darker the unlit side of the rings is compared to icy moons.
Mimas, Epimetheus and Rings - From Gordan UgarkoviΔ (ugordan.bsky.social) - https://flic.kr/p/5oPunj
15.10.2025 13:00
π 146
π 22
π¬ 0
π 0
Replace Variational Autoencoder (VAE) with pretrained representation encoders (e.g., DINO, SigLIP, MAE) paired with trained decoders, which they terms as Representation Autoencoders (RAE).
15.10.2025 03:49
π 18
π 3
π¬ 1
π 1
Preprint Alert π
Can we simultaneously learn transformation-invariant and transformation-equivariant representations with self-supervised learning?
TL;DR Yes! This is possible via simple predictive learning & architectural inductive biases β without extra loss terms and predictors!
π§΅ (1/10)
14.05.2025 12:52
π 51
π 16
π¬ 1
π 5
So excited to see this preprint released from the lab into the wild.
Charlotte has developed a theory for how learning curriculum influences learning generalization.
Our theory makes straightforward neural predictions that can be tested in future experiments. (1/4)
π§ π€ π§ π #MLSky
30.09.2025 14:35
π 40
π 9
π¬ 3
π 0
Tomorrow the next meeting of MIT #Consciousness Club. This is a Zoom link πβ¬οΈ
15.10.2025 21:38
π 3
π 2
π¬ 0
π 0
Correct me if I'm off base here, but the speaker's idea of an "intelligible theory" sounds a lot like an extended intuition pump a la Dennet. I'm wondering in particular what he means when he says understanding doesn't require true theories (what's a "true theory", anyway? all models are wrong etc.)
16.10.2025 03:18
π 1
π 0
π¬ 1
π 0
engage with art on a human level. It makes for better science. After all, the process of discovery is not like the deductive thing that ends up in the paper. And finally it goes without saying that it's preferable to have our top experts stay in touch with the human experience. π
15.10.2025 22:23
π 0
π 0
π¬ 0
π 0
I don't think science will ever "explain" the qualia of artistic experience, but I think there are many layers before we hit that ceiling that we have as yet not explored, that science can meaningfully address. This to me is independent of its being desirable for scientists to
15.10.2025 22:23
π 0
π 0
π¬ 1
π 0
I think it may be possible to understand why playing with certain visual principles "tickles the brain" (maybe it's similar to the 'aha' moment when grasping a metaphor?) as well as why the artistic medium carries the signal better to another mind than does a very accurate, dry representation.
15.10.2025 22:23
π 1
π 0
π¬ 1
π 0
translates it into something that can induce some version of that experience in another person (the viewer). Understanding visual perception is only one small part -- for example, what is engaging about an impressionist work vs something like a journalistic photograph or a diagram of the same scene?
15.10.2025 22:23
π 0
π 0
π¬ 1
π 0
While I deeply agree with this last post, I think the bit about intuitive understanding of visual perception doesn't mean impressionists are reduced to amateur neuroscientists. Rather, art (not exclusively visual art) takes some experience of the world meaningful to the artist and
15.10.2025 22:23
π 0
π 0
π¬ 1
π 0
Max Ernst Showing a Young Girl the Head of his Father
Max Ernst Showing a Young Girl the Head of his Father https://www.wikiart.org/en/max-ernst/max-ernst-showing-a-young-girl-the-head-of-his-father
13.10.2025 11:54
π 14
π 4
π¬ 0
π 0
Cielo di piombo, ispettore Callaghan...
05.10.2025 11:44
π 22
π 2
π¬ 0
π 0
Jour...sur la grève
08.10.2025 21:14
π 24
π 4
π¬ 1
π 0