Kyle's Avatar

Kyle

@darsnack

NeuroAI Scholar @ CSHL https://www.darsnack.info 
 Previously maintaining FluxML to procrastinate

Previously EE PhD at UW-Madison, comp. eng. / math at Rose-Hulman

644
Followers
578
Following
117
Posts
02.08.2023
Joined
Posts Following

Latest posts by Kyle @darsnack

The Cowley Group at CSHL has an opening for a bioAI PhD student to start Fall 2026 to work on closed-loop AI models for visual processing (see below). You *must* have a Master's degree in a quant/eng/cs field.

www.cshl.edu/phd-program/...

Please reach out to me if interested!
I'll be at Cosyne.

09.03.2026 19:05 👍 12 🔁 10 💬 1 📌 1
Preview
Compact deep neural network models of the visual cortex Nature - Parsimonious deep neural network models can be used for prediction of visual neuron responses.

DNN models of the brain are getting bigger. Are we replacing one complicated system in vivo with another in silico?

In new work, we seek the *smallest* DNN models of visual cortex, balancing prediction with parsimony.

It turns out these compact models are surprisingly small!

rdcu.be/e5H8G

26.02.2026 22:32 👍 124 🔁 46 💬 3 📌 4
Post image

What arxiv.org/abs/2512.24873

07.03.2026 02:53 👍 30 🔁 5 💬 4 📌 1
google doesn't endorse marriage through differentiation for constants and exponentials

google doesn't endorse marriage through differentiation for constants and exponentials

"I'm a mathematical constant and my partner is an exponential function she insists we get differentiated but I am worried should I agree?"

24.02.2026 20:14 👍 46 🔁 13 💬 3 📌 0

I am here to torch every soft-focus retrospective on statesman and institutionalist Robin Vos. No one has done more to break the state of Wisconsin than this man.

23.02.2026 14:26 👍 50 🔁 5 💬 3 📌 1
Post image Post image Post image Post image
21.02.2026 17:09 👍 12 🔁 1 💬 1 📌 0
Video thumbnail

Here's a version that lets me look at individual layers and heads (a layer just being the mean of all of its heads). Notice some heads really care about specific tokens that others don't.

19.02.2026 13:16 👍 22 🔁 1 💬 2 📌 0

You wrote “average attention score as the prompt progresses” so I was just clarifying for myself average over what

19.02.2026 12:39 👍 0 🔁 0 💬 1 📌 0

So the opacity is a running average score?

19.02.2026 12:31 👍 0 🔁 0 💬 1 📌 0
Video thumbnail

What do LLMs see?

I wrote a lil' tool that extracts the attention matrices out of open models and creates this typing visual, with each token's opacity changing according to its average attention score as the prompt progresses. Dimmer words are considered less important to the model.

19.02.2026 12:14 👍 257 🔁 42 💬 17 📌 8
Screenshot of the vancouver metro area rendered by the Stamen Design water color tileset, and it's gorgeous. it looks like a real water color painting

Screenshot of the vancouver metro area rendered by the Stamen Design water color tileset, and it's gorgeous. it looks like a real water color painting

i just discovered Stamen's Watercolor tileset and it's just beautiful! I wish all maps where this beautiful.

Bring more whimsy and beauty to websites

15.02.2026 16:30 👍 80 🔁 7 💬 3 📌 0

We had this beautiful internet, and now it's filled with slop. Outside of my circles, I don't trust digital interactions with people, and I know they don't trust me either. (Some effects spill over into real life too.)

Was it worth it? Time will tell.

14.02.2026 17:16 👍 22 🔁 2 💬 0 📌 1
Preview
What happened to Science Goodreads and how do we rebuild it? A 65 million dollar question (at least) - CAIROS Blog The story of the rise and fall of Mendeley

1/ Finally wrote up “The Story of Mendeley”! Most people know the tool, few know about its rise and fall. The Mendeley story provides important clues for how to build self-sustaining AND non-extractive knowledge commons, which is why I think it deserves more attention 🧵

13.02.2026 20:55 👍 76 🔁 37 💬 6 📌 4

Highest quality content on here

13.02.2026 15:24 👍 1 🔁 0 💬 0 📌 0

On a lark, tested Opus 4.6 on a common academic task: take a 10k word article and shorten it to 6k words for submission to a new journal. I told it to use the command line tool texcount to count words given the known inability to count words. It failed in a fairly funny way…

12.02.2026 00:24 👍 12 🔁 2 💬 2 📌 0

And ML agrees! https://arxiv.org/abs/1803.03635 https://proceedings.neurips.cc/paper/2020/hash/322f62469c5e3c7dc3e58f5a4d1ea399-Abstract.html

09.02.2026 13:00 👍 3 🔁 1 💬 0 📌 0

And it’s not because of what scientists did. It is a political change that we did not ask for, nor control.

But now that is has happened, we can’t ignore it.

08.02.2026 14:04 👍 15 🔁 2 💬 1 📌 0
Scoop of ice cream in a shot of espresso, served in a wide-brimmed glass

Scoop of ice cream in a shot of espresso, served in a wide-brimmed glass

I'm starting (a)ffogato fridays. it's legal. it's legal for me to have ice cream in a shot of espresso at 9am on a friday. it's legal for me to have a little treat.

07.02.2026 04:07 👍 51 🔁 4 💬 6 📌 2
Post image Post image

Global warming discourse 10 years ago immunized me against predicting an end to long running trends on the basis of a few data points, because this little blip made people think global warming had stopped. Afterwards it wasn't even visible in the trend.

06.02.2026 19:05 👍 32 🔁 2 💬 1 📌 0
The Bluesky mute words panel showing “Waymo” muted for the next 24 hours

The Bluesky mute words panel showing “Waymo” muted for the next 24 hours

07.02.2026 13:56 👍 0 🔁 0 💬 0 📌 0

Network propagation on this site is fun. You can watch how misinformation spreads just scrolling through your feed. No sleuthing required.

07.02.2026 13:33 👍 0 🔁 0 💬 0 📌 0

Same for programming. One might say languages/communicating succinctly ≈ tool for thinking.

07.02.2026 00:21 👍 0 🔁 0 💬 0 📌 0

Elon's decision to shut down USAID is the direct cause of countless deaths. That he isn't persona non grata in many communities after that is a source of shame.

05.02.2026 15:19 👍 195 🔁 32 💬 1 📌 0

In almost all (all?) latent diffusion models, the VAE that sandwiches the diffusion model is not a real VAE: the KL loss has a weight of 10^-5 and there is an additional GAN loss that significantly boosts the visual quality. So it's more an adversarial auto-encoder than anything else.

03.02.2026 22:45 👍 4 🔁 1 💬 1 📌 0

Okay this JPL article has more details. It actually used image data as context which is pretty impressive!

https://www.nasa.gov/missions/mars-2020-perseverance/perseverance-rover/nasas-perseverance-rover-completes-first-ai-planned-drive-on-mars/

01.02.2026 14:40 👍 3 🔁 1 💬 0 📌 0

The output as markup makes sense, but what is the input context?

01.02.2026 14:34 👍 1 🔁 0 💬 1 📌 0

every epstein file drop underscores how elite power operates through shared socio-economic networks, regardless of people's ideological differences, populist posturing, or public feuds

30.01.2026 23:58 👍 30036 🔁 6539 💬 388 📌 308
Preview
How AI assistance impacts the formation of coding skills Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

This study by people from Anthropic itself should raise huge alarm bells about the use of AI in teaching how to code (and later on in coding itself, but esp. in the learning stage).

And remember: this is by the people who make Claude!

tl;dr: not that long, read it
www.anthropic.com/research/AI-...

31.01.2026 01:21 👍 40 🔁 9 💬 8 📌 3
Post image

good afternoon

31.01.2026 00:35 👍 12 🔁 1 💬 0 📌 1

Ah I see it does have a built-in labeler. Maybe adjusting these settings will help: https://bsky.app/profile/moderation.bsky.app

30.01.2026 17:31 👍 1 🔁 0 💬 0 📌 0