the Rosicrucian Egyptian Museum is a fantastic collection of Egyptian artifacts curated by an unreliable narrator. they're subtle about their bias in the main collection, but in the Alchemy exhibit they strongly imply that they made certain scientific discoveries centuries before anyone else.
the intuition is that the softmax operation zeroes out any uniform change in the distribution, so if you propagate stuff down through the model so that it produces a uniform change in the output distribution, you don't have to pay any loss to dump your error term there.
(i do not know that this is a widely known result but i am presently using it as a wastebasket to dump quantization error into.)
so if something is injected into KV cache which causes a sudden spike in the Bayesian uncertainty channel the model can read it off later down the line
imo he just used the wrong seed
[smiling serenely] seeds are hyperparameters
i don't know that this is terribly bizarre. the model has a channel for dumping Bayesian uncertianty: the pseudoinverse of the ones vector in logit as pulled back through W_u. something closely approximating this appears to exist in even models with tied weights between the embedding and unembedding
it is very strange that we impose our own ideas about what the dignity of the dead required on people who wrote very explicit instructions all over their gravesites on that precise topic
like, the guy who the mummy used to be paid a huge proportion of his mortal wealth to make sure that the mortuary cult would take care of his immortal soul if his family forgot to. he would not understand the argument that he should not be visited and, in a sense, on display.
i do think that if you are going to put egyptian mummies on display, that the room they are in should at least have a Ka door, and that there should be food placed on the lintel. the Rosicrucian Museum has one of those upstairs in the Akhenaten exhibit and it changed my opinion on repatriation.
"feudalism was historically progressive" is a very common belief among people who claim to be Marxists
"everyone eats only because food is a very low-margin business and there's a vast global underclass of people doing work which _can't_ be more than seasonal" is a really, really bad thing and changing it will probably make people unemployed.
matthew yglesias' "sweatshops kill a lot of people, but they also help people get shein tank tops, so it's impossible to say whether it's good or not" article but woke
"aren't you worried about farmworkers." yes. primarily i am worried that they are doing backbeaking labor in the hot sun and we rely on an entire shadow economy which can feel free to abuse them essentially at will.
it's not that farming isn't important (i am eating a hot dog) but that no one does it. like the basic idea he has is that we live in an entirely circular economy where people only eat food because they are responsible for growing it. that's not real. i think that's from an early vic3 patchnote.
who even farms. this is, like, what a sumerian peasant would worry about
god it can just make an infinite amount of this stuff
jesus christ gemini i feel like this sign is an antipolish hate crime
lmao
the word "warfighter" has been rattling around my brain like a peanut for the past three weeks. it sounds like the name of a badly translated polish FPS which got 42% in PC Gamer
our brave warfighters know that the real brain is in the balls
Not directly related to this, but it reminds me of how many “you should really think about India more like you think about Europe in terms of scale and cultural variance” I’ve had in the last few years
we're going to win and we're going to make the people who did this to him pay
man this makes me tear up
i have read the word "eigendecomposition" so many times today that it no longer seems like a word. now i know how almost everyone else is lucky enough to live
it worked extremely well in 2024. people wanted trump and they got him
honestly by the 2050s we may have quantum computers capable of factoring keys as large as nine bits
it's vulnerable to shor's algorithm. you should look this up. it's pretty bad.
this is a topic i wish was respectable. (khazaria and what was going on there, not 'yiddish is a turkish dialect and ashkenazim are turks.')
