This. So many people get upset about this, but getting mad at chatGPT for "lying" to you is quite •literally• like getting mad at a magic 8 ball for giving an answer to your question that looked plausible but turned out to be wrong.
Cool paper about why we overestimate the size of minority groups!
From @brianguay.bsky.social, @tylermarghetis.bsky.social, Cara Wong, and @david-landy.bsky.social
www.pnas.org/doi/10.1073/...
I've always liked "a comathematician is a device for turning cotheorems into ffee" as an exceptionally opaque joke. You have to know BOTH category theory AND the source joke it's referencing, AND if you, it's hilarious.
Im a scientist directly because of this program--it got me my first actual skills and training, which absolutely got me my next job (thanks, IRAF), which got me to grad school...it was also an amazing research experience I could not have had otherwise. I'm gutted to see this.
I wrote an article on some of my dissertation research on the problem-solving power of prayer for @aeon.co and today it is published!
aeon.co/essays/why-p...
I'm proud of the article and it was fun to write for a non-academic outlet! 🤩
I think I disagree: given what ai systems are now, we are very far from accountability. But part of the whole point of science is to build theories which rely as little as possible on trust, but instead can be externally verified. The challenge is that that's hard to do with current ai systems.
I think the unfortunately fact that that seems to happen a lot is the valuable point I see you making, and, so stated, it seems right.
So I can use my own neural systems--but the validity of an interpretation can't hang on the mysteries. I can use integers--but not the truth of Goldbach's conjecture! I can use an ai system (of whatever sort), but not if my inferences hang on properties of it that I don't understand.
The distinction is between things involved in a research pipeline or pathway of developing an interpretation--which can and do involve all sorts of mysterious processes--and the chain of inferential tools which sustain and explicate an interpretation. Those should not involve mysterious properties.
I'm doing neither: I also point to the integers. They are pretty crucial to my pipelines, but I don't fully understand their properties (primes: complicated). None of the systems in my pipeline are ones I •fully• understand, which is my point here.
I think there is a valid concern here, but it's obscured. I don't •fully• understand my own mind, or those of my collaborators, but I use both for interpretation. I don't •fully• grock the integers. The problem arises when a conclusion hangs on the tool, not when it is used anywhere in a pipeline.
I mean, they can SAY anything. But they have interests that are competing, or at least the appearance, since the company's likelihood of funding future research may (at least) seem to depend on the results.
I know I'm a little late to the splash this YouGov made on BlueSky, but I want to talk about it!
The incoming 🔥hot take🔥 is: these errors are not a big deal!!!
We also did this earlier work, which I think was the prototype for the cross-question calibration approach: escholarship.org/content/qt0g..., but @brianguay.bsky.social would know more about any direct connection.
Oh sure sorry! That image is from, I believe, a yougov article which connects to (and links to) some of our work in this space. Lots of connected projects, but the original citation is this one: link.springer.com/journal/1342...
In other work we consistently find little relation to experienced fear or exposure. Other folks have found that correcting misperceptions doesn't change beliefs. So I think this phenomenon is largely unrelated to rampant transphobia.
As one of the authors of the meta review linked there, I'd respectfully disagree with this interpretation. People give systematically weird answers about proportions, yes. But that doesn't seem to have much to do with their experience of threat, fear, or even beliefs. It's about numbers being hard.
This is exactly the mix of feelings I think we have all felt doing this work! It's not exactly groundbreaking, but it seemed important.
This.
Trust me, I know that many of the students don’t do the reading and are finding other ways to skate by, but there are still so many that are so brilliant and so thoughtful, and so eager to learn, and it doesn’t seem that much different from when I was an undergrad TBH
