Michèle Nuijten

Thanks to everyone that was interested in my poster for the great conversations and discussions!

The preprint on reporting, open science, and trustworthiness in simulation studies is available here: osf.io/jn9sy_v2

Ready for day two of #PSE8!

Well at least it's honest 😅 the worst ones are where data is promised and then they pretend you're insane if you ask for them

And the best part is: it doesn't matter what's *in* the data statement and whether or not that corresponds to reality 😀

Ughhh

"Data will be made available for ANY purpose."

Oh but also: "Researchers from other research teams will be expected to submit a project proposal to the study Chief Investigator (first author) to request access to trial
data."

And also: no.

?????

#metascience #metaresearch #openscience #psychology #science #opendata

@jamapsychiatry.com I'm looking at you... 👀

I wrote a blog for the Meta-Research Center expressing my infinite frustration about not getting data. What else is new, you might think? Well, I added an extra layer of annoyance directed at the journals who do NOTHING to enforce promised data sharing.

metaresearch.nl/blog/2026/2/...

I haven't! Cool idea :) The main obstacle for me was the text extraction. I guess that once you have the ES & CIs, you can check all sorts of things (is the CI symmetrical? is the ES even *in* the CI?)

This looks great!! Will the talks also be recorded?

PSE8 Visit the post for more.

Sign up now for the Perspectives on Scientific Error Conference (PSE) on 11 - 13 Feb in Leiden, the Netherlands

We will be hosting a mentor-mentee lunch during the conference. Sign up, and you will be matched to another academic based on shared research interests!

Don't miss out! See you there 🙌

#metascience #metaresearch #psychology #measurement #methodology #preprint

We call for systematic validation of psychological measurement instruments, reuse of validated measures, and clear measurement reporting standards.

Also, when you want to replicate a study, check if the original measure is valid(ated). If not... what are you even comparing?

Around half (!!!) the measures in our sample were single-item measures. This may signal a very real issue for construct validity.

Fig shows recalculated reliability coefficients across labs. Blue triangles indicate reported reliability. Notice that reliability is mainly reported if recalculated reliability was high?

We looked at 77 measures from Many Labs replications and their respective original studies.

Only 5% of the original studies reported sufficient measurement information vs. 46% of replications.

This affects the assessment of construct validity & hampers close replication.

📣Revised preprint by @cas-goos.bsky.social

Measurement reliability, validity, and reporting in psychology still has a long way to go...

We compared original studies w replications, and where possible recalculated reliability & unidimensionality.

Some findings >

osf.io/preprints/ps...

Congratulations!

INSPECT-SR: a tool for assessing trustworthiness of randomised controlled trials The integrity of evidence synthesis is threatened by problematic randomised controlled trials (RCTs). These are RCTs where there are serious concerns about the trustworthiness of the data or findings....

www.medrxiv.org/content/10.1...

INSPECT-SR: A tool for assessing trustworthiness of randomised controlled trials.

Care about #reproducibility in research & publishing? Join this webinar on Aug 27th, jointly organised by @aimosinc.bsky.social & @ausrepro.bsky.social on statistical reproducibility with @michelenuijten.bsky.social & @tomhardwicke.bsky.social Free - register here qut.zoom.us/meeting/regi...

The best way to protect the scientific record is to prevent stats errors from entering it in the first place! Two weeks 'til our webinar featuring @tomhardwicke.bsky.social & @michelenuijten.bsky.social. Register here: qut.zoom.us/meeting/regi...

Logos of AusRN and AIMOS and webinar announcement

Register now for the next joint @aimosinc.bsky.social @ausrepro.bsky.social webinar "Preventing statistical errors before publication" with Dr Michèle Nuijten and Dr Tom Hardwicke on Wed 27 Aug (4:00pm AEST).
@michelenuijten.bsky.social @tomhardwicke.bsky.social
qut.zoom.us/meeting/regi... 2/3

If you're interested in watching me gibber about papercheck for an hour, I'm giving a local seminar tomorrow at 15:00 UK time. DM me before 14:30 and I'll send you the Zoom link.

scienceverse.github.io/talks/2025-p...

sorry if I missed it, but is this Shiny app already online somewhere? would love to browse through an open science blog archive! :)

Super happy that I can finally move statcheck to another server! Thanks @seanrife.bsky.social for helping me out with this :)

While I'm setting everything up, there might be some hiccups at statcheck.io. You can still visit the stable michelenuijten.shinyapps.io/statcheck-web/ in the meantime.

If you loved all the discussions at #Metascience2025, this webinar from @ausrepro.bsky.social and @aimosinc.bsky.social will be just the thing. Register below ⬇️

I'll be presenting at the Metascience conference next week, who will I see there? 🙋‍♀️

PYMS has a new board and it is booming! Don't miss this session in London if you are an early career meta-scientist (or are interested in meta-science careers)!

Screenshot of the content of the Snakes and Ladders Metascience panel

We are looking forward to Metascience 2025 in London next week!

Especially to the panel where we will discuss PYMS! Come discuss career paths with us Monday 14:00 - 15:30:

Session 2, Panel T2.3; Snakes and ladders: mapping research careers

At Metascience 2025? Then come to our panel where wonderful @anoukbouma.bsky.social will talk about our work and vision at PYMS! 🚀