Leonie Vogelsmeier

📢 Call for Papers:
We’re excited to announce an upcoming Psychometrika Special Issue on Data Intensive Methods in Psychometrics (think of using many datasets for methodological development), guest edited by @klint.bsky.social, @kyliegorney.bsky.social, @jmbh.bsky.social, Ben Domingue, and me.

Great new paper led by @bringmannlaura.bsky.social, highlight the need to collect qualitative data in ESM / EMA research.

#PsychSciSky 🧪

www.nature.com/articles/s44...

🤓
@bringmannlaura.bsky.social @katiehoemann.bsky.social @grgudmundsdottir.bsky.social @leonieschorrlepp.bsky.social
@eeskevanroekel.bsky.social @melissadesmet.bsky.social
@charlottev.bsky.social @joannemchung.bsky.social @mariestadel.bsky.social @oliviajkirtley.bsky.social @mieronen.bsky.social

Perspective:
Open-ended responses can improve ESM data by grounding it in real-world experiences and phenomena as they are experienced in everyday life. Handbooks and guidelines on ESM should include sections on collecting and analyzing open-ended text items.
www.nature.com/articles/s44...

Leonie Vogelsmeier Research Visit Oslo 2025

From an inspiring research visit with Esther Ulitzsch in Oslo to a shared-first-author preprint: Likert vs VAS in EMA: Likert scales may come with reduced capacity to sustain attentiveness osf.io/preprints/ps... with D.Vollbracht, L.Zhang, A.J.Martínez, B.W.Domingue, @jmbh.bsky.social & T.Lischetzke

Diagram showing four phases of methodological research (Theory, Exploration, Systematic Comparison, Evidence Synthesis) with an arrow indicating that preregistration usefulness increases from early to late phases. Each phase lists its aim, elements, outcome, and an example from factor retention research.

Does it make sense to preregister simulation studies?
This question has sparked a lot of debate.

▶️We* work through the why, when, and how
▶️We discuss different phases of methodological research to clarify where preregistration might (or might not) add value

📝 Preprint: doi.org/10.31234/osf...

Congratulations, Shirley! 🎉

Congratulations, Manuel!🏆 Proud supervisor moment when your PhD student beats you at the yearly @tesc-tilburgu.bsky.social Experience Sampling Quiz. Thanks for all the fun questions @joranjongerling.bsky.social!

📢 Call for Papers:
We’re excited to announce an upcoming Psychometrika Special Issue on Data Intensive Methods in Psychometrics (think of using many datasets for methodological development), guest edited by @klint.bsky.social, @kyliegorney.bsky.social, @jmbh.bsky.social, Ben Domingue, and me.

MITNB

Timescales Hackathon Group MITNB

Leonie Vogelsmeier

Thanks #MITNB for organizing this wonderful event and to everyone who joined the hackathons, discussions, and social events. It was exciting to see colleagues from around the globe think critically about measurement in ESM. I'm grateful to have been invited to give a workshop on careless responding.

What a week! After 5 days, the #mitnb workshop has come to an end. We had a keynote on time scales and two workshops on careless responding and reliability. The central part of the workshops were the hackathons. We had super diverse hackathons, all designed to assess measurement in #ESM. (1/4)

Participants of the MITNB workshop, where we stand outside in a group of around 40 people

1st day of #MITNB meeting at @tesc-tilburgu.bsky.social. Excited for the week ahead, where we'll tackle measurement issues in #ESM, e.g. modeling processes across timescales, building a formal theory on measurement, and evaluating statistical assumptions in #ESM data.
Go teamwork <3

We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python

Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...

Do you have ecological momentary assessment data and want to model between-group differences in the dynamics of psychological constructs in the presence of measurement non-invariance? Then check out the new preprint by Manuel, who presents a novel step-wise approach in R.
osf.io/preprints/ps...

Amazing! Congratulations, Omid! 🎉

As additional spotlight: what I meant was the other work by @jmbh.bsky.social together with Anja Ernst: osf.io/preprints/ps...
"Modeling Qualitative Between-Person Heterogeneity in Time-Series using Latent Class Vector Autoregressive Models"
Thus, lots of novel ESM methods (even in R) to dive into!

Grateful for the collaboration with our huge team @bsiepe.bsky.social, Esther Ulitzsch, @gudruneisele.bsky.social, Joran Geeraerts, Adam Klocek, Ricarda K. K. Proppert, Carlotta Rieble, Rayyan Tutunji, @dejonckheeregon.bsky.social, Peter Kuppens, and @eikofried.bsky.social

🚨 New preprint: We compared 13 methods for detecting momentary careless responding in the WARN-D data (206k+ obs.). Tutorials guide you through each method. The takeaway? Diverging results, inherent subjectivity (to varying degrees), and a clear need for further validation.
osf.io/preprints/ps...

Delving Into the Psychology of Machines: Exploring the Structure of Self-Regulated Learning via LLM-Generated Survey Responses Large language models (LLMs) offer the potential to simulate human-like responses and behaviors, creating new opportunities for psychological science.…

New paper: In the context of self-regulated learning, if LLMs reliably simulated survey responses, they could be used to test interventions, refine theoretical models, & augment sparse datasets; but the psychometric validity of the responses depends on the LLM. www.sciencedirect.com/science/arti...

I'm excited that our preregistration template for simulation studies is now available on OSF!
See below for a brief interview with the Center for Open Science about the template and why we created it..

Thrilled to share that this paper has now been published on Psychological Methods. See 🧵 below for an intro & shinyapp to view the results, as well as non-paywalled version. dx.doi.org/10.1037/met0...

📣New Preprint Alert!

Esther Maassen meticulously simulated the effect of p-hacking and publication bias on effect size & heterogeneity estimates.

💡bad: selective outcome reporting & optional dropping
💡bad: publication bias
💡not so bad: optional stopping/outlier removal

osf.io/preprints/ps...

Self-control in daily life is more than willpower — but how well do commonly used trait scales capture this recent, broader view on self-control?

New preprint with @kaihorstmann.bsky.social & @mhennecke.bsky.social: osf.io/preprints/ps...
Short summary below.

Delving Into the Psychology of Machines: Exploring the Structure of Self-Regulated Learning via LLM-Generated Survey Responses Large language models (LLMs) offer the potential to simulate human-like responses and behaviors, creating new opportunities for psychological science. In the context of self-regulated learning (SRL), ...

New preprint🤓 LLMs have great potential in the educational context! If LLMs reliably simulate survey responses, they could be used to test intervention scenarios, represent hard-to-reach populations, etc. But are generated survey responses psychometrically valid? It depends. arxiv.org/abs/2506.13384

Join me at the University of Witten/Herdecke for research on meta scientific topics, replication work or other fun things :-) as well as teaching some IMO wonderful students
short.sg/j/56902143

📢Job ad
Postdoc position (full-time, 3 years) in the DFG project Reliability in Intensive Longitudinal Data in Aachen (topics: psychometrics, intensive longitudinal data / ambulatory assessment data)
www.rwth-aachen.de/go/id/kbag/f...
Application deadline is June 16

British Journal of Mathematical and Statistical Psychology | Wiley Online Library Psychological concepts are increasingly understood as complex dynamic systems that change over time. To study these complex systems, researchers are increasingly gathering intensive longitudinal data...

I’m really excited to share that our first article has been published in the Br. J. Math. Stat. Psychol. doi.org/10.1111/bmsp...

In this paper, we evaluate and compare different non-parametric approaches for modeling non-linearity in psychological intensive longitudinal data.

Executive Functions and Emotional Granularity: No Evidence for Positive Associations - Affective Science Emotional granularity is the ability to experience one’s emotional experiences in a nuanced and specific manner. According to the theory of constructed emotion, between-person differences in emotional...

New paper out on testing potential cognitive foundations of emotional granularity/emotion differentiation. In contrast to what we expected, we found no associations between executive functions and granularity.

link.springer.com/article/10.1...

British Journal of Mathematical and Statistical Psychology | Wiley Online Library Psychological concepts are increasingly understood as complex dynamic systems that change over time. To study these complex systems, researchers are increasingly gathering intensive longitudinal data...

The first article by our PhD student @janfailenschmid.bsky.social is now published in the Br. J. Math. Stat. Psychol. doi.org/10.1111/bmsp...
He evaluated non-parametric approaches and their applicability to modeling non-linear psychological processes in intensive longitudinal data #proudsupervisor

We still enjoyed your recorded presentation very much, Jonas! The code is incredibly useful for EMA research.