Call for Proposals: Data Collection for
Replication+Novel Political Science Survey Experiments
Alexander Coppock and Mary McGrath
January 27, 2026
We invite proposals for a survey experiment replication+novel design competition. Se-
lected replication+novel design survey experiments will be conducted on large samples of
American respondents, quota sampled to match U.S. Census margins and filtered for quality
and attention by the survey sample provider Rep Data (repdata.com).
Each proposal consists of two parts: (1) a replication study of an existing, previously
published survey experiment, and (2) a novel experimental design on a topic of the authors’
choosing.
The replication studies and reanalyses of the existing studies will be combined into a
meta-paper to be co-authored by all authors of accepted proposals along with the princi-
pal investigators (Coppock and McGrath). As a condition for acceptance, authors commit
to sharing the data and producing a write-up of the findings from their novel design for
submission to a scholarly journal, and public posting of a working paper pre-publication.
🎺 Call for proposals 🎺
1️⃣ replicate an existing experiment
2️⃣ run a novel experiment
on repdata.com
3️⃣ coauthor with Mary McGrath and me to meta-analyze the replications and existing studies
4️⃣ publish your study
details: alexandercoppock.com/replication_...
applications open Feb 1
please repost!
27.01.2026 22:16
👍 78
🔁 71
💬 0
📌 3
After years in academia, I’m exploring data science and research roles in industry.
I'm a quant. social scientist (PhD Yale ’24, NYU) focused on causal inference, experiments, and large-scale data.
Feel free to get in touch or share; all leads appreciated. dwstommes@gmail.com
27.01.2026 18:45
👍 31
🔁 20
💬 0
📌 0
Yes, I know I am late. Yes, I know the world is on fire. Sorry!
07.01.2026 20:09
👍 1
🔁 0
💬 0
📌 0
Looking for 1-2 papers (and maybe one more discussant) to put together an #APSA2026 panel proposal on recent methodological developments in surveys/experiments (can go either way). Feel free to reach out!
07.01.2026 20:08
👍 3
🔁 5
💬 2
📌 0
Texas Methods Conference 2026
Please answer the following questions to indicate your interest in attending and/or participating at our conference, which is scheduled to take place on Friday and Saturday, February 20-21, at Texas A...
Calling those looking to get feedback on their quant work📢: Join us at @TexasAM for TexMeth2026 this Feb. Great opportunity to connect with the regional community and showcase your research. The sun will still be strong for those coming from the north!🤝📊☀️
Apply: docs.google.com/forms/d/e/1F...
08.12.2025 17:45
👍 4
🔁 3
💬 0
📌 0
Shameless plug. We made a similar distinction a while ago: gustavodiaz.org/files/resear...
I appreciate the emphasis on the importance of intellectual origins and how they map to different goals. Sometimes people talk past each other because their training emphasizes one or the other more.
06.12.2025 01:40
👍 3
🔁 1
💬 1
📌 0
Currently in FirstView: In “Survey Professionalism: New Evidence from Web Browsing Data,” Bernhard Clemm von Hohenberg, @tiagoventura.bsky.social, Tiago Ventura, @jonathannagler.bsky.social, @ericka.bric.digital, & Magdalena Wojcieszak provide evidence on survey professionalism across three samples.
04.12.2025 18:05
👍 11
🔁 8
💬 1
📌 0
An Audit of Social Science Survey Experiments
Abstract. Survey experiments have become a popular methodology for causal inference across the social sciences. We study the efficacy of survey experiment
Needed - larger samples, more realism about (the lack of) heterogeneous treatment effects:
-"less than a third of proposed hypotheses were supported... the largest predictor of positive exp. results was sample size"
-"moderation hypotheses were rarely significant"
academic.oup.com/poq/advance-...
30.11.2025 15:16
👍 83
🔁 36
💬 4
📌 3
🏆APSA's Experimental Research Section Best Paper Award🏆
Did you present an experiment at APSA2026? Submit your conference paper for the Experimental Research Section's best paper award by April 15, 2026. @sumitra.bsky.social @talbotmandrews.bsky.social and I are excited to read your work!
28.10.2025 01:31
👍 2
🔁 4
💬 1
📌 0
Currently in FirstView: In “Balancing Precision and Retention in Experimental Design,” @gustavodiaz.org and Erin Rossiter study how experimental design choices can increase precision when estimating treatment effects. Specifically, they examine block-randomized and pre-post designs.
14.10.2025 16:35
👍 19
🔁 9
💬 1
📌 0
Just over one week to go before the September 16 deadline.
Excited to review the applications and engage with folks’ work!
08.09.2025 16:13
👍 2
🔁 1
💬 0
📌 0
Check out this fascinating paper by my colleagues Erin Rossiter and Jeff Harden. Such a cool design and interesting findings. Plus, Taylor!
29.07.2025 03:27
👍 15
🔁 6
💬 1
📌 0
“Balancing Precision and Retention in Experimental Design.”
Political Analysis, 2025, 1–10.
https://doi.org/10.1017/pan.2025.10008
Gustavo Diaz and Erin Rossiter
In experimental social science, precise treatment effect estimation is of utmost importance, and researchers can make design choices to increase precision. Specifically, block-randomized and pre-post designs are promoted as effective means to increase precision. However, implementing these designs requires pre-treatment covariates, and collecting this information may decrease sample sizes, which in and of itself harms precision. Therefore, despite the literature’s recommendation to use block-randomized and pre-post designs, it remains unclear when to expect these designs to increase precision in applied settings. We use real-world data to demonstrate a counterintuitive result: precision gains from block-randomized or pre-post designs can withstand significant sample loss that may arise during implementation. Our findings underscore the importance of incorporating researchers’ practical concerns into existing experimental design advice.
"We use real-world data to demonstrate a counterintuitive result: precision gains from block-randomized or pre-post designs can withstand significant sample loss that may arise during implementation."
@gustavodiaz.org & Erin Rossiter via @polanalysis.bsky.social doi.org/10.1017/pan....
23.07.2025 13:48
👍 6
🔁 2
💬 1
📌 0
The image displays the text "POLITICAL ANALYSIS" in bold white letters on a red background, above the hashtag "#FirstView" in white text, set against a yellow background.
#OpenAccess from @polanalysis.bsky.social -
Balancing Precision and Retention in Experimental Design - cup.org/44E5isE
- @gustavodiaz.org & Erin Rossiter
#FirstView
21.07.2025 10:45
👍 3
🔁 5
💬 0
📌 0
BJPolS abstract discussing the potential influence of a politician's gender on voter expectations and perceptions in Argentina, focusing on responses from an online survey experiment about a hypothetical city mayor.
From April 2025 -
Ignoring Women’s Performance: A Survey Experiment on Policy Implementation in Argentina - cup.org/4clGHLw
- @gustavodiaz.org, @viroliveros.bsky.social, Rebecca Weitz-Shapiro & Matthew S. Winters
#OpenAccess
16.06.2025 08:05
👍 5
🔁 5
💬 1
📌 0
The Experimental Research section of the American Political Science Association (@experimentsapsa.bsky.social) invites research proposals from post-prospectus PhD students for its Experimental Research Early-Career Fellowship program. Share this post! @apsa.bsky.social, @poscresearch.bsky.social
26.05.2025 15:39
👍 19
🔁 30
💬 0
📌 2
I'm super excited to be giving a tutorial at the useR conference (Duke) this summer!
Let me know if you're thinking about signing up, or if you'll be in Durham and want to chat over coffee.
I'd love to connect with other #Rstats enthusiasts!
20.05.2025 23:33
👍 21
🔁 4
💬 0
📌 0
hermione granger from harry potter is wearing a black sweater and a red tie and looking at the camera .
Alt: hermione granger from harry potter is wearing a black sweater and a red tie and looking at the camera .
Virtual and IRL in Ann Arbor seats still available for my @icpsrsummer.bsky.social workshop on Multilevel Modelling in the Social Sciences from July 7-11. It's 40 hours or a semester of content in just 5 days. Bring your project data! myumi.ch/JwM8e #SumProg25 #ICPSR
24.04.2025 20:58
👍 7
🔁 7
💬 0
📌 0
Thrilled to share my article “The Right Kind of (Gay) Man?” was accepted @thejop.bsky.social I started it as a 1st-year grad student, it became my MA, then a dissertation & job market paper. It’s the piece I’m most proud of (and relieved to finally share) 🏳️🌈 www.journals.uchicago.edu/doi/10.1086/...
16.05.2025 17:29
👍 69
🔁 17
💬 7
📌 3
Come work with me! McMaster is the best Canadian research university w/a medical school that you've never heard of™!
Though there are areas listed, the field is actually wide open! These Research Chairs come with research funding.
universityaffairs.ca/search-job/?...
12.05.2025 14:53
👍 17
🔁 9
💬 2
📌 3
Hey, I'm on the Casual Inference podcast this week!
I've been a massive fan of @lucystats.bsky.social and @epiellie.bsky.social since Episode 1 of Casual Inference. Talking to great experts (and conversationalists!) like them was a ton of fun.
Thanks so much for the invitation!
25.04.2025 11:48
👍 62
🔁 7
💬 1
📌 0
"It was derivatives all along"
24.04.2025 03:54
👍 2
🔁 0
💬 0
📌 0
Diaz, Gustavo, Virginia Oliveros, Rebecca Weitz-Shapiro, and Matthew S. Winters. “Ignoring Women’s Performance: A Survey Experiment on Policy Implementation in Argentina.” British Journal of Political Science 55 (2025): e54. https://doi.org/10.1017/S0007123424000668.
Abstract
How does a politician’s gender shape citizen responses to performance in office? Much of the existing literature suggests that voters hold higher expectations of women politicians and are more likely to punish them for malfeasance. An alternative perspective suggests that voters view men politicians as more agentic and are, therefore, more responsive to their performance, whether good or bad. Using an online survey experiment in Argentina, we randomly assign respondents to information that the distribution of a government food programme in a hypothetical city is biased or unbiased, and we also randomly assign the gender of the mayor. We find that respondents are more responsive to performance information – both positive and negative – about men mayors. We find little evidence that respondents hold different expectations of malfeasance by men versus women politicians. These results contribute to our understanding of how citizens process performance information in a context with few women politicians.
MUST READ new article from @gustavodiaz.org, @viroliveros.bsky.social, Rebecca Weitz-Shapiro & Matthew S. Winters via @bjpols.bsky.social
Ignoring Women’s Performance: A Survey Experiment on Policy Implementation in Argentina
doi.org/10.1017/S000...
#openaccess #polisky #NUResearch
04.04.2025 21:12
👍 14
🔁 7
💬 0
📌 0
BJPolS abstract discussing the potential influence of a politician's gender on voter expectations and perceptions in Argentina, focusing on responses from an online survey experiment about a hypothetical city mayor.
NEW -
Ignoring Women’s Performance: A Survey Experiment on Policy Implementation in Argentina - cup.org/4clGHLw
- @gustavodiaz.org, @viroliveros.bsky.social, Rebecca Weitz-Shapiro & Matthew S. Winters
#OpenAccess
02.04.2025 11:20
👍 6
🔁 6
💬 0
📌 1
Text describing a call for PhD applications at Western University in London, Ontario Canada
Please share! Have an MA student or current PhD student who wants/needs to get out of the US (or not go there)? Western is accepting PhD late apps. Info here: politicalscience.uwo.ca/graduate/gra...
Apply here: politicalscience.uwo.ca/graduate/pro...
Or contact Grad Chair: Cameron.Anderson@uwo.ca
06.03.2025 17:35
👍 11
🔁 9
💬 0
📌 1
Put me in, coach!
20.12.2024 03:31
👍 1
🔁 0
💬 0
📌 0
Thanks and sorry for the delay! It's a mix of topics ranging from causal inference to concept formation to fieldwork. There is already one discussant so you would split papers. If you email me at the address on my website I can tell you more.
14.11.2023 14:43
👍 1
🔁 0
💬 1
📌 0
Polisky! Still need one more!
10.11.2023 23:43
👍 3
🔁 3
💬 1
📌 0
Polisky! I'm looking for volunters for chair/discussant for a panel on fieldwork and qualitative methods for the next MPSA conference. Ping or email me if interested👀
09.11.2023 05:33
👍 10
🔁 10
💬 0
📌 1