#errorcontrol

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

#statstab #234 Not all alphas can be justified

Thoughts: When using discrete distributions, with few outcomes, your alpha cannot always take the values you want. Same with the distribution of p-values under the null.

#pvalues #nhst #errorcontrol #alpha

osf.io/preprints/ps...

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

Post Hoc Power: Not Empowering, Just Misleading

#statstab #189 Post Hoc Power: Not Empowering, Just Misleading

Thoughts: "the observed power is a 1:1 function of the P value" If you need a ref for why "post hoc" power is nonsense (paywalled).

#power #posthoc #QRPs #errorcontrol #poweranalysis

www.sciencedirect.com/science/arti...

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

Are Multiple Contrast Tests Superior to the ANOVA? Multiple contrast tests can be used to test arbitrary linear hypotheses by providing local and global test decisions as well as simultaneous confidence intervals. The ANOVA- F -test on the contrary ca...

#statstab #186 Are Multiple Contrast Tests Superior to the ANOVA?

Thoughts: Focuses more on the statistical aspects of the comparison than the theoretical ones. But insightful for newbies.

#nhst #anova #ttest #errorcontrol
#typeI #pvalues

www.degruyter.com/document/doi...

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

Optimal test procedures for multiple hypotheses controlling the familywise expected loss We consider the problem of testing multiple null hypotheses, where a decision to reject or retain must be made for each one and embedding incorrect decisions into a real-life context may inflict diff....

#statstab #127 Optimal test procedures for multiple hypotheses controlling the familywise expected loss

Thoughts: Can't wait to see papers defining their own loss functions to control error rates 🙄.

#errorcontrol #typeI #NHST #pvalues #stats

onlinelibrary.wiley.com/doi/10.1111/...

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

#statstab #84 Using the data twice

Thoughts: A very good overview of conditional and unconditional inferences based on the modelling decisions we make. I can't say I've seen many discuss this.

#errorcontrol #inference #modelling #stats

www.alexpghayes.com/post/2020-05...

Dr Mircea Zloteanu 🌺🌞🍃

@mzloteanu.bsky.social

1 year ago

When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing - Synthese Scientists often adjust their significance threshold (alpha level) during null hypothesis significance testing in order to take into account multiple testing and multiple comparisons. This alpha adjus...

#statstab #74 When to adjust alpha during multiple testing: disjunction, conjunction, and individual testing by @RubinPsyc

Thoughts: Error control = NHST. But doing it right is a nightmare. This paper made sense to me.

#NHST #pvalues #errorcontrol

doi.org/10.1007/s112...