Below is a list of the key tests and techniques covered in the book:
GRIM
Granularity-Related
Inconsistency of Means
Checks if reported means are mathematically possible given sample size and integer data
GRIMMER
GRIM for standard deviations
Verifies if reported standard deviations are consistent with means and sample sizes
SPRITE
Sample Parameter
Reconstruction via
Iterative TEchniques
Reconstructs possible sample data from reported summary statistics
DEBIT
Detecting Errors in Binary
Analyzes binary variables in regression tables for consistency
RIVETS
Rounded Input Variables,
Exact Test Statistics
Identifies hand-calculated
statistics by examining precision of reported values
STALT
Smaller Than A Lowest
Threshold
Identifies suspiciously small p-values hidden behind threshold reporting (e.g., p < 0.05)
StatCheck
Automated recalculation of statistical tests
Verifies consistency between test statistics and reported p-values
Carlisle-Stouffer-
Fisher (CSF)
Analysis of multiple p-values
Examines validity of multiple baseline comparison p-values
Visual Analysis
Examination of graphs, plots, and images
Identifies duplicated or manipulated visual elements
Book Review: An Introduction to Forensic Metascience, by James Heathers
Guest column by Harvey Motulsky
https://goodscience.substack.com/p/book-review-an-introduction-to-forensic
Via @deevybee review of nowadays much needed didactical #scicomm book
» provides practical tools for verifying the statistical consistency of published research.
It's available as a free ebook, making it accessible to the scientific community.
...
made the […]
[Original post on mastodon.social]