BlookMark

Statistics Done Wrong: A Toolkit for Clearer Inference

Reinhart converts common statistical failures into a compact set of diagnostic rules and practical habits. The book cultivates a skeptical, design-first mindset that reduces sloppy inference and improves how results are framed and reported.

By Blookmark • •Thinking Better •2 min read

Book Summary

Book: Statistics Done Wrong

Rating: ⭐ 5/5

Relevant For:

  • Researchers who run experiments or analyze observational data
  • Graduate students and early-career scientists learning statistical judgment
  • Data practitioners who want robust decision rules, not rituals

Remarkable Points:

  • Converts abstract inferential errors into short, actionable checks
  • Places experimental design and question formulation before statistical toys
  • Shows how selective reporting and multiple comparisons create false narratives
  • Makes reproducibility a routine, not an optional badge

Most Liked (As-Is Statements):

"Ask the question you will be able to answer."

"P values do not measure the probability that your hypothesis is true."

Key Themes:

Theme 1: Design Before Analysis

Reinhart insists that a redundant or vague question dooms inference. The clearest gains come from predefining comparisons and stopping rules.

Theme 2: Treat P Values as Diagnostics

P values are signals, not verdicts. The book reframes them as one input among many and warns against binary thinking.

Theme 3: Guardrails for Reporting

Transparent code, full data, and honest reporting are presented as procedural safeguards that change incentives and reduce error.

Theme 4: Simple Models, Honest Claims

Prefer models that match the question over complex fits that seduce with precision. State assumptions clearly and avoid overreach.

Final Remark:

Statistics Done Wrong is a corrective manual: short, direct, and tactical. It replaces ritual with rules that scale across fields. The value is not new mathematics but better habits. Read it to shrink the gap between what analyses show and what claims deserve.

Clarity in statistical practice starts with asking the right question and sticking to the plan.

Similar Books:

  • The Art of Statistics by David Spiegelhalter
  • Naked Statistics by Charles Wheelan
  • The Signal and the Noise by Nate Silver
  • Practical Statistics for Data Scientists by Peter Bruce and Andrew Bruce

Related Book Reviews

  • Phaedo: A Framework for Thinking About Death and Knowledge — Plato's Phaedo is less an account of the soul and more a set of thinking tools: dialectic as a method of disentangling belief from appearance, and the body-soul distinction as a model for epistemic hygiene. Read for its disciplined procedures and the mental models it supplies for confronting limits, not for biographical detail.
  • Trust and Honesty: An Institutional Toolkit — This review treats Frankel's work as a set of thinking tools rather than a book to be summarized. It values the author's translation of trust into institutional variables and evaluates the clarity and usability of those mental models.
  • How Children Succeed: A Framework for Character — Paul Tough reframes childhood success as an engineering problem of building cognitive and emotional capacities rather than a scoreboard of grades. The book offers portable mental models for identifying levers that shape persistence, self-control, curiosity, and the environments that either erode or restore them.
  • Better Together: A Primer on Civic Design — This review extracts the conceptual machinery behind Better Together and evaluates its value as a playbook for rebuilding civic life. It highlights the book's mental models for social capital, replication, and local problem solving while noting limits in theory and generalizability.
  • Awakening the Mind, Lightening the Heart — A Framework for Practiced Compassion — This review isolates the book's operating mental models rather than retelling its teachings. It judges the work by clarity of methods, repeatability of practice, and usefulness as a cognitive tool for cultivating compassion.
  • Mechanics Before Muse: Swain's Systems for Sellable Fiction — Swain reframes fiction as a set of tractable operations: scenes that move, sequels that breathe, and choices that produce reader response. This review isolates the mental models that let a writer convert raw energy into reproducible, marketable craft.

Browse all book reviews →