Skip to main content

My favorite real world stats examples: The ones that mislead with real data.

This is a remix of a bunch of posts. I brought them together because they fit a common theme: Examples that use actual data that researchers collected but still manage to lie or mislead with real data. So, lying with facts.

These examples hit upon a number of themes in my stats classes:
1) Statistics in the wild
2) Teaching our students to sniff out bad statistics
3) Vivid examples are easier to remember than boring examples.

Here we go:

Making Graphs

Fox News using accurate data and inaccurate charts to make unemployment look worse than it is.

Misleading with Central Tendency

The mean cost of a wedding in 2004 might have been $28K...if you assume that all couples used all possible services, and paid for all of the services. Also, maybe the median would have been the more appropriate measure to report.

Don't like the MPG for the vehicles you are manufacturing? Try testing your cars under ideal, non-real world conditions to fix that. Then get fined by the EPA.

Misleading with Sampling

78% of young women approve of a no-good man sexting women who aren't his wife? Well, that number is correct...if you sample sugar babies.

Autism is linked to vaccination. If you are a research with a conflict of interest who uses a small sample of people who are typically biased against vaccination AND don't demand any actual medical evidence of anything you are measuring. 

Misleading with Probability

Absolute versus relative risk. Here, the way that perfectly accurate birth control safety data is presented affects birth control use, per Gerd Gigerenzer.

Comments

Popular posts from this blog

Ways to use funny meme scales in your stats classes

Have you ever heard of the theory that there are multiple people worldwide thinking about the same novel thing at the same time? It is the multiple discovery hypothesis of invention . Like, multiple great minds around the world were working on calculus at the same time. Well, I think a bunch of super-duper psychology professors were all thinking about scale memes and pedagogy at the same time. Clearly, this is just as impressive as calculus. Who were some of these great minds? 1) Dr.  Molly Metz maintains a curated list of hilarious "How you doing?" scales.  2) Dr. Esther Lindenström posted about using these scales as student check-ins. 3) I was working on a blog post about using such scales to teach the basics of variables.  So, I decided to create a post about three ways to use these scales in your stats classes:  1) Teaching the basics of variables. 2) Nominal vs. ordinal scales.  3) Daily check-in with your students.  1. Teach your students the basics...

Rouse, Russel, & Campbell (2025) is a curated list of Psi Chi journals that are perfect for Intro Stats.

This summer, the Psi Chi Journal of Psychology Research published  Rouse, Russel, and Campbell's Beyond the textbook: Psi Chi Journal articles in introductory psychology courses. It is a curated list of paywall-free Psi Chi articles, mostly with student co-authors, that are peer-reviewed and of an appropriate writing level and length to use in an Introduction to Psychology course. The authors provide the following information for each of the articles: In addition to being appropriate for Into Psych, these articles are also perfect for Intro Stats. In my classes, I emphasize the ability to read and write simple result sections. One way I would review this skill is by showing my students Results sections from published research and asking them to identify the test statistics, effect size, and other relevant information. This selection of articles features clear and concise results sections for t -tests, ANOVA, factorial ANOVA, regression, and correlation. I created a spreadsheet...

Using pulse rates to determine the scariest of scary movies

  The Science of Scare project, conducted by MoneySuperMarket.com, recorded heart rates in participants watching fifty horror movies to determine the scariest of scary movies. Below is a screenshot of the original variables and data for 12 of the 50 movies provided by MoneySuperMarket.com: https://www.moneysupermarket.com/broadband/features/science-of-scare/ https://www.moneysupermarket.com/broadband/features/science-of-scare/ Here is my version of the data in Excel format . It includes the original data plus four additional columns (so you can run more analyses on the data): -Year of Release -Rotten Tomato rating -Does this movie have a sequel (yes or no)? -Is this movie a sequel (yes or no)? Here are some ways you could use this in class: 1. Correlation : Rotten Tomato rating does not correlate with the overall scare score ( r = 0.13, p = 0.36).   2. Within-subject research design : Baseline, average, and maximum heart rates are reported for each film.   3. ...