We should teach intro stats students about relative vs. absolute risk

Do you know what bugs me? How much time different intro stats textbooks spend talking about probability, lots of A not B stuff*, lots of probability associated with the normal distribution, etc. But we don't take advantage of the discussion to warn their students about the evils of relative vs. absolute risk. #statsliteracy

Relative risk is the most clickbaity abuse of statistics that there is. Well, maybe the causal claims based on correlational data are more common. But I think the relative risk is used to straight-up scare people, possibly changing their behaviors and choices.

I thought of it most recently when The Daily Mail (bless) used explained the difference in COVID-19 risk between dog owners and non-dog owners.

Here is the data described in the headline, straight from the original paper:

Really, Daily Mail? How dare you.

I think the most clever, trickiest, sneakiest ways to mislead with data are by not lying with data at all. Most truncated y-axes display actual data. Data sets with sampling error are still data sets. And relative risk and absolute risk express the same data, but relative risk sounds scary while absolute risk doesn't sound scary.

Another example I like involved Gerd Gigerenzer, the well-known cognitive psychologist. In this video, he describes an instance when relative risk headlines scared women away from oral contraceptives, and then there was a rise in abortions. All of these could have been avoided totally if women have been given absolute risk information about birth control pills.

You can take issue with Gerd's claim that abortion negatively affects women, but I think that most people would agree that women being scared out of taking their birth control pills is a bad thing. And that newspapers need to be responsible, and editors must avoid using relative risk to scare readers.

I know we have a lot of ground to cover in Intro Stats. But we are doing our students a disservice if we aren't preparing them to deal with oft-encountered dirty data in real life. This topic doesn't take too long to explain. You already have to talk about probability. The video is short. It is easy to explain.

*And probability has its time and place. Go read The Drunkard's Walk. You'll love it. But I just sit and think a lot about how we should use our precious Intro to Stats time. And I think we should point out how classroom topics play out in real life.

Comments

Ways to use funny meme scales in your stats classes

Have you ever heard of the theory that there are multiple people worldwide thinking about the same novel thing at the same time? It is the multiple discovery hypothesis of invention . Like, multiple great minds around the world were working on calculus at the same time. Well, I think a bunch of super-duper psychology professors were all thinking about scale memes and pedagogy at the same time. Clearly, this is just as impressive as calculus. Who were some of these great minds? 1) Dr. Molly Metz maintains a curated list of hilarious "How you doing?" scales. 2) Dr. Esther Lindenström posted about using these scales as student check-ins. 3) I was working on a blog post about using such scales to teach the basics of variables. So, I decided to create a post about three ways to use these scales in your stats classes: 1) Teaching the basics of variables. 2) Nominal vs. ordinal scales. 3) Daily check-in with your students. 1. Teach your students the basics...

Using pulse rates to determine the scariest of scary movies

The Science of Scare project, conducted by MoneySuperMarket.com, recorded heart rates in participants watching fifty horror movies to determine the scariest of scary movies. Below is a screenshot of the original variables and data for 12 of the 50 movies provided by MoneySuperMarket.com: https://www.moneysupermarket.com/broadband/features/science-of-scare/ https://www.moneysupermarket.com/broadband/features/science-of-scare/ Here is my version of the data in Excel format . It includes the original data plus four additional columns (so you can run more analyses on the data): -Year of Release -Rotten Tomato rating -Does this movie have a sequel (yes or no)? -Is this movie a sequel (yes or no)? Here are some ways you could use this in class: 1. Correlation : Rotten Tomato rating does not correlate with the overall scare score ( r = 0.13, p = 0.36). 2. Within-subject research design : Baseline, average, and maximum heart rates are reported for each film. 3. ...

Andy Field's Statistics Hell

Andy Field is a psychologist, statistician, and author. He created a funny, Dante's Inferno-themed web site that contains everything you ever wanted to know about statistics. I know, I know, you're thinking, "Not another Dante's Inferno themed statistics web site!". But give this one a try. Property of Andy Field. I certainly can't take credit for this. Some highlights: 1) The aesthetic is priceless. For example, his intermediate statistics page begins with the introduction, "You will experience the bowel-evacuating effect of multiple regression, the bone-splintering power of ANOVA and the nose-hair pulling torment of factor analysis. Can you cope: I think not, mortal filth. Be warned, your brain will be placed in a jar of cerebral fluid and I will toy with it at my leisure." 2) It is all free. Including worksheets, data, etc. How amazing and generous. And, if you are feeling generous and feel the need to compensate him for the website, ...

Search This Blog