Skip to main content

Teaspoons, Tablespoons, and a new analogy for family-wise error.

This blog post contains one small analogy for explaining family-wise error to your students.

I was making French toast for dinner the other night. While I was measuring out cinnamon, I realized using one tablespoon instead of three teaspoons to avoid measuring errors is sort of like using a one-way ANOVA with three levels instead of doing three t tests to avoid Type I error. 


Stick with me here. If I were to use three teaspoons to measure out an ingredient, there is a chance I could make a mistake three times. Three opportunities for air pockets. Three opportunities to not perfectly level out my ingredient. Meanwhile, if I just use one tablespoon, I will only risk the error associated with using a measuring spoon once. 

Similarly, every time we use NHST, we accept 5% Type I error (well, if you are a psychologist and using the 5% gold standard, but I digress). Using three tests (t tests) when we could use one (ANOVA) will increase the risk of a false positive.

I don't know about you, but I never know which explanation for a statisitcal phenomena will stick in my students' brains. You can talk about, like, measuring whatever you want to use this analogy, but I like that the 3 to 1 ratio that applies teaspoons and tablespoons as well three t tests versus an one-way ANOVA and three t tests.

Comments

Popular posts from this blog

Ways to use funny meme scales in your stats classes

Have you ever heard of the theory that there are multiple people worldwide thinking about the same novel thing at the same time? It is the multiple discovery hypothesis of invention . Like, multiple great minds around the world were working on calculus at the same time. Well, I think a bunch of super-duper psychology professors were all thinking about scale memes and pedagogy at the same time. Clearly, this is just as impressive as calculus. Who were some of these great minds? 1) Dr.  Molly Metz maintains a curated list of hilarious "How you doing?" scales.  2) Dr. Esther Lindenström posted about using these scales as student check-ins. 3) I was working on a blog post about using such scales to teach the basics of variables.  So, I decided to create a post about three ways to use these scales in your stats classes:  1) Teaching the basics of variables. 2) Nominal vs. ordinal scales.  3) Daily check-in with your students.  1. Teach your students the basics...

Using pulse rates to determine the scariest of scary movies

  The Science of Scare project, conducted by MoneySuperMarket.com, recorded heart rates in participants watching fifty horror movies to determine the scariest of scary movies. Below is a screenshot of the original variables and data for 12 of the 50 movies provided by MoneySuperMarket.com: https://www.moneysupermarket.com/broadband/features/science-of-scare/ https://www.moneysupermarket.com/broadband/features/science-of-scare/ Here is my version of the data in Excel format . It includes the original data plus four additional columns (so you can run more analyses on the data): -Year of Release -Rotten Tomato rating -Does this movie have a sequel (yes or no)? -Is this movie a sequel (yes or no)? Here are some ways you could use this in class: 1. Correlation : Rotten Tomato rating does not correlate with the overall scare score ( r = 0.13, p = 0.36).   2. Within-subject research design : Baseline, average, and maximum heart rates are reported for each film.   3. ...

If your students get the joke, they get statistics.

Gleaned from multiple sources (FB, Pinterest, Twitter, none of these belong to me, etc.). Remember, if your students can explain why a stats funny is funny, they are demonstrating statistical knowledge. I like to ask students to explain the humor in such examples for extra credit points (see below for an example from my FA14 final exam). Using xkcd.com for bonus points/assessing if students understand that correlation =/= causation What are the numerical thresholds for probability?  How does this refer to alpha? What type of error is being described, Type I or Type II? What measure of central tendency is being described? Dilbert: http://search.dilbert.com/comic/Kill%20Anyone Sampling, CLT http://foulmouthedbaker.com/2013/10/03/graphs-belong-on-cakes/ Because control vs. sample, standard deviations, normal curves. Also,"skewed" pun. If you go to the original website , the story behind this cakes has to do w...