Skip to main content

Posts

Showing posts with the label p-value

Aschwanden's "You Can’t Trust What You Read About Nutrition"

Fivethirtyeight provides lots of beautiful pictures of spurious correlations found by their own in-house study. At the heart of this article are the limitations of a major tool use in nutritional research, the Food Frequency Questionnaire (FFQ). The author does a mini-study, enlisting the help of several co-workers and fivethirtyeight.com readers. They track track their own food for a week and reflect on how difficult it is to properly estimate and recall food (perhaps a mini-experiment you could do with your own students?). And she shares the spurious correlations she found in her own mini-research: Aschwanden also discusses how much noise and lack of consensus their is in real, published nutritional research (a good argument for why we need replication!):  http://fivethirtyeight.com/features/you-cant-trust-what-you-read-about-nutrition/ How to use in class: -Short comings of survey research, especially survey research that relies on accurate memories -...

Teaching the "new statistics": A call for materials (and sharing said materials!)

This blog is usually dedicated to sharing ideas for teaching statistics. And I will share some ideas for teaching. But I'm also asking you to share YOUR ideas for teaching statistics. Specifically, your ideas for teaching the new statistics: effect size, confidence intervals, etc. The following email recently came across the Society for the Teaching of Psychology listserv from Robert Calin-Jageman (rcalinjageman@dom.edu). "Is anyone out there incorporating the "New Statistics" (estimation, confidence intervals, meta-analysis) into their stats/methods sequence? I'm working with Geoff Cumming on putting together an APS 2017 symposium proposal on teaching the New Statistics.  We'd love to hear back from anyone who has already started or is about to.  Specifically, we'd love to:         * Collect resources you'd be willing to share (syllabi, assignments, etc.)         * Collect narratives of your experi...

If your students get the joke, they get statistics.

Gleaned from multiple sources (FB, Pinterest, Twitter, none of these belong to me, etc.). Remember, if your students can explain why a stats funny is funny, they are demonstrating statistical knowledge. I like to ask students to explain the humor in such examples for extra credit points (see below for an example from my FA14 final exam). Using xkcd.com for bonus points/assessing if students understand that correlation =/= causation What are the numerical thresholds for probability?  How does this refer to alpha? What type of error is being described, Type I or Type II? What measure of central tendency is being described? Dilbert: http://search.dilbert.com/comic/Kill%20Anyone Sampling, CLT http://foulmouthedbaker.com/2013/10/03/graphs-belong-on-cakes/ Because control vs. sample, standard deviations, normal curves. Also,"skewed" pun. If you go to the original website , the story behind this cakes has to do w...

Orlin's "What does probability mean in your profession?"

Math with Bad Drawings is a very accurately entitled blog. Math teacher Ben Orlin illustrates math principles, which means that he occasionally illustrates statistical principles. He dedicated one blog posting to probability, and what probability means in different contexts. He starts out with a fairly standard and reasonable interpretation of p :  Then he has some fun. The example below illustrates the gap that can exist between reality and reporting. And then how philosophers handle probability (with high- p statements being "true"). And in honor of the current Star Wars frenzy: And finally...one of Orlin's Twitter followers, JP de Ruiter , came up with this gem about p -values:

Aschwanden's "Science is broken, it is just a hell of a lot harder than we give it credit for"

Aschwanden (for fivethirtyeight.com) did an extensive piece that summarizes that data/p-hacking/what's wrong with statistical significance crisis in statistics. There is a focus on the social sciences, including some quotes from Brian Nosek regarding his replication work. The report also draws attention to  Retraction Watch  and Center for Open Science as well as retractions of findings (as an indicator of fraud and data misuse). The article also describes our funny bias of sticking to early, big research findings even after those research findings are disproved (example used here is the breakfast eating:weight loss relationship). The whole article could be used for a statistics or research methods class. I do think that the p-hacking interactive tool found in this report could be especially useful illustration of How to Lie with Statistics. The "Hack your way to scientific glory" interactive piece demonstrates that if you fool around enough with your operationalized...

One article (Kramer, Guillory, & Hancock, 2014), three stats/research methodology lessons

The original idea for using this article this way comes from Dr. Susan Nolan 's presentation at NITOP 2015, entitled " Thinking Like a Scientist: Critical Thinking in Introductory Psychology."  I think that Dr. Nolan's idea is worth sharing, and I'll reflect a bit on how I've used this resource in the classroom. (For more good ideas from Dr. Nolan, check out her books, Psychology , Statistics for the Behavioral Sciences , and The Horse that Won't Go Away (about critical thinking)). Last summer, the National Academy of Sciences Proceedings published an article entitled "Experimental evidence of massive-scale emotional contagion through social networks ." The gist: Facebook manipulated participants' Newsfeeds to increase the number of positive or negative status updates that each participant viewed. The researchers subsequently measured the number of positive and negative words that the participants used in their own status updates. They fou...

Statsy pictures/memes for not awful PowerPoints

I take credit for none of these. A few have been posted here before. by Rayomond Biesinger, http://fifteen.ca/ Creator unknown, usually attributed to clipart? http://www.sciencemag.org/content/331/6018.cover-expansion https://www.flickr.com/photos/lendingmemo/ https://lovestats.wordpress.com/2014/11/10/why-do-kids-and-you-need-to-learn-statistics-mrx/ http://memecollection.net/dmx-statistics/ 9/23/15 Psychometrics: Interval scale with proper anchors 2/9/16 4/19/16 4/28/16 "Symbols that math urgently needs to adopt" https://mathwithbaddrawings.com/2016/04/27/symbols-that-math-urgently-needs-to-adopt/ http://www.mrlovenstein.com/ http://www.smbc-comics.com/ 9/8/16 2/9/2107 https://hbr.org/2017/02/if-you-want-to-motivate-employees-stop-trusting-your-instincts https://www.theguardian.com/politics/2017/jan/19/crisis-of-statistics-big-data-democracy?CMP=share_btn_tw 2/13/17 ...