Skip to main content

Posts

Science Friday's "Spot the real hypothesis"

Annie Minoff delves into the sins of ad hoc hypotheses using several examples from evolutionary science (including evolutionary psychology) . I think this is a fun way to introduce this issue in science and explain WHY a hypothesis is important for good research. This article provides three ways of conveying that ad hoc hypotheses are bad science. 1) This video of a speaker lecturing about absurd logic behind ad hoc testing (here, evolutionary explanations for the mid-life "spare tire" that many men struggle with). NOTE: This video is from an annual event at MIT, BAHFest (Bad Ad Hoc Fest) if you want more bad ad hoc hypotheses to share with students. 2) A quiz in which you need to guess which of the ad hoc explanations for an evolutionary finding is the real explanation. 3) A more serious reading to accompany this video is Kerr's HARKing: Hypothesizing after results are known (1998), a comprehensive take down of this practice.

Why range is a lousy measure of variability

Climate change deniers misrepresent data and get called out

 Here is another example of how data visualizations can be accurate AND misleading. I Fucking Love Science broke down a brief Twitter war that started after National Review tweeted the following post in order to argue that global climate change isn't a thing. Note: The y-axis ranged from 110 - -10 degrees Fahrenheit. True, such a temperature range is experienced on planet Earth, but using such an axis distracts from the slow, scary march that is global climate change and doesn't do a very good job of illustrating how discrete changes in temperature map onto increased use of fossil fuels in the increasingly industrialized world. Twitter-verse responded thusly:

Totilo's "Antonin Scalia's landmark defense of violent video games"

A great example using a topic relevant to your students (video games), involving developmental psychology (the effect of violent media on children), and a modern event (Scalia's passing) in order to demonstrate the importance of both research psychology as well as statistics. This article extensively quote Scalia's majority opinion regarding Brown vs. Entertainment Merchants Association, a 2010 U.S. Supreme Court case that decided against California's attempt to regulate the sale of violent video games to minors (the full opinion embedded in the article). Why did Scalia decide against regulating violent video games in the same manner that the government regulates alcohol and cigarette sales? In part, because research and statistics. Of particular use to an instructor of statistics are sections when Scalia cites shaky psychological research and argues that correlational research can not be used to make causal arguments... ...Scalia also discusses effect sizes... ...

Stromberg and Caswell's "Why the Myers-Briggs test is totally meaningless"

Oh, Myers-Briggs Type Indicator, you unkillable scamp. This video , from Vox, gives a concise historical perspective on the scale, describes how popular it still is, and summarizes several of the arguments against the scale. This video explains why the ol' MBTI is not particularly useful. Good for debunking psychology myths and good for explaining reliability (in particular, test-retest reliability) and validity. I like this link in particular because it presents its argument via both video as well as a smartly formatted website. The text in the website includes links to actual peer-reviewed research articles that refute the MBTI.

Davies' "Ted Cruz using firm that harvested data on millions of unwitting Facebook users"

So, this is a story of data mining and Mechanical Turk and data privacy and political campaigns. Lots of good stuff for class discussion about data privacy, applied use of data, etc..  It won't exactly teach your students how to ANOVA, but it is a good and timely discussion piece. Short version of the story: Ted Cruz's campaign hired a consulting firm (Strategic Communications Laboratories, SCL) to gather information about potential voters. They did so by using Amazon's Mechanical Turk to recruit participants. Participants were asked to complete a survey that would give SCL access to your Facebook account. SCL would then download all visible user information from you. And then they would download the same information FROM ALL OF YOUR FRIENDS who did not consent to be involved in the study. Some mTurk users claim this was a violation of Amazon's Terms of Service. This data was then used to create psychological profiles for campaigning purposes. Discussion pieces: ...

Dr. Mages' "APA Exposed: Everything you wanted to know about APA formatting but were afraid to ask."

Teaching undergraduates APA style is not fun. It is not fun for teachers. It is not fun for students. However, I think that the more tools that we, the teachers, have in order to convey the rules of APA style, the more likely we are to find something that finally sticks for our students. This week, I offer one such tool created by Dr. Wendy K. Mages. Dr. Mages created an online, self-paced, free Powerpoint presentation that teaches the essentials of APA style. Lessons are presented in a PowerPoint-esque format with a voice-over (as well as a transcript) I like that Dr. Mages includes some of her own experiences grading students papers in order to keep current students from making frequent mistakes that Dr. Mages has encountered. She also offers plenty of original examples and uses appropriate Powerpoint animations/highlighting to engage the viewer.

Statistics/RM videos from The Economist

TED isn't the only source of videos for teaching statistics . The Economist also makes animated videos that are lousy with data. One easy, no-pay-wall source for such videos is The Economists Videographic playlist on YouTube  (there is a limit on number article views/month at their website ). One really statsy video from The Economist that I've featured previously on this blog explains the real life implications for Type I/Type II error in research (and, specifically, how it leads to errors in published research ). The other videos may not be as directly related to the teaching of statistical topics, but they do illustrate data. Topics range from American union membership trends to this video about world population growth . As you may have inferred from the source, many of these videos focus on national and global economic information, but all of the videos do present data that you can integrate into your classes. Some are more applicable to teaching statistics: This vid...

Explaining between and within group differences using Pew Research data on religion/climate change

I am a big fan of Pew Research Center . They collect, share, and summarize data about a wide variety of topics. In addition to providing very accessible summaries of their findings, they also provide more in-depth information about their data collection techniques, including original materials used in their data collection and very through explanations of their methods. One topic they collect Pew studies is religion and attitudes (religious and secular) held by people of different religions. And it got me thinking that I could use their data in order to explain within and between group differences at the heart of a conceptual understanding of ANOVA. Specifically, Pew gathered data looking at between-group differences in beliefs in global climate change by religion ... Chart created by Pew Research ... and belief in climate change within just Catholics, divided up by political affiliation. Chart created by Pew Research The questionnaires differed slightly for the...

Stein's "Is It Safe For Medical Residents To Work 30-Hour Shifts?"

This story describes an 1) an efficacy study that 2) touches on some I/O/Health psychology research and 3) has gained the unwanted attention of government regulatory agencies charged with protecting research participants.   The study described in this story is an efficacy study that questions a decision made by the 2003 Accreditation Council for Graduate Medical Education. Specifically, this decision capped the number of hours that first-year medical student can work at 80/week and a maximum shift of 16 hours. The PIs want to test whether or not these limits improve resident performance and patient safety. They are doing so by assigning medical students to either 16-hour maximum shifts or 30-hour maximum shifts. However, the research participants didn't have the option to opt out of this research. Hence, an investigation by the federal government. So, this is interesting and relevant to the teaching of statistics, research methods, I/O, and health psychology for a numbe...

Oster's "Everybody Calm Down About Breastfeeding"

I just had a baby. Arthur Francis joined our family last week. Don't mind the IV line on his head, he is a happy, chubby little boy. Now, I am the mother of a new born and a toddler. And I have certainly been inundated by the formula versus breast feeding debate. In case you've missed out on this, the debate centers around piles and piles of data that indicate that breast fed babies enjoy a wealth of developmental outcomes denied to their formula fed peers. Which means there is a lot of pressure to breast feed (and some women feel a lot of guilt when they can't/do not want to breast feed). However, the data that supports breast feeding also finds that breast feeding is much more common among  educated, wealthy white women with high IQs. And being born to such a woman probably affords a wealth of socioeconomic advantages beyond simply breast milk. These issues, as well as mixed research findings, are reviewed in Emily Oster's "Everybody calm down about brea...

Hickey's "The 20 Most Extreme Cases Of ‘The Book Was Better Than The Movie"

Data has been used to learn a bit more about the age old observation that books are always better than the movies they inspire. Fivethirtyeight writer Walk Hickey gets down to the brass tacks of this relationship by exploring linear relationships between book ratings and movie ratings.  The biggest discrepancies between movie and book ratings were for "meh" books made into beloved movies (see "Apocalypse Now"). How to use in class: -Hickey goes into detail about his methodology and use of archival data. The movie ratings came from Metacritic, the book ratings came for Goodreads. -He cites previous research that cautions against putting too much weight into Metacritic and Good reads. Have your students discuss the fact that Metacritic data is coming from professional movie reviewers and Goodreads ratings can be created by anyone. How might this effect ratings? -He transforms his data into z-scores. -The films that have the biggest movie:book rati...

Esther Inglis-Arkell's "I Had My Brain Monitored While Looking at Gory Pictures. For Science!"

The writer helped out a PhD candidate by participating in his research, and then described the research process for io9.com readers . I like this because it is describes the research process purely from the perspective of the research participant who doesn't know what the exact hypothesis is. This could be useful for explaining what research participation is like for introductory students. You could used it in a methods class by asking the students to figure out why they used the procedures that they did, and what procedures and scales she describes in her narrative. She describes the informed consent, a personality scale (what do you think the personality scale was trying to assess?), and rating stimuli in two ways (brain scan as well as paper and pencil assessment...why do you think they needed both?) Details to Like: -She is participating is psychology research (neruo. work that may benefit those with PTSD someday) -She describes what is entailed when wearing an elect...