Categories
Statistics

Nix the Tricks – AP Stats Edition

For AP Stats teachers, this is the time of year where we move from innocent ideas like scatterplots and experimental design, and into uncharted waters; those topics which require sharper focus, and more time and reflection to develop properly. Sampling distributions, the Central Limit Theorem, confidence intervals and hypothesis testing…new and scary ideas.  With the crush to cover content before May, it’s easy to fall into traps where we shortchange discovery and real meaning and replace them with quick tricks.  Here I present one of my least favorite Statistics “tricks”, and hope you “Nix this Trick”!


Nix Header“Nix The Tricks” is a powerful, free document for math teachers of all grades; a crowdsourced collection of math shortcuts and well-intentioned devices teachers employ to assist students with math mechanics; devices which ultimately under-cut student understanding of mathematics.  Along with the tricks are suggestions for developing math concepts in your classroom without tricks; encouraging communication of ideas and language.  It’s a labor of love, compiled and edited by Tina Cardone, who I admire for her dedication to this project.  Some of my ideas from a blog post last year on phrases from math class which need to be expunged have been absorbed into Nix The Tricks, and I am thrilled to have had even a small part in building this document.  Share it with your math friends, and let the debates begin!


Back to Stats-world, and a phrase we need to Nix.  It’s time for hypothesis testing, a new world of strange symbols for the null and alternate hypothesis, lots of conditions and tests to think about, and making logical connections between computed values and real-life consequences.  Writing tight, meaningful conclusions takes practice, revision, and patience. But why struggle, when we have a cute shortcut?

When the P is low, reject the Ho!

This is the short version of the general argument that when we have a sufficiently low P-vale (below alpha), we have evidence against the null hypothesis, and in favor of the alternate. But why go through all of this meaning, when we can talk about Hos in math class!

 Snoop

So, what’s wrong with this catchy phrase?  Well, first, and probably most importantly, it’s damn offensive.  For teachers, talking about Hos in class, or even providing a “giggle” momnent about the idea, is out of bounds.  We all get that, right?  Good.

In stats-world, the problem with this phraise is that it provides students an excuse to not develop real understanding about the connection between P-Values, Alpha, and the null hypothesis.  As an AP Reader, I enjoy the opportunity to see how students craft their conclusions to a hypothesis test. In 2012, I read question 4, which was a full 2-proportion z-test.  It was fascinating to observe the clear differences between the written approaches to conclusions; which textbook they probably used, what mnemonic devices did their teacher push, how much attention was paid to written practice.  In addition, while many approaches relied upon a canned template, where students simply fill in blanks (with mixed success), I also enjoyed well-developed explanations which demonstrate clear evidence of understanding of the logic of hypothesis testing.

At last year’s AP Stats Reading “Best Practices Night” Luke Wilcox did a wonderful job explaining how he challenges his students to become clear communicators from day 1. You can download his presentation, and many other “best practices” resources, at the famous APStatsMonkey page.  Here’s a fantastic example from Luke’s class, which demonstrates clear understanding of the process:

Conclusion

In AP Stats, communication is essential.  Here are some thoughts and ideas to keep in mind:

  • A strong conclusion has linkage between a computed P-value and a defined significance level (alpha).  This is the computation piece.  The art of statistical writing is taking this numerical result and using it to reach a conclusion about our population.
  • My students write, write and write, and my boards are covered with samples, which we critique and revise.  I like to randomly assign students to work together (I often use playing cards for this), so that “group think” does not set in. I want students to debate language, and I can see from afar which groups are on-point by having them on boards around my room
  • My document camera is also a valuable resource here. As an opener, I’ll have students examine a homework problem, and write their conclusion on an index card. Random cards are selected and critiqued.

As many Stats teachers head toward their hypothesis testing units, let work together to Nix this Trick, and improve student writing!

Categories
Statistics

“Old Wives Tales” and Experimental Design

We just completed our Experimental Design chapter in AP Statistics. It’s one of my favorites, as there are so many opportunities for fun, meaningful activities and class discussions. The activity in this post is an adaptation of a project I first heard of through my friends at Villanova University, where it is used in Introductory Statistics courses.

Think about these “old wives’ tales” and slogans. Which ones are accepted to be true? What ones seem dubious?

  • Carrots improve vision
  • Chicken soup can cure a cold
  • Toads cause warts
  • Choosy mothers choose JIF
  • The 5-second rule

In this project, teams select a “famous saying” to explore. Using the principles of experimental design learned in AP Stats, teams design an experiment which could be use to test the claim.  Treatments must be described, randomization procedures explained, and comparisons suggested.  Should the experiment be blocked?  Will a placebo be employed?  Should blinding be used?  These all must be addressed by the team in a powerpoint submitted to describe the project.  Finally, teams peer-assess other projects, and provide feedback.  Below, you can download the project description, and the grading rubric.

Sayings project

Sayings rubric

On the day the project is assigned, I give 15 minutes for the teams to form.  Teams look over the list of topics, and are given a playing card.  Then the draft of topics begins!  The team drawing an ace gets to pick their topic first, then two, then 3….so that no topic is repeated in the class.

Teams were given about two weeks to work on the project, as we continued through the unit.  The actual creation of the project does not take that long, but we had the project simmering in the background as experimental design ideas were learned in class.

As teams turned in their files, my colleague Joel moved them to slideshare so that they could be house on his web page.  Here are two examples:

After we had all the projects, all students were assigned 3 of the projects to assess.  Using a Google Form, students provided comments, which I then sorted and gave back to the teams.  Amazing how students are usually in target when asked to grade.  And the comments provided were mostly consructive and on point.

Feedback

Categories
High School Statistics

Matched Pairs with Hallway Bowling

The experimental design unit in AP Statistics is a fun one, with lots of opportunities to design activities, discuss possibilities and collect data.  For a few years, a “Hallway Bowling” activity I created has been one of my favorites for discussing matched-pairs experiments.  This year, I added a new wrinkle to this activity day, in order to economize class time.  As students entered the class, they drew a playing card, each having one of three suits which determined their group assignment for the day.  Each group had 7 or 8 students.  Groups then rotated through 3 stations, with 15 minutes on the clock, and with each activity designed to review a different aspect of the chapter.

In Station 1, students met with me in a small group, where we discussed experimental design, writing ideas and experiment trees on desks.  This was a departure from whole-class discussions, and more students had the chance to share their ideas on experiments dealing with clothes washing temperatures and drug trials.  Experimental design vocabulary like blocking and matched-pairs were clarified, and the small-group discussions were rich.  At the end of the day, the students shared how much they liked being able to share in a more intimate setting.

In Station 2, the group completed an actual AP item dealing with experimental design.  Papers were collected as a group, and I will randomly choose 2 paper from the group to grade.  Students knew this going into the activity, and this procedure holds all students accountable for the group grade/

In Station 3, the group went out of the room to play and collect data with “Hallway Bowling”.  15 minutes was enough time for students to practice, play, and collect data.

You can down loading the rules here:  Hallway Bowling

Here’s how Bowling works.

  • 2 markers are placed 5 meters apart (I had pre-taped blue X’s on the floor)
  • players stand behind one marker, and roll a golf ball as close to the other marker as possible.
  • During the data recording, players will roll 4 times; alternating hands and measuring the disatance to the marker.

BowlingAfter the activity, a whole-class discussion is held to talk about Hallway Bowling as an experiment.  What are we trying to prove?  How does our activity provide data for the experiment?  Where is the randomization?  What could be done to improve the design?  Here, we are looking to encourage “matched-pairs thinking”; where all subjects are exposed to both treatments (rolling with dominant and non-dominant hands), and we are interested in those differences.  We can also consider blocking here if we feel that males and females may be effected diffferently by the treatments.  We can also revisit the data later when we look at hypothesis testing procedures.

And about that data we collected?  My kids entered their data into a Google form.  There are some great comparisons to consider: right hand vs left hand, boys vs girls.  But how did the distances come out for dominant hands vs non-dominant hands?

Graph 1

Note the difference in medians here.  But can we directly compare individual player performances?  To do this, we can subtract dominant and non-dominant hand scores, and observe the differences:

Graph 2

If players are truly better with their cominant hands, we should see many negative differences here.  We see over 50% negative, but is there enough evidence to prove a mean difference for ALL players?  Time to start linking to inference.

So have fun with hallway bowling, and try some classroom stations!