The Pineapple, the Hare, and Test Quality

An absurd reading passage from the New York State 8th-grade English exam was published in a local paper, along with the inscrutable questions that followed it.  The passage, described as “a non-sense story” by its original author, is about a talking pineapple racing a hare.

The passage is bizarre, and the questions that follow (“The animals ate the pineapple most likely because they were …”) are virtually meaningless.  You can catch up on all the details in this story from the NY Daily News.

This is yet another public embarrassment for those in charge of creating, screening, and overseeing standardized testing.  The outcry in the wake of this episode has elicited a predictable response from the NYS testing commissioner:  the associated questions will not be counted because of their “ambiguous nature”.  (Here is the official statement.)

I call this predictable because we’ve seen this type of response in the past.  When inexcusably erroneous math questions appeared on a NYS Regents exam, an embarrassing sequence of events ultimately led to removing the question because of variations in usage.  There was no real admission that an error had been made, and the test (and indeed, the question itself) were both steadfastly defended.

Such issues seem to be remarkably common.  In studying NYS Math Regents Exams, we routinely see erroneous, poorly-constructed, ambiguous, and meaningless questions, but such incidents rarely garner much attention.  What’s different here is the publicity this particular story is getting.

In this era of high-stakes testing, hopefully this incident will get more people thinking about the question, “Are these tests any good?”

Joe Girardi, Probability, and Expected Value

During last night’s Yankees-Twins baseball game, the commentators were discussing the Yankees’ increased use of defensive shifts.

A “shift” is a defensive realignment of the infield to guard against a particular player’s hitting tendencies.  For example, if a player is much more likely to hit the ball to the right side of the infield (as, say, a strong left-handed hitter might be), a team may move an infielder from the left side to the right side to increase the chance of defensive success.

Dramatic infield shifting was once a rarity in the game, employed against only a few hitters in the league.  It is now being used with increasing frequency.  “All the data is out there,” said the announcers when discussing Yankees’ manager Joe Girardi’s explanation of why he was using it more.  (Which sounded remarkably like what Rays’ manager Joe Maddon, a pioneer in increased defensive shifting, had to say when asked about it some time ago).

The essential idea is that, given the reams of data now recorded on player performance, teams have a much more refined understanding of what a player will do.  No longer is the projection “The player has a 30% of getting a hit”; now, it’s “The player pulls 83% of ground balls to the left side of the infield”.  Naturally, teams try to use such information to their advantage.

It’s good that Joe Girardi is demonstrating an increased appreciation for, and understanding of, probability.  But as last night’s game suggests, he may need to learn more about the principle of expected value.

Early in the game, the bases were loaded with two outs, and a left-handed batter came to the plate.  Girardi put the defensive shift on, responding to data on this player that suggested he was extremely likely to ground out to the right side of the infield.  But probability considerations should be only one part of the analysis.  By leaving so much of the left side of the infield undefended, a situation was created where a weakly hit ground ball that would usually be an easy out actually produced two runs for the Twins.

In short, although the probability of that event (ground ball to the left side) was low, the risk (giving up two runs) was high.  Considering both the probability and the payoff is essential to long-term success.

I’d be surprised if the Yankees’ employ the shift again in that situation.  And if the Yankees need a special quantitative consultant, I am available during the summer.

TEDxNYED

I am honored and excited to be presenting at this year’s TEDxNYED conference on April 28th, 2012.

TEDx conferences are local, self-organized events inspired by TED, an organization devoted to “ideas worth spreading”.

The theme of this year’s TEDxNYED is “Created.  Instructed.  Connected,” and the list of speakers is impressive.  It includes Bre Pettis, a founder of Makerbot,  Christopher Emdin from Columbia University, and Frank Noschese, a well-known physics teacher and blogger.

The full line-up of speakers can be seen here.

http://tedxnyed.com/2012/speakers/

I look forward to participating and learning at this event, and I’m sure I’ll come back with many great ideas to share!

Mathematics Awareness Month

April is Mathematics Awareness Month.  Sponsored by professional and educational organizations like the American Mathematical Society, the Mathematical Association of America, the American Statistical Association,  and the Society for Industrial and Applied Mathematicians, Mathematics Awareness Month aims to increase awareness and promote the utility of mathematics through activities, contests, and public discourse.

This year’s theme is Mathematics, Statistics, and the Data Deluge.  The application of statistics is playing an ever-increasing role in both theory and practice, and the overwhelming amount of data available to us now is dramatically changing what we can do and how we do it.

There are a number of linked resources to this year’s theme at the Math Awareness Month website.  And this story from Stephen Wolfram offers an interesting tale about the unexpected application of personal data.

In addition, there are plenty of resources to previous MAMs here, like “Mathematics and Sports” and “Mathematics and the Internet” here:  http://www.mathaware.org/about.mam.html#previous.

How will you be celebrating Mathematics Awareness Month?

Follow

Get every new post delivered to your Inbox

Join other followers: