Are The New Tests More Rigorous?

The release of student test data from 2013 has educators, administrators, politicians, and parents abuzz in New York.  These are the first state exams aligned to the Common Core standards, and as widely predicted, proficiency rates have plummeted, leaving everyone scrambling to explain what has happened.

The most common explanation offered is that these new tests are substantially more rigorous than the old ones, so lower student performance is to be expected.  I was curious about the claim that the new tests are more rigorous, and while the state does not release the exams to the public, they do publish a small number of questions from each grade level.

The new tests were administered in grades 3-8.  As a high school teacher, I am not well-versed in elementary school tests, but I have spent a substantial amount of time scrutinizing New York state math Regents exams, so I thought I’d look at the 8th grade math questions that were released to the public.  I was quite surprised by what I saw.

The “representative sample” of 8th grade math questions does not seem more rigorous to me.  They do not seem to emphasize “deep analysis” or “creative problem solving over short answers and memorization”, which is often how the new standards are characterized.  I can’t say I was surprised to discover this.

What did surprise me, however, was how many of these 8th grade math questions were virtually identical to questions that have recently appeared on high school math Regents exams.

Here is the first example from the set of 8th grade math questions released to the public:

New Test Sample Q 1

This problem is essentially the same as #4 from the January, 2013 Integrated Algebra exam

January 2013 IA 4

The second example from the set of 8th grade math questions released to the public

New Test Sample Q 2

is quite similar to #4 from the January, 2013 Geometry exam

January 2013 G 4

And the fourth example from the set of 8th grade math questions released to the public

New Test Sample Q 4

is essentially the same as #9 from the January, 2013 Integrated Algebra exam

January 2013 IA 9

This surprising discovery left me with a lot of questions.

First, why are 8th graders facing the same kinds of questions on this state exam that 9th, 10th, 11th, and even 12th graders faced this year?  Were teachers and students prepared to see this kind of content on the 8th grade exam?

Second, how can it be argued that this new test is more rigorous if it is comprised of the same kinds of questions that appear on the old tests?  Simply moving a question from a 10th-grade test to an 8th-grade test doesn’t transform the question into one that requires deep analysis or creative problem solving.  More rigorous questions would ask students to construct mathematical objects, explore concepts from different perspectives, and demonstrate mathematical reasoning.  None of the above questions do this:  they are not especially challenging, deep, or novel.  In short, they are typical standardized test fare.

And perhaps the most important question is this:  if these are the hand-picked exemplar questions released to the public, what must the rest of the test look like?  Only by releasing the entire test to the public can we truly assess what we are assessing.

A version of this post appears at GothamSchools.

Presenting at MOVES Conference

moves logoI am very excited to be a part of the inaugural MOVES conference at the Museum of Mathematics in New York City!

The focus of the conference is the Mathematics of Various Entertaining Subjects, and it features an amazing lineup.  Erik Demaine, Dave Richeson, and Henry Segerman are among invited speakers, and Tim Chartier and Colm Mulcahy will be part of special evening of mathematical entertainment!

I will be running a Family Track activity at the Museum on Monday afternoon.  This workshop, Sphere Dressing, is inspired by the activity I submitted for the 2012 Rosenthal Prize.

The conference runs August 4-6.  You can find out more information here, and see the entire conference program here.

Regents Recap — June 2013: Encouraging Bad Habits

Here is another installment in my series reviewing the NY State Regents exams in mathematics.

Some of the worst exam questions aren’t merely erroneous, but actually encourage students to exercise bad mathematical habits.  Consider these questions from the June 2013 Algebra 2 / Trig exam.

2013 June A2T 4

Notice that the problem doesn’t specify what kind of series this is:  the student is expected to assume that the series is geometric.  This is a terrible habit to encourage, and I wrote about this the last time it happened on a Regents exam.  I guess no one is listening.

2013 June A2T 3

In order to determine whether a relation is one-to-one or onto, it is necessary to know the relation’s domain and range.  Here, the student is expected to assume that the oval on the left represents the domain of the relation and the oval on the right represents the range.  Perhaps these assumptions are reasonable given the nature of the diagrams, but this just seems sloppy to me.  I wouldn’t accept imprecise formulations of functions and relations like this from my students; I would demand they be more explicit.  (It’s also worth noting that the relation in (2) is one-to-one and onto its image in the right-hand oval.)

Here’s another example of sloppiness in question construction.

2013 June A2T 19

Is it supposed to be obvious that the i here is the imaginary unit?  The letter i could be just a variable, like, say, the m that also appears in the question.  The available answers support the assumption that i^2 = \sqrt{-1}, but why are we forcing students to play test-detective?

The Regents exams also continue with their long-standing tradition of presenting unscaled graphs, another bad mathematical habit to encourage.

I believe these tests should stand as exemplars of proper mathematics.  Maybe I’m alone in thinking this, but it seems to me that repeated exposure to these sloppy exam questions might actually interfere with a student’s ability to truly understand the underlying mathematics.

Regents Recap — June 2013: More Trouble with Functions

Here is another installment in my series reviewing the NY State Regents exams in mathematics.

Functions seem to be an especially challenging topic for the writers of the New York State math Regents exams.  After this debacle with functions and their inverses, we might expect closer attention to detail when it comes to functions and their domains and ranges.  We don’t seem to be getting it.

Consider this question from the June 2013 Algebra 2 / Trig exam.

2013 June A2T 33

According to the rubric, the correct answer is -900a^2.  This indicates that the test-makers either (a) don’t understand the concept of domain or (b) they have decided to start working in the world of complex-valued functions without telling the rest of us.

Let f(x) = ax \sqrt{1-x} and h(x) = x^2, and note that g(x) = h(f(x)).  In order to evaluate g(10), we first have to evaluate f(10).  But f(10) = 10a\sqrt{1-10} = 10a\sqrt{-9}, which isn’t a real number.  Thus f(10) is undefined; in other words, 10 is not in the domain of f(x).

But if 10 is not in the domain of f(x), it can’t be in the domain of g(x) = h(f(x)) either.  Therefore, g(10) is undefined; it is not -900a^2, as indicated in the rubric.

Of course, if we are working in the world of complex numbers, \sqrt{-9} = 3i.  But we never talk about complex-valued functions in Algebra 2 / Trig.  When we talk about functions like g(x), we are always talking about real-valued functions.  And just because the process of squaring later on down the line eliminates the imaginary part, that doesn’t fix the inherent domain problem.  After all, what is the domain of f(x) = ({ \sqrt x})^2?

What are the test-makers thinking here?  I really don’t know.

Related Posts

 

Bridges 2013 — Math and Art Conference

bridges 2013I am very excited to be heading to Enschede, the Netherlands later this week for the 2013 Bridges conference!

The Bridges organization has been hosting this international conference highlighting the connections between art, mathematics, and computer science for the past 15 years.  I have attended several Bridges conferences and have been greatly influenced by my experiences there.

This year I am excited to be exhibiting some work in the Bridges Mathematical Art Gallery.  You can see my pieces here, and browse the full galleries here.  I will also be presenting a short paper on some ideas about teaching mathematics through image manipulation, which relates to my pieces in the exhibition.

Bridges 2013 will be five days of inspiring people, conversations, mathematics, and art!  And after that, I’ll enjoy unpacking everything I experience throughout the school year.

Related Posts

Follow

Get every new post delivered to your Inbox

Join other followers: