Showing posts with label NAPLAN. Show all posts
Showing posts with label NAPLAN. Show all posts

Thursday, August 21, 2014

Testing Democracy: NAPLAN Produces Culture of Compliance

Inquiry: Critical Thinking Across the Disciplines
Inquiry: Critical Thinking Across the Disciplines (Photo credit: Wikipedia)
by Arathi Sriprakash, University of Sydney and Tony Loughland, University of Sydney

There has been widespread and well-justified critique of the NAPLAN tests in Australian schools. Concerns have focused on the ways the testing severely narrows the school curriculum, compounds disadvantage and creates undue anxieties for young students.

Current panic about this year’s writing test is telling of the broader social and political consequences of a back-to-basics curriculum underpinned by a high-stakes standardised testing system.

The poorly worded question set for the writing test, “which law or rule would you make better in your view?”, has been criticised for being too difficult for students.

Teachers felt they had been ambushed by the complexity of the question when they had been preparing students on the technical aspects of writing a narrative or persuasive text. The outcome was that some students did not attempt the question and received zero marks for writing.

One particular response to this year’s writing question compels reflection about the purpose and future of our schooling system. To ask such a question has been seen as “inappropriate” and “ludicrous”, especially for “children being brought up in law-abiding families, where they are told that rules are important”.

Arguably, it should be the driving purpose of education to ask such questions, albeit not within the constraints of a standardised test. As the Melbourne Declaration sets out, a key goal for Australian schooling is to produce “active and informed citizens”.

Denying the possibility of critical thinking - for example, examining issues of justice in rules and laws - threatens these broader goals of active citizenship and engaged democratic participation.

The end of critical thinking?

The content of the NAPLAN writing tests has always been secondary to the technical aspects of writing that students are expected to bring to the task. This is a function of the fact that the same question is posed to all students in Years 3, 5, 7 and 9. This year, however, the question demanded both control over the genre as well as critical thinking.

Debates about “which law or rule would you make better in your view?” - and the critical engagement it requires - would be sadly unfamiliar to many Australian students who were being prepared for a test of their technical writing.

When schooling is focused so heavily on preparing for high-stakes tests, it is not surprising that teachers have to resort to “defensive pedagogies” - teaching strategies that ensure good examination results.

This is made worse by relentless preoccupations with “teacher effectiveness”, where performance is measured by student outcomes. Teachers do more than teach to the test, but the scope for this is diminished under high-stakes scrutiny.

Many students, especially from minority groups and disadvantaged communities, would be ready and motivated to discuss this year’s writing question. After all, it is a question that invites reflection on matters of fairness. However, this important opportunity is lost when it is framed within a high-pressure test that forces defensive pedagogies.

The social costs of NAPLAN

The social costs of such a narrowed education are profound. Not only does it fail to encourage students to develop tools for participating thoughtfully as “active and informed citizens”, it also makes it acceptable for education to be unquestioning about the status quo.

The appeal that children from “law-abiding families” would find it particularly difficult to engage critically with laws and rules reveals something about the kind of citizen we want our education system to foster. Should critique be seen as inappropriate? Should compliance be privileged over change? Even in the face of inequality?

As one young child was reported saying with respect to the NAPLAN question,
When I thought about all the rules I know I thought that they are really good ones. So I didn’t have anything to say about it.
Here is where the narrowing of education by NAPLAN can suit dominant social groups. Research has long shown how schooling systems reproduce the social order in which the middle-classes benefit. This has been exacerbated in recent times by the repositioning of education as a private good, where educational products and services can be bought to ensure individual success.

In this context, winners have no reason to question rules and laws, and losers needn’t be given a voice.

The displacement of critical thinking by NAPLAN positions schools as instruments of social control, rather than being sites for creativity, debate and change. The stakes are particularly high for the disadvantaged.

For as long as this is the case, it will be hard for schools to encourage students to meaningfully consider the questions fundamental to democracy and justice. Questions such as, “which law or rule would you make better in your view?”

Editor’s note: Arathi will be on hand for an Author Q&A session between 2 and 3pm tomorrow (August 21). Post any questions about NAPLAN and education in the comment section below.
The Conversation

The authors do not work for, consult to, own shares in or receive funding from any company or organisation that would benefit from this article. They also have no relevant affiliations.

This article was originally published on The Conversation. Read the original article.

Tuesday, July 2, 2013

NAPLAN Doesn't Stand Up to International Tests

by Squirrel Main, University of Melbourne

A new parliamentary report on the National Assessment Program - Literacy and Numeracy (NAPLAN) finally takes a long, hard look at the calibre of these controversial tests.

As part of the committee process, the Australian Curriculum, Assessment and Reporting Authority (ACARA), the body responsible for NAPLAN, recommended a number of reforms including online delivery, linking NAPLAN to the National Curriculum, reducing the time gap between testing and results, and introducing flexible delivery of the tests.

But missing from this list is perhaps the most important change: improving the test itself. NAPLAN needs to reflect a higher standard, especially when we compare it internationally.

How do we compare?

One simple way to see how NAPLAN stacks up globally is to compare results from the NAPLAN assessment to another international literacy test.

Comparisons between NAPLAN and another reading test for Year 4 students (known as PIRLS) show that NAPLAN may not have the depth - or the benchmarks - to assess Australian schoolchildren in a global context.

For starters, the number of students reaching the minimum standard differ.

Results published by the Australian Council for Educational Research (ACER) showed that more than one-quarter of the Australian Year 4 students who participated in PIRLS failed to meet the minimum international benchmark.

In contrast, the most recent round of NAPLAN results showed only 9% of Year 5 students did not meet the minimum national standard as the below figure shows (the grey indicates students who are failing to meet the benchmark standard in literacy):
How is the same cohort faring? NAPLAN data from 2012; PIRLS data from 2011 Author/ACER/ACARA

On the international PIRLS test, Australia’s average score was similar to the score for Bulgaria, New Zealand, Slovenia, Austria, Lithuania and Poland. And significantly lower than the average score for 21 other countries, including the United States, England and Canada, Hong Kong and Singapore.

Comparing PIRLS results across countries. ACER ([see p.16 for a complete list of international results](http://www.acer.edu.au/documents/TIMSS-PIRLS_Monitoring-Australian-Year-4-Student-Achievement.pdf)

The same cohort of children took the two tests. So what is going on here?

There are three possible explanations: the NAPLAN standard is too low, PIRLS texts are more difficult, or PIRLS items are more challenging. All three, its seems, are true.

NAPLAN misses the international mark

Dr Sue Thomson from the Australian Council for Education Research (ACER), the body that oversees PIRLS, said recently that “almost everybody agrees that the NAPLAN standards are too low”.

Even in sections where the two assessments are somewhat similar – for example, making inferences about fiction texts - students who are meeting the NAPLAN minimum are falling short of the international benchmark.

A spokesperson for ACARA said that it will “take account of international standards” when aligning the national assessment program to the national curriculum. It hopes the curriculum - mid-way through its roll-out - will also lead to “improved results”.

But teachers believe the longer PIRLS text turns students off. One Year 4 teacher explained: “they’re not used to reading such long periods of text”. While the PIRLS reader has only two stories that are nearly 800 words long, NAPLAN has seven stories, all less than 200 words.

There are two types of passages, informational and fiction.Readability statistics show PIRLS informational texts are harder to read.

Interestingly, PIRLS fiction texts are slightly easier than the NAPLAN literacy texts. This, too, brings a sobering point: even with easier texts, fewer Australian students are meeting the international benchmark once the word count goes beyond five paragraphs.

Although the NAPLAN tests are about ten items longer, the additional questions are easier recall questions. PIRLS asks more higher-order questions about its fiction texts and has more open-ended items.

Data from publicly available PIRLS (2011) and NAPLAN (2012) reading tests

Getting the results to principals

At an education department National Principals' Conference in early March only ten out of 120 principals in the audience knew about the PIRLS results. This information needs to get to principals, teachers, parents and students in order for meaningful progress to occur.

Currently, international reading assessments have longer texts, harder non-fiction, deeper questions and higher benchmarks.

When the Senate committee returns to the inquiry after the election, let’s hope that the content, nature and standards of NAPLAN plays a more central role in its recommendations.

If Australian students are to be held to a high international standard, NAPLAN needs to improve to become a world-class test.

Squirrel Main does not work for, consult to, own shares in or receive funding from any company or organisation that would benefit from this article, and has no relevant affiliations.
The Conversation

This article was originally published at The Conversation. Read the original article.