PISA – more than just league tables?

Parliament house flag post

PISA – more than just league tables?

Posted 12/09/2012 by Carol Ey

In announcing the Government’s response to the Gonski Review, Prime Minister Gillard statedthat the aim of the new National Plan for School Improvement ‘is to ensure that by 2025 Australia is ranked as a top 5 country in the world for the performance of our students in Reading, Science, Mathematics’.

Much of the discussion about the Australian school system has focussed on the relative (and absolute) decline of Australia in the results from the triennial Programme for International Student Assessment (PISA) over the period 2000 to 2009 despite an increase in real expenditure on school education of 44 per cent over the period. In considering how the school system can be improved, commentators have often looked to the current ‘top 5’ in the PISA rankings—Finlandand the four East Asian jurisdictions included in the 2009 survey (Hong Kong, Shanghai, Korea and Singapore).

However, closer analysis of the PISA data suggests that using the PISA assessment league tables may not be the best measure of the quality of school systems.
Under the PISAprogram, every three years since 2000 a sample of 15-year-old students around the world have been assessed on their reading, mathematics and science performance. For PISA 2009, some 470 000 students participated, representing about 26 million 15-year-olds in 65 countries. In addition to assessing performance, the students and school principals were asked a range of questions about the school and home environments, as well as students’ attitudes to various aspects of schooling. Testing has recently been undertaken for the 2012 Australian PISA sample.

In considering Australia’s relative decline in the ranking lists, it is worth noting that in 2000 only 32 countries took part in the study, while 65 countries participated in 2009. Part of the reason Australia appears further down the ranking lists is the inclusion of countries which have not previously been included in the results. For example, Shanghai and Singapore participated in PISA for the first time in 2009.
While Australia’s absolute scores have also declined, the results for Finland have experienced a similar reduction across all three areas. In fact, almost all the non-Asian countries that were ranked ahead of Australia in the initial 2000 results have seen a decline in their performance across each of the three subject areas assessed, largely driven by the poorer performance of high-achieving students. This suggests causes outside the direct influence of the Australian education system. Possible explanations include a decline in reading for pleasureamong teenagers or an inability to focus on extended texts due to an increasing exposure to reading on the Internet.

In addition, while PISA attempts to assess the quality, equity and efficiency of school systems, it does not include any measure of the impact of formalised learning outside schools. For many students in the top ranked East Asian school systems this forms a considerable part of their learning experience, in some cases exceeding their exposure to the school system. 

For example, a 2011 article in Time Magazine reported that Korean authorities had introduced a curfew to prevent students studying in private tutoring academies past 10 pm. A typical academic schedule for many students in senior high school starts at 8 am and continues sometimes until 1 am. In 2010, 74 per cent of students had some form of private after-school education, at an average cost of USD2600 per student per year. A recent Gratton Institute report noted that, ‘Korea spends much less per student than other education systems, yet achieves far better student success’. However, this analysis does not include the private tutoring costs, which would increase the per capita expenditure for secondary students by around 30 per cent.

Even if the Australian education system (and its students) were prepared to accept such an approach in order to achieve high results on assessment tests, there remains the question about how valid these tests are as an overall gauge of the success of an education system. In the 2003 PISA study students were asked how useful they thought their schooling was for later life. Eighty-four per cent of Australian students agreed with the statement that, ‘School has taught me things which could be useful in a job’, compared with only 66 per cent of students from Korea and Hong Kong. On the other hand, only 6 per cent of Australian students thought school had been a waste of time, as against 10 per cent of Korean students and 13 per cent of those from Hong Kong.[1]

PISA also includes measures of the equity of the school system. One measure is the spread of scores from the 5th to the 95th percentile, indicating the extent to which the education system supports those at the lower end of academic ability. Although Australia’s performance on this measure is poorer than the OECD average, it is similar to that of Singapore on both reading and scientific literacy, and better than all four East Asian systems in relation to mathematical literacy.

Another measure is the relationship between student background and educational achievement. PISA reports on the socio-economic gradient of school systems to assess their relative equity. On this measure Australia is rated as ‘Average Equity’ for reading, significantly lower than Hong Kong and Finland, but similar to Korea, Shanghai and Singapore.

There is no doubt that PISA provides a very rich source of information about students’ experience of education in countries around the world, as well as the influence of home and school factors. However, it may be misleading to only use the PISA results in reading, mathematics and science as a summary of the success or otherwise of the Australian education system.

[1] Programme for International Student Assessment, Learning for Tomorrow’s World: First Results from PISA 2003’, Organisation for Economic Co-operation and Development, 2004, p. 126

Thank you for your comment. If it does not require moderation, it will appear shortly.
Facebook LinkedIn Twitter Add | Email Print


Flagpost is a blog on current issues of interest to members of the Australian Parliament

Parliamentary Library Logo showing Information Analysis & Advice




refugees asylum immigration Australian foreign policy Parliament climate change elections women social security Indigenous Australians Australian Bureau of Statistics Employment Sport illicit drugs people trafficking taxation Medicare welfare reform Australian Defence Force higher education welfare policy United Nations Asia income management Middle East criminal law disability Australian Sports Anti-Doping Agency World Anti-Doping Agency United States federal budget health financing gambling school education forced labour aid statistics Australian Electoral Commission WADA emissions trading Australia in the Asian Century steroids detention Private health insurance OECD ASADA labour force transport Law Enforcement Australian Federal Police Industrial Relations people smuggling dental health National Disability Insurance Scheme Australian Crime Commission slavery Senate election results Papua New Guinea Australian Public Service International Women's Day corruption Afghanistan Fair Work Act child protection debt federal election 2013 parliamentary procedure poker machines ALP New Zealand Newstart Parenting Payment 43rd Parliament political parties Census constitution High Court skilled migration voting Federal Court terrorist groups Higher Education Loan Program HECS youth paid parental leave Aviation environment foreign debt gross debt net debt defence capability customs doping health crime health risks multiculturalism aged care Gonski Review of Funding for Schooling sex slavery sea farers Special Rapporteur leadership United Kingdom UK Parliament Electoral reform politics banking firearms public policy violence against women domestic violence mental health China ADRV terrorism social media pensions welfare ASIO intelligence community Australian Security Intelligence Organisation governance public service reform Carbon Pricing Mechanism carbon tax mining military history employer employee fishing by-election European Union same sex relationships international relations coal seam gas family assistance planning United Nations Security Council Australian economy food vocational education and training Drugs Indonesia children codes of conduct terrorist financing money laundering Productivity asylum seekers early childhood education Canada Population Financial sector national security fuel disability employment Tasmania integrity science research and development Australian Secret Intelligence Service sexual abuse federal state relations World Trade Organization Australia accountability housing affordability bulk billing water renewable energy children's health health policy Governor-General US economy export liquefied natural gas foreign bribery question time speaker superannuation expertise Senators and Members climate Intergovernmental Panel on Climate Change Department of Agriculture Fisheries and Forestry food labelling Pacific Islands reserved seats new psychoactive substances synthetic drugs UNODC carbon markets health reform Indigenous constitutional recognition of local government local government consumer laws PISA royal commission US politics language education baby bonus Leaders of the Opposition Parliamentary remuneration health system Australia Greens servitude Trafficking Protocol energy forced marriage rural and regional Northern Territory Emergency Response ministries social citizenship human rights citizenship Defence High Court; Indigenous; Indigenous Australians; Native Title ACT Indigenous education Norfolk Island External Territories emissions reduction fund; climate change child care funding refugees immigration asylum procurement Indigenous health e-voting internet voting nsw state elections 44th Parliament 2015 ABS Age Pension Death penalty capital punishment execution Bali nine Bali bombings Trade EU China soft power education Fiji India Disability Support Pension Antarctica Diplomacy by-elections state and territories workers Bills anti-corruption fraud bribery transparency corporate ownership whistleblower G20 economic reform innovation standards NATO Members of Parliament Scottish referendum Middle East; national security; terrorism social services Criminal Code Amendment (Misrepresentation of Age to a Minor) Bill 2013 online grooming sexual assault of minors ACT Assembly public health smoking plain packaging tobacco cigarettes Asia; Japan; international relations Work Health and Safety Migration; asylum seekers; regional processing China; United States; international relations fiscal policy Racial Discrimination Act; social policy; human rights; indigenous Australians Foreign policy Southeast Asia Israel Palestine regional unemployment asylum refugees immigration political finance donations foreign aid Economics efficiency human rights; Racial Discrimination Act employment law bullying Animal law; food copyright Australian Law Reform Commission industry peace keeping contracts workplace policies trade unions same-sex marriage disorderly conduct retirement Parliament House standing orders public housing prime ministers election timetable sitting days First speech defence budget submarines Somalia GDP forestry world heritage political engagement leave loading Trade; tariffs; safeguards; Anti-dumping public interest disclosure whistleblowing Productivity Commission regulation limitation period universities Ireland cancer gene patents genetic testing suspension of standing and sessional orders animal health live exports welfare systems infant mortality middle class welfare honorary citizen railways disciplinary tribunals standard of proof World Health Organisation arts international students skilled graduate visas temporary employment visas apologies roads Italy national heritage NHMRC nutrition anti-dumping Constitutional reform referendum Rent Assistance competition policy pharmaceutical benefits scheme obesity evidence law sacrament of confession US presidential election international days DFAT UN General Assembly deregulation Regulation Impact Statements administrative law small business Breaker Morant homelessness regional engagement social determinants of health abortion Youth Allowance Members suspension citizen engagement policymaking federal election 2010 workplace health and safety Trafficking in Persons Report marine reserves hearing TAFE Victoria astronomy resources sector YMCA youth parliament alcohol Korea rebate Australian Greens presidential nomination Racial Discrimination Act entitlements political parties preselection solar hot water Financial Action Taskforce Horn of Africa peacekeeping piracy Great Barrier Reef Stronger futures political financing Hung Parliament political education social inclusion Social Inclusion Board maritime early childhood National Quality Framework for Early Childhood Education and Care Murray-Darling Basin Iran sanctions Norway hospitals

Show all
Show less
Back to top