PISA – more than just league tables?

Parliament house flag post

PISA – more than just league tables?

Posted 12/09/2012 by Carol Ey

In announcing the Government’s response to the Gonski Review, Prime Minister Gillard statedthat the aim of the new National Plan for School Improvement ‘is to ensure that by 2025 Australia is ranked as a top 5 country in the world for the performance of our students in Reading, Science, Mathematics’.

Much of the discussion about the Australian school system has focussed on the relative (and absolute) decline of Australia in the results from the triennial Programme for International Student Assessment (PISA) over the period 2000 to 2009 despite an increase in real expenditure on school education of 44 per cent over the period. In considering how the school system can be improved, commentators have often looked to the current ‘top 5’ in the PISA rankings—Finlandand the four East Asian jurisdictions included in the 2009 survey (Hong Kong, Shanghai, Korea and Singapore).

However, closer analysis of the PISA data suggests that using the PISA assessment league tables may not be the best measure of the quality of school systems.
Under the PISAprogram, every three years since 2000 a sample of 15-year-old students around the world have been assessed on their reading, mathematics and science performance. For PISA 2009, some 470 000 students participated, representing about 26 million 15-year-olds in 65 countries. In addition to assessing performance, the students and school principals were asked a range of questions about the school and home environments, as well as students’ attitudes to various aspects of schooling. Testing has recently been undertaken for the 2012 Australian PISA sample.

In considering Australia’s relative decline in the ranking lists, it is worth noting that in 2000 only 32 countries took part in the study, while 65 countries participated in 2009. Part of the reason Australia appears further down the ranking lists is the inclusion of countries which have not previously been included in the results. For example, Shanghai and Singapore participated in PISA for the first time in 2009.
While Australia’s absolute scores have also declined, the results for Finland have experienced a similar reduction across all three areas. In fact, almost all the non-Asian countries that were ranked ahead of Australia in the initial 2000 results have seen a decline in their performance across each of the three subject areas assessed, largely driven by the poorer performance of high-achieving students. This suggests causes outside the direct influence of the Australian education system. Possible explanations include a decline in reading for pleasureamong teenagers or an inability to focus on extended texts due to an increasing exposure to reading on the Internet.

In addition, while PISA attempts to assess the quality, equity and efficiency of school systems, it does not include any measure of the impact of formalised learning outside schools. For many students in the top ranked East Asian school systems this forms a considerable part of their learning experience, in some cases exceeding their exposure to the school system. 

For example, a 2011 article in Time Magazine reported that Korean authorities had introduced a curfew to prevent students studying in private tutoring academies past 10 pm. A typical academic schedule for many students in senior high school starts at 8 am and continues sometimes until 1 am. In 2010, 74 per cent of students had some form of private after-school education, at an average cost of USD2600 per student per year. A recent Gratton Institute report noted that, ‘Korea spends much less per student than other education systems, yet achieves far better student success’. However, this analysis does not include the private tutoring costs, which would increase the per capita expenditure for secondary students by around 30 per cent.

Even if the Australian education system (and its students) were prepared to accept such an approach in order to achieve high results on assessment tests, there remains the question about how valid these tests are as an overall gauge of the success of an education system. In the 2003 PISA study students were asked how useful they thought their schooling was for later life. Eighty-four per cent of Australian students agreed with the statement that, ‘School has taught me things which could be useful in a job’, compared with only 66 per cent of students from Korea and Hong Kong. On the other hand, only 6 per cent of Australian students thought school had been a waste of time, as against 10 per cent of Korean students and 13 per cent of those from Hong Kong.[1]

PISA also includes measures of the equity of the school system. One measure is the spread of scores from the 5th to the 95th percentile, indicating the extent to which the education system supports those at the lower end of academic ability. Although Australia’s performance on this measure is poorer than the OECD average, it is similar to that of Singapore on both reading and scientific literacy, and better than all four East Asian systems in relation to mathematical literacy.

Another measure is the relationship between student background and educational achievement. PISA reports on the socio-economic gradient of school systems to assess their relative equity. On this measure Australia is rated as ‘Average Equity’ for reading, significantly lower than Hong Kong and Finland, but similar to Korea, Shanghai and Singapore.

There is no doubt that PISA provides a very rich source of information about students’ experience of education in countries around the world, as well as the influence of home and school factors. However, it may be misleading to only use the PISA results in reading, mathematics and science as a summary of the success or otherwise of the Australian education system.

[1] Programme for International Student Assessment, Learning for Tomorrow’s World: First Results from PISA 2003’, Organisation for Economic Co-operation and Development, 2004, p. 126

Thank you for your comment. If it does not require moderation, it will appear shortly.
Facebook LinkedIn Twitter Add | Email Print


Flagpost is a blog on current issues of interest to members of the Australian Parliament

Parliamentary Library Logo showing Information Analysis & Advice




refugees asylum immigration Australian foreign policy Parliament elections climate change social security women welfare reform taxation Indigenous Australians Australian Defence Force welfare policy school education higher education private health insurance health financing emissions trading Senate Australian Bureau of Statistics employment people trafficking Asia statistics Middle East illicit drugs gambling health reform federal election 2010 Australian Public Service income management Medicare disability Sport United Nations environment industrial relations constitution transport politics criminal law Afghanistan health forced labour food public service reform aged care aid Australian Sports Anti-Doping Agency World Anti-Doping Agency United States federal budget Carbon Pricing Mechanism dental health international relations governance regulation Fair Work Act voting law enforcement electoral reform OECD Australian Electoral Commission WADA child protection poker machines Australia in the Asian Century steroids National Disability Insurance Scheme detention 43rd Parliament slavery health system leadership domestic violence parliamentary procedure International Women's Day accountability defence capability multiculturalism ASADA Australian Federal Police labour force people smuggling debt New Zealand Australian Crime Commission pharmaceutical benefits scheme political parties coal seam gas Human rights crime China Census election results UK Parliament Papua New Guinea banking corruption pensions children's health Aviation federal election 2013 foreign debt gross debt net debt Senators and Members ALP Newstart Parenting Payment Youth Allowance sea farers United Kingdom energy food labelling Australian economy violence against women vocational education and training military history by-election High Court skilled migration mental health Federal Court terrorist groups science social media Higher Education Loan Program HECS federal state relations youth paid parental leave same sex relationships customs planning doping health risks Gonski Review of Funding for Schooling sex slavery Special Rapporteur Northern Territory Emergency Response social policy ANZUS Rural and regional trade unions Foreign affairs election timetable Indigenous royal commission Productivity firearms public policy Population ADRV terrorism transparency research and development welfare ASIO intelligence community Australian Security Intelligence Organisation carbon tax mining employer employee renewable energy regional unemployment fishing European Union family assistance United Nations Security Council forestry Drugs welfare systems Indonesia children Constitutional reform local government codes of conduct terrorist financing homelessness Parliamentary remuneration money laundering Trafficking in Persons Report social inclusion paternalism environmental law US presidential election nutrition ODA Defence sitting days electoral divisions Southeast Asia administrative law universities TAFE Ireland citizenship asylum seekers early childhood education Canada Financial sector national security fuel disability employment Tasmania integrity standards NATO Australian Secret Intelligence Service sexual abuse World Trade Organization Australia public health housing affordability bulk billing water health policy Governor-General US economy export liquefied natural gas foreign bribery question time speaker superannuation public housing expertise climate Intergovernmental Panel on Climate Change Department of Agriculture Fisheries and Forestry Pacific Islands reserved seats new psychoactive substances synthetic drugs UNODC carbon markets animal health middle class welfare constitutional recognition of local government referendum consumer laws PISA competition policy US politics language education baby bonus Leaders of the Opposition citizen engagement policymaking Australia Greens servitude Trafficking Protocol forced marriage alcohol entitlements ministries Hung Parliament social citizenship maritime Iran regional students school chaplains federal budget 2011-12 salary Medicare Locals primary care Building the Education Revolution marine pollution sustainability prisons police deaths in custody electoral margins electoral pendulum electoral redistribution redistribution NSW redistribution WA redistribution ACT electoral boundaries ASEAN Sustainable Development Goals Double dissolution Senators safety vehicles MYEFO Pathology tertiary education Taiwan Xi Ma meeting family violence government financial advisers financial planners Financial System Inquiry Murray Inquiry China; Economic policy; Southeast Asia; Africa housing Speaker; House of Representatives; Parliament High Court; Indigenous; Indigenous Australians; Native Title ACT Indigenous education Norfolk Island External Territories emissions reduction fund; climate change child care funding refugees immigration asylum procurement Indigenous health e-voting internet voting nsw state elections 44th Parliament 2015 ABS Age Pension Death penalty capital punishment execution Bali nine Bali bombings Trade EU China soft power education Fiji India Disability Support Pension Antarctica Diplomacy by-elections state and territories Bills anti-corruption fraud bribery corporate ownership whistleblower G20 economic reform innovation Members of Parliament Scottish referendum Middle East; national security; terrorism social services Criminal Code Amendment (Misrepresentation of Age to a Minor) Bill 2013 online grooming sexual assault of minors ACT Assembly smoking plain packaging tobacco cigarettes Asia; Japan; international relations Work Health and Safety Migration; asylum seekers; regional processing China; United States; international relations fiscal policy Racial Discrimination Act; social policy; human rights; indigenous Australians Foreign policy Israel Palestine asylum refugees immigration political finance donations foreign aid Economics efficiency human rights; Racial Discrimination Act employment law bullying Animal law; food copyright Australian Law Reform Commission industry peace keeping contracts workplace policies same-sex marriage disorderly conduct retirement Parliament House standing orders prime ministers First speech defence budget submarines workers Somalia GDP world heritage political engagement leave loading Trade; tariffs; safeguards; Anti-dumping public interest disclosure whistleblowing Productivity Commission limitation period cancer gene patents genetic testing suspension of standing and sessional orders live exports infant mortality honorary citizen railways disciplinary tribunals standard of proof World Health Organisation arts international students skilled graduate visas temporary employment visas apologies roads Italy national heritage NHMRC anti-dumping Rent Assistance obesity evidence law sacrament of confession international days DFAT UN General Assembly deregulation Regulation Impact Statements small business Breaker Morant regional engagement social determinants of health abortion Members suspension workplace health and safety marine reserves hearing Victoria astronomy resources sector YMCA youth parliament Korea rebate Australian Greens presidential nomination Racial Discrimination Act political parties preselection solar hot water Financial Action Taskforce Horn of Africa peacekeeping piracy Great Barrier Reef Stronger futures political financing political education Social Inclusion Board early childhood National Quality Framework for Early Childhood Education and Care Murray-Darling Basin sanctions Norway hospitals republic President Barack Obama Presidential visits qantas counselling Korean peninsula Work Choices biosecurity hendra federalism federation preselection therapeutic goods Therapeutic Goods Administration plebiscites computer games pests suicide nuclear COAG Ministerial Councils floods ADHD stimulant medication advertising electricity extradition conscience votes poverty preventative health rural health coastal erosion Parliamentary Budget Office work-life balance

Show all
Show less
Back to top