Performance Based Research Fund Explained

The Performance Based Research Fund (PBRF) was a New Zealand tertiary education funding process, assessing the research performance of tertiary education organisations (TEOs) and then funding them on the basis of their performance. [1] The PBRF provided million to support the tertiary sector in 2018/19.[2]

The PBRF model had three elements to:

All New Zealand Tertiary Education Organisations (TEOs) who were approved by the New Zealand Qualifications Authority (NZQA) to award degrees, and also received Student Achievement Component (SAC) funding from the Tertiary Education Commission (TEC) were entitled to participate in the PBRF Quality Evaluation process. [3] In March 2024, the Government announced that the 2025 round was cancelled and all work related to it was stopped, pending a review by University Advisory Group.[4]

Quality evaluation

The major element, the Quality Evaluation, is held periodically. The first was held in 2003, the second, a partial round in which not all staff were required to submit portfolios, was held in 2006, the third in 2012 and the latest full round was held in 2018. Due to COVID-19, the next round was delayed by a year and was due to be held in 2025.[5] In March 2024, the Government announced that the 2025 round was cancelled and all work related to it was stopped, pending a review by the University Advisory Group (UAG). The UAG is chaired by Peter Gluckman.

Each Quality Evaluation assessed the quality of research conducted at TEOs, and funding is allocated accordingly. Quality is determined by an assessment of research degree completion numbers, the amount of external research funding an institution achieves, and an evaluation of the individual research performance of all academic staff teaching on degrees or employed to conduct research.

Each academic staff member was required (with some exceptions) to submit an Evidence Portfolio which records their research outputs, contribution to research environment, and peer esteem. They were then assessed as A, B, C or R category. The A indicated international standing, B national, C local and R research inactive or active at a lower level.

From 2006 two new categories, C(NE) and R(NE) were introduced, for new and emerging researchers who had not yet had the benefit of a full six year census period. Each staff member was assigned a numerical grade (in 2006 5 for an A, 3 for a B, 1 for a C or C (NE), and 0 for R and R (NE)). This was used to calculate an overall score. Since the numerical scores assigned for the 2003 assessment and that for the 2006 assessment differed, the results of the two assessments were not entirely comparable, despite the 2006 assessment being designed to be a partial round.

In assessing individuals rather than groups, PBRF differed from the otherwise similar Research Assessment Exercise (RAE) in the United Kingdom.

New Zealand universities up to 2012

In 2012, The Victoria University of Wellington was ranked first for research quality. The research rankings up to that year are below. [6]

However these figures are based on the AQS(N) reported average, which measured research quality against the number of full-time equivalent staff receiving an A, B, or C grade. This measure was discontinued for the 2018 round.

RankUniversity2012 Quality score2006 Quality score2003 Quality score
1Victoria5.513.833.39
2Auckland5.124.193.96
3Otago4.964.233.23
4Canterbury4.794.103.83
5Waikato4.533.732.98
6Massey4.313.052.11
7Lincoln4.022.972.56
8AUT3.591.860.77
National average4.662.962.59

Other tertiary institutions (2012)

Other tertiary institutions scoring above 2.0 in the 2012 PBRF round including Polytechnics, Institutes of Technology and Private Training Establishments are below.

Institution2012 Quality score
Laidlaw College3.25
Te Whare Wānanga O Awanuiārangi3.09
Unitec New Zealand2.94
Eastern Institute of Technology2.83
Otago Polytechnic2.79
Manukau Institute of Technology2.76
Carey Baptist College2.73
Christchurch Polytechnic Institute of Technology2.57
Wellington Institute of Technology2.51
Northland Polytechnic2.44
Whitireia Community Polytechnic2.37
Waikato Institute of Technology2.36

2018 Results (Universities)

These results are based on the AQS(S) - average quality, based on the number of teaching and research staff in a given tertiary education organisation, and is now the primary measure of research quality. [7] These figures were reported by the TEC in 2019 [8]

RankUniversity2018 Quality score
1Victoria29.19
3Otago26.09
4Canterbury25.92
2Auckland24.94
5Waikato21.76
6Massey19.5
7Lincoln17.64
8AUT15.78

Other tertiary institutions (2018)

Other tertiary institutions scoring above 2.0 in the 2018 PBRF round including Polytechnics, Institutes of Technology and Private Training Establishments are below.

Institution2018 Quality score
Carey Baptist College10.11
Whitecliffe College of Arts and Design7.4
Good Shepherd College – Te Hepara Pai5.45
Unitec New Zealand5.24
New Zealand College of Chiropractic5.09
Otago Polytechnic3.8
Laidlaw College3.05
Media Design School2.73
Te Whare Wānanga O Awanuiārangi2.66
Bethlehem Tertiary Institute2.47
Eastern Institute of Technology2.35
Waikato Institute of Technology2.25

External links

Notes and References

  1. Web site: Performance-Based Research Fund. 19 September 2016.
  2. Web site: Vote Tertiary Education - Education and Workforce Sector - Estimates 2018/2019. New Zealand Treasury.
  3. Web site: Tertiary Education Commission. 2019. Performance-Based Research Fund (PBRF) 2018 Quality Evaluation results: Frequently Asked Questions..
  4. Web site: Education . New Zealand Ministry of . 2024-03-27 . University Advisory Group established and PBRF Quality Evaluation 2026 cancelled . 2024-03-27 . Tertiary Education Commission . en-NZ.
  5. Web site: Tertiary Education Commission. 2021. PBRF 2025 Quality Evaluation.
  6. Web site: Tertiary Education Commission. Performance-Based Research Fund Evaluating Research Excellence – the 2012 Assessment Final Report. 2013-04-12. https://web.archive.org/web/20130512032624/http://www.tec.govt.nz/Documents/Reports%20and%20other%20documents/PBRF-Assessment-Interim-Report-2012.pdf. 2013-05-12.
  7. Web site: Ministry of Education. Fact Sheet: Changes to the Performance-Based Research Fund.
  8. Web site: Tertiary Education Commission. 2019. Improving Research Quality: The results of the PBRF 2018 Quality Evaluation.