Content

Home » Publications »Performance Measurement Framework 2003-2006

NHMRC's Performance Measurement Framework 2003-2006

Please note that a new performance measurement framework is being developed for 2007–2009.

Image from Cover

In September 2004 Council approved the 2003-06 Performance Measurement Framework (PMF) that aligns with the seven outcomes of the 2003-06 Strategic Plan.

The revised PMF links the Strategic Plan and the NHMRC's legislative objectives to an outcome-output framework that is the Department of Finance and Administration's preferred model for performance measurement. This framework emphasises what the NHMRC produces (outputs) and what impacts or consequences (outcomes) this has for the community.

 

NHMRC Outcome - Output Framework 2003 - 06

Health outcome 9: Knowledge, information and training for developing better strategies to imrove the health of Australians.

arrow indicating decision flow

NHMRC outcome 9.1: Health research, ethics, advice and regulation.

arrow indicating decision flow

The PMF is an update of the original that was built on the conceptual research outcomes framework agreed to by Government following the 1999 Health and Medical Research Strategic Review. In 2002, the PMF was expanded by Council to include indicators of performance in the health advisory and health ethics roles

Using the Performance Measurement Framework

The PMF is a management tool that is integral to the NHMRC's planning and reporting processes and has three main purposes to:

  1. assist and inform the NHMRC's internal business processes, including the development of business plans and the NHMRC's Strategic Plan;
  2. demonstrate a return on investment in health and medical research funding; and
  3. utilise a range of reporting strategies informing both the Australian Government and the Australian community on NHMRC's performance in meeting its strategic objectives and legislative requirements.

The indicators and measures have been chosen on the basis that they are appropriate, achievable (albeit some more immediately than others) and proportionate to the scale of the activity, and have been developed to:

  • include a balance of inputs, processes, outputs and outcomes;
  • highlight the synergies between research, health advice, health ethics and embryo research regulation;
  • provide a baseline for comparing data over time; and
  • address existing gaps that currently inhibit our ability to fully demonstrate the impacts that NHMRC funded activities provide

[top]

Outcome 1 - Creating new knowledge

Indicator 1.1: Increased investment leading to high impact research

 Targets
  1. Funding allocated to support research

80% of MREA allocated to research activities
  1. Number of applications to conduct research

Increased demand for NHMRC support

  1. Research results with outstanding scientific impact or potential to impact highly on public health policy and practice

New Indicator - data to be benchmarked through a peer review process and reported in 2005

 

Indicator 1.2: Growth in internationally competitive knowledge Targets
  1. Rate of publication and citation outputs

Above national average
Above OECD average
  1. Comparison of NHMRC research outputs with international health and medical sector

New Indicator - to be benchmarked against selected OECD and regional countries

[top]

Outcome 2 - Enhancing capacity to innovate

Indicator 2.1: Expanded and mobile research workforce

Targets
  1. Funding allocated to people support

20% of MREA allocated to people support activities
  1. Number of people support applications received and funded

Increased demand for NHMRC support
  1. Number of researchers and research staff supported by NHMRC funding

Increase in total workforce and new new workforce
  1. Number of new researchers

New indicator - (data to be benchmarked and reported)
  1. Number of researchers based overseas who returned to Australia to undertake further research

7 Howard Florey fellowships in 2005
New data for all other grant types
  1. Completion rates of scholars

90% of training awards and scholarships completed within time
  1. Retention rates of post-graduates and postdoctoral researchers

New indicator - data to be benchmarked and reported
  1. Career mobility of researchers

New indicator - data to be benchmarked and reported

 

Indicator 2.2: Increased international recognition of Australian researchers Targets
  1. Trend in awards, prizes and other honorariums

New indicator - data to be benchmarked and reported
  1. Trend in keynote addresses, presentations and speaking engagements

New indicator - data to be benchmarked and reported

 

Indicator 2.3: Growth in access to and availability of facilities and equipment Targets
  1. Funding allocated to infrastructure

New indicator - data to be benchmarked and reported
  1. Trend in researchers accessing NHMRC supported facilities and equipment

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC supported research requiring access to unavailable infrastructure or service

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC supported researchers obtaining external funding to access facilities

New indicator - data to be benchmarked and reported

[top]

Outcome 3 - Utilising knowledge

Indicator 3.1: Increased uptake of NHMRC health advice and information

Targets
  1. Stakeholder awareness of and satisfaction with NHMRC advice and information

New indicator - Ratings to be identified for each stakeholder group through a benchmarking survey
  1. Citation rates of NHMRC advice

New indicator - data to be benchmarked and reported

 

Indicator 3.2: Improved transfer of knowledge into health policy and practice Targets
  1. Trend in NHMRC funded research rolled over into further research

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC funded research leading to changes to public health practices and policies

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC research and researchers cited in NHMRC advisory publications

New indicator - data to be benchmarked and reported
  1. New or updated advisory products

75% of new products address issues in a national priority area

 

Indicator 3.3: Increased commercial activity Targets
  1. Funds allocated to encourage commercial outcomes

2.5% of MREA budget allocated to commercialising discovery
  1. Number of applications received and funded

Increased demand for NHMRC support
  1. Trend in NHMRC Development Grants that roll over into further commercial development

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC Industry Fellowship holders who continue with commercialisation

New indicator - data to be benchmarked and reported
  1. Trend in NHMRC funded research with commercial potential

New indicator - data to be benchmarked and reported
  1. Growth in research leading to commercial outcomes

New indicator - data to be benchmarked and reported
  1. Growth in research grants rolled over into industry development programs

New indicator - data to be benchmarked and reported
  1. Researcher awareness and knowledge in protecting and managing Intellectual Property

New indicator - data to be benchmarked and reported

[top]

Outcome 4 - Ensuring high ethical standards

Indicator 4.1: Improved support, advice and guidance on ethics issues in health and for conducting research

Targets
  1. Trend in support provided by the NHMRC
  
    1. Number of new and existing guidelines, reports and papers produced and disseminated

2 new
2 revised
5 reviewed
    1. Number of NHMRC sponsored information and education forums

National conference May 2005
HRECs national training program completed
    1. Number of bulletins and information sheets produced by NHMRC

4 AHEC bulletins/year
2 AWC bulletins/year
  1. Stakeholder awareness of and satisfaction with NHMRC support, advice and guidance

HRECs 90% aware, 80% satisfied
Researchers 50% aware, 50% satisfied

 

Indicator 4.2: Compliance with NHMRC ethics guidelines Targets
  1. Proportion of Human Research Ethics Committees complying with the National Statement and associated NHMRC ethics guidelines

100% compliance
  1. Proportion of Animal Ethics Committees complying with the Australian code of practice for the care and use of animals for scientific purposes and associated NHMRC ethics guidelines

100% compliance

[top]

Outcome 5 - Strengthening communications and collaborations

Indicator 5.1: Growth in collaborations and partnerships

Targets
  1. Growth in external funding from collaborations

5% of new funding awarded per annum matched by external funding
  1. Trend in collaborations and partnerships

40% of research involves national collaboration
30% of research involves international collaboration

 

Indicator 5.2: Increased engagement with the community Targets
  1. Trend in consultations

NHMRC consultation processes are receiving increased positive responses from the public and stakeholders as appropriate
  1. Growth in links with other organisations

New Indicator - data to be benchmarked and reported.

  1. Demand for NHMRC products

5% increase above current combined sales/download levels
  1. Stakeholder awareness of NHMRC support, advice and guidance and satisfaction level

80% of stakeholders aware of NHMRC support
85% of stakeholders are satisfied with support provided by the NHMRC
  1. Community awareness of issues addressed by the NHMRC

New indicator - data to be benchmarked and reported
  1. Change in community attitudes on issues addressed by NHMRC

Enhanced awareness of specific issues

[top]

Outcome 6 - Regulating embryo research and maintaining the prohibition of human cloning

Indicator 6.1: An effective national system of regulation

Targets
  1. Number of licence applications considered by the Licensing Committee, including variations and issues.

Six monthly report to Parliament on licences
  1. Number of information exchange visits

New indicator - data to be benchmarked and reported
  1. Stakeholder awareness and satisfaction with the implementation of the regulatory system

New indicator - data to be benchmarked and reported
  1. Stakeholders understand their responsibilities and rights under the legislation

New indicator - data to be benchmarked and reported

 

Indicator 6.2: Compliance with the legislation Targets
  1. Trends in activity to monitor compliance

New indicator - data to be benchmarked and reported
  1. Audits of the monitoring and compliance systems

Unqualified audits
  1. Review of the Research Involving Human Embryos Act 2002 and Prohibition of Human Cloning Act 2002

Report to both Houses of Parliament and COAG by 19 December 2005

[top]

Outcome 7 - Achieving high standards of governance and accountability

Indicator 7.1: Effective planning, monitoring and reporting

Targets
  1. Implementation of the Strategic Plan

Council report to Minister on implementation by end of 2005 (Strategic Plan approved by Minister at beginning of triennium)
  1. Regular evaluation of the risks to NHMRC

Management Committee report every six months to Council on unacceptable risks
  1. Compliance with legislative reporting requirements

Submission of the NHMRC Annual Report, Strategic Plan, Department of Health and Ageing Annual Report
Portfolio Budget Statement in the required timeframes
Licensing Committee six-monthly Reports to Parliaments
  1. Regular reporting of Budgets to Council

Expenditure to be within allocated budget

 

Indicator 7.2: Effective information management Targets
  1. Proportion of records complying with the corporate record keeping policy

All records are complete and accessible
  1. Proportion of decisions recorded in register and supported by evidence

100% recorded and supported by evidence
  1. Satisfaction with NHMRC information management processes and practices

90% of users satisfied

 

Indicator 7.3: Effective governance arrangements Targets
  1. Regular review of governance arrangements

Review effectiveness of governance by October 2005
  1. Stakeholder satisfaction with NHMRC governance

90% of stakeholders satisfied
95% of committee and Council members satisfied
Ministerial acceptance of Strategic Plan, Annual Program Budget and Annual Report within legislated timeframes
  1. Approval of NHMRC leadership and management

Triennial multi-source appraisal of Executive and Chairs completed by October 2005

[top]

See related information on:

 

Related topics

footer links