Measuring Research Impact: Ngā Whakaputanga Auaha | Non-traditional Research Outputs (NTROs)

Non-traditional research outputs (NTROs) play an important role in the advancement of knowledge across a wide range of disciplines. They can also demonstrate the impact of a university or research centre's work. The range of impacts listed below illustrates the wide variety of areas in which impacts from research across the Creative and Performing Arts may be found to have a clear influence on the quality of life of individuals and communities locally, nationally and internationally:

• The enrichment of cultural life and public discourse through the creative and performing arts
• Increased community access and enrichment of cultural experiences through pre-event talks, programme notes and other public and media commentary associated with performances, exhibitions, screenings or broadcasts
• Contributions to processes of commemoration, memorialisation, reconciliation and cultural development
• The impact of site-based art practices on how audiences engage with issues such as environmental politics, the histories of contested sites or the politics of land and place
• The impact of hui ā iwi focusing on whaikōrero, mau rākau or tā moko as customary art forms that shape, sustain and advance Māori knowledge and development
• The impact of art, design, music, literature and the performing arts on the profile of New Zealand culture and society internationally
• Contributions to innovation and entrepreneurial activity through the design and delivery of new products and services
• Contributions to economic prosperity via the creative sector, including publishing, music, theatre, museums and galleries, film and television, fashion, tourism and computer games
• Provision of expert advice to governments, non-governmental organisations, charities and the private sector that influences policy and/or practice
• Economic benefits generated by design using new technologies
• Increased public involvement in literary, musical and other forms of creative endeavour
• The impact of new expert systems that facilitate innovative community participation, organisational change, financial services and organisational communication
• The contribution of artistic practices to public understanding of human rights and standards of health and wellbeing.

The ephemeral nature of some NTROs such as performances or exhibitions can present a challenge for impact measures. For researchers producing NTROs, it is worth being more proactive from the outset in compiling evidence of research impact from a range of sources. 

There is no definitive way to measure impact for NTROs, rather there are a number of different sources that can be used to demonstrate impact.

For creative works including design

Outputs include visual arts, architectural works, and design

Sources

• Catalogues
• Gallery website
• Publisher website
• Sales data
• Commissions and invitations to collaborate
• Artist-in-residence programs
• Google
• Social media (X (formerly Twitter), Facebook etc)

Data points

• Ticket sales
• Reviews and ratings
• Interviews
• Awards and nominations
• Venue prestige
• Notability of performers
• Number of downloads & views

For recordings & rendered works

Outputs include performances, music, audio, film, TV, video art. 

Sources

• Vimeo
• YouTube
• Spotify
• Festival website
• Online and printed reviews
• Social media (X (formerly Twitter), Facebook etc)
• Sales data
• Commissions and grants
• Research Commons

Data points

• Views, streams and downloads
• Number of likes
• Number of sales
• Citations
• Shares and mentions
• Number of reviews
• Awards and nominations