Testing innovative methods to evaluate cultural and creative spillovers in Europe

This is the second research stage of the cultural and creative spillovers research project. In 2015, we commissioned a preliminary evidence review of research and evaluation that purported to measure or demonstrate spillover effects. This report was written by Tom Fleming Creative Consultancy and has been widely shared across Europe and beyond among the research and policy community. In 2016, we launched a call (see the brief below) for case studies that will document, evaluate and make recommendations based on arts, cultural and creative activity where cultural and creative spillover effects have been evaluated or might be evaluated using and testing innovative methods.

We are delighted to present the four final reports from the bodies selected to deliver this research -

More information on the research partners and their proposals (methods and hypotheses) are below.

The partnership is in the process of absorbing the outcomes of these reports, and we will be publishing a conclusion later in 2017. Our concluding report will comment on and deliver recommendations on the efficacy of methodological approaches used in different settings to measure spillover effects and on future methodological approaches to investigating spillover effects. We expect this to be made public by September 2017. We hope that in the long term the findings of this research project will lead to a tool kit or consistent approach to better understand and measure cultural and creative spillover effects of the arts, culture and the creative industries in Europe.

Find out more by emailing us.
Download the original research brief below.

Lucca Comics & Games

Towards a Holistic Methodology for the Assessment of Cultural and Creative Spillovers

Lucca, Italy

Researchers: Dr Yesim Tonga & Dr Rafael Brundo Uriarte
Partners: Lucca Comics & Games Srl and LYNX Research Unit – IMT School for Advanced Studies Lucca, Italy

About: Arts, culture and creative industries generate diverse spillovers. Within this context, big scale cultural events, particularly festivals, appear as an exceptional subject since they constitute hybrid and cross-sector spaces where there is an intense/interactive production, consumption and experience of culture with a complex ecology. To capture this complexity and diverse spillovers of festivals, it is possible to integrate qualitative and quantitative methods and develop a re-usable holistic methodological framework based on machine learning, statistics, network analysis and CDA to investigate knowledge and network spillovers and their causalities, specifically for employability and skills development, new organisational models, creating an attractive ecosystem and economic impacts.
In this project, an innovative and holistic methodology will be adopted that combines qualitative and quantitative methods to analyse some of the most important spillovers of big scale cultural events. With the aim to demonstrate its applicability, the researchers will employ this framework on the biggest festival that is dedicated to fantasy culture in Europe and the second biggest in the world: Lucca Comics & Games (LC&G). Furthermore, LC&G can be considered as a public governance success story in an exceptional way since it is a public initiative and the autonomous management structure was established by the Municipality of Lucca, under Lucca Holding S.p.A, which is a public limited company entirely owned by the city. To understand the spillovers of such a big event, a multi-faceted perspective is required, which will be achieved through different data sources: a database of more than 7,000 audience surveys and around 60 commercial partners surveys, conducted in the last LC&G edition; longitudinal social media data; archival information; and focus groups.

For more Information please visit: http://www.luccacomicsandgames.com/it/lcg/home/ and https://www.imtlucca.it/

Logo IMT_ENG_horiz_blue.jpg

Festival Rotterdam Unlimited (RU)

The Value-based Approach (VBA) to evaluate the transfer of innovation from the cultural and creative industries to the rest of the economy and society

Rotterdam, the Netherlands

Researchers: CREARE Foundation (Consortium Members: Prof. A. Klamer/ Erasmus University, L. Petrova/ CREARE/Erasmus University, D. Kiss/ Het Atelier/Erasmus University)
Partners: Erasmus University, Festival Rotterdam Unlimited

About: We test a method, called Value-Based Approach (VBA), which can evaluate/assess in a systematic way the CCI spillover effects by considering their multiple contributions of economic, social and cultural added values. The approach combines qualitative and quantitative data collection methods. As opposed to traditional output evaluation methods, this method explicitly uses stakeholders’ perspectives on the quality changes.
We apply this (e)valuation method to the case of the Rotterdam Unlimited festival (RU), the Netherlands. RU is a 5-day city event (e.g. annual festival) performing a wide range of dance, music, film and poetry genres from acknowledged and upcoming artists to a local, national and international audience of all ethnicities, ages and social backgrounds. It represents the multicultural character of the city centre of Rotterdam and aims at exerting a social impact, thereby having a positive influence on the ‘sense of belonging’ and on the connection among different cultural Groups.

For more Information please visit: www.crearefoundation.nl


CONCORDIA Design Centre & Human Touch Group in Poznań (POLAND)

Influencing and interacting with the social environment, entrepreneurial and business climate, social and public education Services

Poznan, Poland

Researchers: Dr Marcin Poprawski (research project leader) and Altum Foundation, Poznan, Poland
Partners: Concordia Design Center, City of Poznan, Adam Mickiewicz University in Poznan – Faculty of Social Sciences, ROK AMU Culture Observatory

About: Concordia Design is the centre of creativity, design and business, operated by the private owners, located in the very centre of Poznań (Poland), in the renovated Old Printing House. The project was initiated in 2010 with a grant for renovation of 1890 origin building (co-funded from public grants). In nearly 6 years the place becomes a major design thinking creative approach lab in Poland, being a conceptual and consulting headquater for a whole new group of privately owned cross-sectoral initiatives called Human Touch Group, focusing on the role of humanistic oriented management (design thinking origin, aesthetics, multi-sensoric) methods in business and education. Concordia is now a creative engine and a spillover factor for new satelite organizations such as: School of Form – design and crafts highschool, Vox Industries – furniture factory, SWPS University – University of Social Psychology, Baltyk skyscraper, Collegium Da Vinci school, Da Vinci Elementary School, Vox Artis Contemporary Art Foundation, Talent Scholarship Fund, Concordia Restaurant. It offers also design and creativity festivals, platform for bloggers (BLOGTej) and a location for TEDex and other conferences. But what is even more important Concordia generated a windwirl of stakeholders: thousands of people inspired till now by their innovative, entrepreneurial and creative approach: consultancy clients, creative workshops participants, designers, architects, creative business entrepreneurs, but also city inhabitants, kids, women leaders, unemployed, artists, social and civic organizations from the neighbourhood districts, public officers, local and regional government bodies, schools, families, start-ups creators. Their essential work space is the whole cluster of offices „Incubator” / „Co-work” offered to creative industry, start-ups and related businesses. The new inventory of Concordia initiators is a new iconic office building skyscraper under construction done by MVRDV architects an unusualally designed tower. Concordia Design is a private case with a public money contribution for revitalisation proces and multiple partnerships in the city, region and internationally.

For more Information please visit: https://www.concordiadesign.pl/en and lhttp://baltykpoznan.pl/index_en.html


KUULTO and Tampere Together, Finland

Action research as a qualitative tool to identify and evaluate knowledge and network spillovers in art and culture projects


Researchers: Foundation for Cultural Policy Research (Cupore) - Sakarias Sokka/ Senior Researcher, Olli Jakonen/ Researcher, Sari Karttunen/ Senior Researcher.
Partners: University of Jyväskylä. Anita Kangas / Professor emerita at University of Jyväskylä.

About: Our framework for investigating cultural and creative spillovers draws upon action research. We aim to develop a qualitative approach and method for the evaluation of knowledge and network spillovers in particular. Our case study will utilise the data and outcomes of a large scale action research project KUULTO that was conducted in Finland during the years 2011–2015. KUULTO was targeted at increasing cultural participation in small, distant localities where the level of municipal cultural funding was low. It was carried out by the University of Jyväskylä and financed by the Finnish Ministry of Education and Culture. We will identify spillovers of an ERDF funded cultural development project that was carried out in the city of Tampere from 2008 to 2013: Culture for City Districts - Tampere Together. Through reflexive group work and mini-Delphi discussions we will analyse the Tampere Together project and selected cases from the KUULTO project to develop an evaluation model for knowledge and network spillovers of cultural projects. This means adding a new layer in the action research spiral focusing on long-lasting effects and spillovers. Our ultimate goal is to create, test and develop methodological innovations based on action research to analyse spillovers stemming from grassroots level cultural participation.

For more information please visit:http://www.tampere.fi/english/culturalaffairs/citydistricts/tamperetogether.html and https://www.jyu.fi/ytk/laitokset/yfi/oppiaineet/kup/tutkimus/tutkprojhank/kuulto
and Cupore/spillovers

Mini-Delphi discussions
Helsinki, 16/09/2016

Delfoi16.9.16_005.jpg Delfoi16.9.16_004.jpg
Cupore research team (from left to right): Olli Jakonen, Sari Karttunen, Anita Kangas, Sakarias Sokka

Program and themes of the Delphi-panel (in English):


Add Discussion