Quantitative and qualitative criteria for designing an effective policy framework for impact measurement

22-23 March 2018, Rome, Italy

Register Now


RomeTarget audience

  • Research councils and research foundations;
  • Managers of University research;
  • All professionals involved in stimulating societal impact of science

Background and Goals

Science funders and research programme designers are constantly challenged to maintain an effective and efficient science funding system, while justifying the investments in scientific research towards their stakeholders. As a result of the economic downturn and the increased understanding of the limitations of existing justification frameworks, the pressure increases on governmental and non-governmental science funding organisations to increase the extent to which they demonstrate the socio-economical and societal returns on their investments in science.

In all parts of the world, experts are working on improving the process of measuring and demonstrating the impact of science on society. In the past years, new methods have been developed to better justify and demonstrate the societal impact of scientific research by universities and research institutions. Increasingly, research councils do not just ask to promise impact of new research ideas, but also to plan activities to involve stakeholders and realise impact. Universities and universities of applied sciences develop impact strategies at regional and sectoral level.

The challenge is also for the science policymakers and the other stakeholders to address. Together they have to develop effective systems for the particular scientific climate in their country. A number of systems have been set up to address this challenge – often initiated or stimulated by the science funding organisations: The Research Excellence Framework (REF) in the UK, the National Science Foundation (NSF) in the US and the EU research programs such as Horizon2020.

During this interactive training course, experts from multiple countries, leading the innovation in research funding approaches, will discuss their experiences. They provide insights on how you can organise a research strategy in such a way that it strengthens societal impact.

The detailed programme of this course will follow shortly.

Paul Wouters - Course Director

Paul Wouters Paul Wouters is professor of scientometrics and director of the Centre for Science and Technology Studies at Leiden University. He has a Masters in biochemistry (Free University of Amsterdam, 1977) and a Ph.D. in science and technology studies (University of Amsterdam, 1999). In between these degrees he has worked as science journalist and as editor-in-chief of a daily newspaper ("De Waarheid"). He has published on the history of the Science Citation Index, on and in scientometrics, and on the way the criteria of scientific quality and relevance have been changed by the use of performance indicators. He has also studied the role of information and information technologies in the creation of new scientific and scholarly knowledge. In this area, he was appointed as leader of two research programs by the Royal Netherlands Academy of Arts and Sciences.

He was Principal Investigator of several European research consortia, among others ACUMEN on research careers and evaluation of individual researchers. Paul was coordinator of the Dutch STS Graduate School Science, Technology, and Modern Culture (WTMC) together with Annemiek Nelis (2001-2005). Currently he is chair of the WTMC board. In 1999, he helped create Onderzoek Nederland, a leading professional journal on Dutch science policy (part of Research Professional). He is a member of the editorial board of Social Studies of Science, Journal of the Association of Information Science and Technology, and Cybermetrics, was member of the Council of the Society for the Social Studies of Science from 2006 to 2008. Currently, he is involved in, among others, the PRINTEGER project on integrity in science, the Center for Research Quality and Policy Impact Studies at NIFU in Oslo.

David Phipps - Course Director

David Phipps Dr. Phipps received his Ph.D. in Immunology from Queen’s University (Kingston, Ontario) and undertook post-doctoral studies in HIV research at the University Health Network (Toronto). After leaving the lab he built a career managing academic research holding successively senior positions at the University of Toronto Innovations Foundation (Manager of Biotechnology and Life Sciences), Canadian Arthritis Network (Director of Business Development) and Canadian Institutes of Health Research (Director of Partnerships). In 2001 Dr. Phipps completed his MBA from the Rotman School of Management (University of Toronto). Dr. Phipps is the Executive Director of Research & Innovation Services at York University where he manages all research grants and contracts including knowledge and technology transfer.

In this capacity he leads York’s award winning Knowledge Mobilization Unit that provides services to researchers, community organizations and government agencies who wish to use maximize the economic, social and environmental impacts of university research. Dr. Phipps has been named the most influential knowledge mobilizer in Canada. In 2012 York’s Knowledge Mobilization Unit was awarded a best practice award from the European-based Knowledge Economy Network. In 2012 he was awarded a Queen Elizabeth II Diamond Jubilee Medal in recognition of his work in knowledge mobilization. In 2013 he was one of three national finalists for the Impact Award – Connections category from the Social Sciences and Humanities Research Council of Canada. He was also awarded the 2015 Research Management Excellence Award (Canadian Association of Research Administrators) and 2015 President’s Award for Innovation in Knowledge Mobilization (Institute for Knowledge Mobilization). In 2015 he was named the Gordon and Jean Southam Fellow from the Association of Commonwealth Universities. In 2017 Research Impact Canada received the Directors’ Award for Inter-Institutional Collaboration from the Canadian Association of Research Administrators.

He is the Knowledge Translation Lead for Kids Brain Health Network of Centres of Excellence and is the Network Director for Research Impact Canada, Canada’s knowledge mobilization network including 12 universities investing in strategies to maximize the impact of research.

Emanuela Reale - Moderator

Emanuela Reale Dr. Emanuela Reale social scientist is senior Researcher at IRCRES – CNR. She has been scientific responsible in many international projects on science and technology policy. From 2004 to 2009, she was Team Leader of CNR in Network of Excellence PRIME – VI EC Framework Programme, and Member of the Executive Committee of the Network. She was Principal investigator in research projects on higher education (Projects TRUE ESF-EUROCORE, PREST-ENCE ANR, France, POCARIM Project – Mapping population careers, mobilities and impacts of advanced research degree graduates in the social sciences and humanities -VII EUFP), research evaluation and indicators (Coordinator of JOREP Project on Joint transnational research, EC and of the PREF Project on R&D government funding, EC).

Presently she is involved in the RISIS-Research Infrastructures for the assessment of science technology and innovation policy Project (VII EUFP) and in the IMPACT-EV-Evaluating the impact and outcomes of EU SSH research Project (VII EUFP). From 1998 to 2009 she acted as expert of Research Evaluation for the National Committee for the Evaluation of Research (CIVR). She cooperated as an Expert with the ANVUR-Italian Agency for the evaluation of university and research. She was Vice President of the Italian Evaluation Association-AIV in 2009-2013; Vice President of the European Forum for Studies on Policies for Research and Innovation-EU-SPRI from 2009 to 2016, and Member of the executive board of the ENID European STI Indicators Conference Series until 2015. She is currently member of the CHER-Consortium of Higher Education Researchers Board.

22-23 March, 2018

Consiglio Nazionale delle Ricerche
Piazzale Aldo Moro, 7
Rome, Italy

You can register through the course website. After registration, you will receive a confirmation via email. You will receive further details about the conference in due time. We kindly request that you register before 19 March 2018.

Participation costs: € 995,-
Participation costs AESIS network members: € 895,-

The participation fee includes lunches, coffee/tea and course documentation.

Payment of the participation fee should happen before the start of the course. You will receive an invoice together with the confirmation. Payments have to be made in Euro and free of all bank and other charges. Personal or company cheques are not accepted. All amounts are excluding VAT, if applicable.

If you are unable to attend the conference it is permitted to allow someone else to participate in your stead, if the name of the replacement is communicated before the start of the conference to the organisers. Cancellation without cost is possible until January 25, 2018. If you cancel between 25 January and February 22 2018, we will invoice €95 for administration costs. After February 22 2018, you owe us the full amount.

Anika Duut van Goor - General Manager
Peter Jan van der Veek - Project Manager

AESIS Network
Mauritskade 5
2514 HC Den Haag
+31 (0)70 217 2018

Organised by:



National research Council of Italy

Quotes by participants of previous courses

"Three days of very balanced insights and a great network that will help me in the future. Looking forward to the next course!"

"A wide variety of different points of view and expertises of the trainers, and the diverse group of participants."

"The course offered a very inspiring approach on ways to deal with the topic of impact in research, providing at the source very concrete solutions on how to tackle it in your own institution.

"Impact makes the world go round!"

"Informative, friendly and useful. I would recommend the course to research managers everywhere to enhance their understanding, and engagement in the development and delivery of impact strategies"