Quantitative and qualitative criteria for designing an effective policy framework for impact measurement

22-23 March 2018, Rome, Italy

This course has already taken place. We would like to thank all the attendees for an insightful week.

RomeTarget audience

  • Research councils and research foundations;
  • Managers of University research;
  • All professionals involved in stimulating societal impact of science

Background and Goals

Science funders and research programme designers are constantly challenged to maintain an effective and efficient science funding system, while justifying the investments in scientific research towards their stakeholders. As a result of the economic downturn and the increased understanding of the limitations of existing justification frameworks, the pressure increases on governmental and non-governmental science funding organisations to increase the extent to which they demonstrate the socio-economical and societal returns on their investments in science.

In all parts of the world, experts are working on improving the process of measuring and demonstrating the impact of science on society. In the past years, new methods have been developed to better justify and demonstrate the societal impact of scientific research by universities and research institutions. Increasingly, research councils do not just ask to promise impact of new research ideas, but also to plan activities to involve stakeholders and realise impact. Universities and universities of applied sciences develop impact strategies at regional and sectoral level.

The challenge is also for the science policymakers and the other stakeholders to address. Together they have to develop effective systems for the particular scientific climate in their country. A number of systems have been set up to address this challenge – often initiated or stimulated by the science funding organisations: The Research Excellence Framework (REF) in the UK, the National Science Foundation (NSF) in the US and the EU research programs such as Horizon2020.

During this interactive training course, experts from multiple countries, leading the innovation in research funding approaches, will discuss their experiences. They provide insights on how you can organise a research strategy in such a way that it strengthens societal impact.

Thank you to all the attendees of the Wintercourse 2017 for participating. The pictures of the course can be found using this link!


Programme Training Course Rome

>Programme Spring Course 2018

Paul Wouters - Course Director

Paul Wouters Paul Wouters is professor of scientometrics and director of the Centre for Science and Technology Studies at Leiden University. He has a Masters in biochemistry (Free University of Amsterdam, 1977) and a PhD in science and technology studies (University of Amsterdam, 1999).

He has published on the history of the Science Citation Index, on and in scientometrics, and on the way the criteria of scientific quality and relevance have been changed by the use of performance indicators. He has also studied the role of information and information technologies in the creation of new scientific and scholarly knowledge. In this area, he was appointed as leader of two research programs by the Royal Netherlands Academy of Arts and Sciences: Networked Research and Digital Information (Nerdi) (2000 - 2005) and The Virtual Knowledge Studio for the Humanities and Social Sciences (VKS) (2005 - 2010) (Virtual Knowledge. Experimenting in the Humanities and Social Sciences). He was Principal Investigator of several European research consortia, among others ACUMEN on research careers and evaluation of individual researchers. Paul was coordinator of the Dutch STS Graduate School Science, Technology, and Modern Culture (WTMC) (with Annemiek Nelis; 2001-2005). Currently he is chair of the WTMC board.

In 1999, he helped create Onderzoek Nederland, a leading professional journal on Dutch science policy (part of Research Professional) and has since published in the journal. He is a member of the editorial board of Social Studies of Science, Journal of the Association of Information Science and Technology, and Cybermetrics, was member of the Council of the Society for the Social Studies of Science from 2006 to 2008, and sits on various advisory boards of international programs and projects. Currently, he is involved in, among others, the PRINTEGER project on integrity in science, the Center for Research Quality and Policy Impact Studies at NIFU in Oslo, and he is member of the program board of the ZonMW program to promote responsible research behaviour.

David Phipps - Course Director

David Phipps Dr. Phipps received his Ph.D. in Immunology from Queen’s University (Kingston, Ontario) and undertook post-doctoral studies in HIV research at the University Health Network (Toronto). After leaving the lab he built a career managing academic research holding successively senior positions at the University of Toronto Innovations Foundation (Manager of Biotechnology and Life Sciences), Canadian Arthritis Network (Director of Business Development) and Canadian Institutes of Health Research (Director of Partnerships). In 2001 Dr. Phipps completed his MBA from the Rotman School of Management (University of Toronto). Dr. Phipps is the Executive Director of Research & Innovation Services at York University where he manages all research grants and contracts including knowledge and technology transfer.

In this capacity he leads York’s award winning Knowledge Mobilization Unit that provides services to researchers, community organizations and government agencies who wish to use maximize the economic, social and environmental impacts of university research. Dr. Phipps has been named the most influential knowledge mobilizer in Canada. In 2012 York’s Knowledge Mobilization Unit was awarded a best practice award from the European-based Knowledge Economy Network. In 2012 he was awarded a Queen Elizabeth II Diamond Jubilee Medal in recognition of his work in knowledge mobilization. In 2013 he was one of three national finalists for the Impact Award – Connections category from the Social Sciences and Humanities Research Council of Canada. He was also awarded the 2015 Research Management Excellence Award (Canadian Association of Research Administrators) and 2015 President’s Award for Innovation in Knowledge Mobilization (Institute for Knowledge Mobilization). In 2015 he was named the Gordon and Jean Southam Fellow from the Association of Commonwealth Universities. In 2017 Research Impact Canada received the Directors’ Award for Inter-Institutional Collaboration from the Canadian Association of Research Administrators.

He is the Knowledge Translation Lead for Kids Brain Health Network of Centres of Excellence and is the Network Director for Research Impact Canada, Canada’s knowledge mobilization network including 12 universities investing in strategies to maximize the impact of research.

David Sweeney - Course Director

DavidSweeney David Sweeney is Executive Chair Designate of Research England, the Council which will be responsible for university research and knowledge exchange within the forthcoming body UK Research & Innovation.
He is currently also Director (Research and Knowledge Exchange) for the Higher Education Funding Council for England (HEFCE), where he is responsible for research policy and funding, knowledge exchange and university-business relations.

After gaining First Class Honours in Statistics at the University of Aberdeen, David worked at two Biotechnology and Biological Sciences Research Council (BBSRC) research institutes, as a consultant statistician then developing mathematical models of plant growth. His work on the computational aspects of this led into broader applications of IT in education and research, and he was Director of Information Services at Royal Holloway, University of London, before moving into university leadership as Vice-Principal (Communications, Enterprise and Research) in 2004. In this role he was responsible for research strategy and for developing Royal Holloway’s research-led commercial and consultancy activities. He joined HEFCE in 2008 as Director (Research, Innovation and Skills) and led the development and implementation of the first Research Excellence Framework including the new impact agenda element.

David has been invited to visit many countries to advise on research assessment and funding, particularly with respect to research impact. He was awarded an honorary doctorate from the University of Aberdeen in 2012, was Vice-Chancellor’s Fellow at the University of Newcastle, NSW in 2015 and is a Fellow of the Royal Statistical Society.

Emanuela Reale - Moderator

Emanuela Reale Dr. Emanuela Reale social scientist is senior Researcher at IRCRES – CNR. She has been scientific responsible in many international projects on science and technology policy. From 2004 to 2009, she was Team Leader of CNR in Network of Excellence PRIME – VI EC Framework Programme, and Member of the Executive Committee of the Network. She was Principal investigator in research projects on higher education (Projects TRUE ESF-EUROCORE, PREST-ENCE ANR, France, POCARIM Project – Mapping population careers, mobilities and impacts of advanced research degree graduates in the social sciences and humanities -VII EUFP), research evaluation and indicators (Coordinator of JOREP Project on Joint transnational research, EC and of the PREF Project on R&D government funding, EC).

Presently she is involved in the RISIS-Research Infrastructures for the assessment of science technology and innovation policy Project (VII EUFP) and in the IMPACT-EV-Evaluating the impact and outcomes of EU SSH research Project (VII EUFP). From 1998 to 2009 she acted as expert of Research Evaluation for the National Committee for the Evaluation of Research (CIVR). She cooperated as an Expert with the ANVUR-Italian Agency for the evaluation of university and research. She was Vice President of the Italian Evaluation Association-AIV in 2009-2013; Vice President of the European Forum for Studies on Policies for Research and Innovation-EU-SPRI from 2009 to 2016, and Member of the executive board of the ENID European STI Indicators Conference Series until 2015. She is currently member of the CHER-Consortium of Higher Education Researchers Board.

Leanne Harvey - Speaker

Leanne Harvey photo As Executive General Manager at the Australian Research Council (ARC) Ms Leanne Harvey is responsible for the Research Excellence, Corporate Services and Programs branches.
In her career at the ARC Leanne has played a pivotal leadership role in developing and delivering Excellence in Research for Australia (ERA). Demonstrating the quality of ERA in 2010, the Organisation for Economic Co-Operation and Development (OECD) recognised the exercise as ‘state-of-the-art’. Each ERA cycle continues to build on the utility and evidence base for research policy both for Australia and internationally.

Leanne is also leading the Engagement and Impact Assessment of Australian university research. The Engagement and Impact pilot phase was completed in 2017. The first full assessment is underway this year and will be run as a companion to ERA 2018.

Claudio Colaiacomo - Speaker

Claudio Colaiacomo holds a position as VP of Academic relations at Elsevier. In his role he is responsible for building and entertaining networks, spark synergy, partnerships and inspiration with research policy makers and university executives around Southern Europe. He has followed closely the development of research assessment excercises including the collaboration of Elsevier with ANVUR as well as nationwide initiatives for accessing scholarly publishing in Spain, France and Italy. He holds an executive MBA a Bachelor and a Masters in Solid State Physics. He’s also published author and passionate about bringing science closer to the public opinion as well as the impact of science on society.

Stefan Hornbostel - Speaker

Prof. Dr. Stefan Hornbostel studied Social Sciences at the University of Göttingen. In 1995, he received his PhD from Freie Universität Berlin. He worked at the Universities of Kassel, Cologne, Jena and Dortmund, as well as at the Center of Higher Education Development (CHE – Centrum für Hochschulentwicklung). Stefan Hornbostel served as Director of the Institute for Research Information and Quality Assurance (IFQ) from 2005 to 2015. He was appointed Professor at Humboldt-Universität zu Berlin, Department of Social Sciences (Science Studies) in 2005. Since 2016, he is head of the research area “Research System and Science Dynamics” at the German Centre for Higher Education Research and Science Studies (DZHW). He is a member of the advisory board of the Saxon State and University Library Dresden (SLUB), and member of the advisory board for the Centre for Research Quality and Policy Impact Studies (R-Quest), Oslo. His research interests lie in in the field of science studies, bibliometrics, and elite sociology.

Brigida Blasi - Speaker

Brigida Blasi is the responsible for the Unit on Third Mission Evaluation at the Italian Agency for University and Research Evaluation (ANVUR). Her research interests span various aspects of higher education and scientific systems, especially research policy, management and evaluation, research group dynamics, teaching quality assessment and impact evaluation methods. After receiving her PhD in Research in Applied Social Sciences from the University of Rome Sapienza in 2009, she has been fellow at Roma Tor Vergata University and at Center for Innovation, Technology and Policy Research (IN+) in Portugal.

Consiglio Nazionale delle Ricerche (CNR)
National Research Council Italy
Piazzale Aldo Moro, 7
00185 Rome, Italy
Thursday 22nd of March
Efeso il barrocciaio
Via dei Salentini, 12
00185 Rome, Italy
Thursday 22nd of March
Efeso il barrocciaio
Via dei Salentini, 12
00185 Rome, Italy
From the airport

From Fiumicino Airport you can take the Leonardo Express train to Rome Termini (Central Station). this is a direct train to the Rome Termini station which departs every 15 minutes with a journey time of approximately 32 minutes. A one way train ticket is €14,00 and you can purchase tickets beforehand. From Roma Termini station it is a 15 minute walk to the course location.

By taxi
At Fiumicino Airport there are taxi services at Terminal 1 and Terminal 3. A ride from the airport to the city centre of Rome is approximately €48,00.

Other ways of transportation to and from the airport can be found on the Fiumicino Airport website.


Ateneo Garden Palace ****
Via dei Salentini 3
000185 Roma, Italy

This hotel is located just a 5 minute walk from the course location. You are able to book a room for €125/night (single room) including breakfast and Wi-Fi, excluding city tax (6%). Rooms are available for booking until the 28th of February via this website, after this date rooms can only be reserved based on availability.

For any logistical questions, please do not hesitate to contact Eline Kemperman, conference manager at the AESIS Network, via e.kemperman@aesisnet.com or via +31 (0)70 217 20 18.

22-23 March, 2018

Consiglio Nazionale delle Ricerche
Piazzale Aldo Moro, 7
Rome, Italy

You can register through the course website. After registration, you will receive a confirmation via email. You will receive further details about the conference in due time. We kindly request that you register before 19 March 2018.

Participation costs: € 995,-
Participation costs AESIS network members: € 895,-

The participation fee includes lunches, coffee/tea and course documentation.

Payment of the participation fee should happen before the start of the course. You will receive an invoice together with the confirmation. Payments have to be made in Euro and free of all bank and other charges. Personal or company cheques are not accepted. All amounts are excluding VAT, if applicable.

If you are unable to attend the conference it is permitted to allow someone else to participate in your stead, if the name of the replacement is communicated before the start of the conference to the organisers. Cancellation without cost is possible until January 25, 2018. If you cancel between January 25 and February 22 2018, we will invoice €95 for administration costs. After February 22 2018, you owe us the full amount.

Anika Duut van Goor - General Manager
Peter Jan van der Veek - Project Manager

AESIS Network
Mauritskade 5
2514 HC Den Haag
+31 (0)70 217 2018

Organised by:



National research Council of Italy

With Participation of:


Friend of AESIS:


Quotes by participants of previous courses

"Three days of very balanced insights and a great network that will help me in the future. Looking forward to the next course!"

"A wide variety of different points of view and expertises of the trainers, and the diverse group of participants."

"The course offered a very inspiring approach on ways to deal with the topic of impact in research, providing at the source very concrete solutions on how to tackle it in your own institution.

"Impact makes the world go round!"

"Informative, friendly and useful. I would recommend the course to research managers everywhere to enhance their understanding, and engagement in the development and delivery of impact strategies"