RESUMEN
Performance-based funding and calls for public-funded science to demonstrate societal impact are encouraging public research organisations to evaluate impact, the so-called impact agenda. This paper explores evaluation methods of four fully or partially public-funded agricultural research organisations and how they are building evaluative capacity to respond to the impact agenda. Drawing on cross-organisational comparison of the readiness of each organisation to implement evaluation, the implications for improving evaluative capacity building (ECB) are discussed. This study extends the current literature on ECB, as very little has focussed on research organisations in general, and particularly agricultural research. Driven by the impact agenda, the organisations are beginning to emphasise summative evaluation. Organisational leaders valuing the demonstration of impact and commitment to building evaluation capacity are important precursors to other aspects of organisational readiness to implement evaluation. However, organisational emphasis remains on using evaluation for accountability and to improve efficiency and allocation of funding. The organisations have yet to systematically embed evaluation processes and capabilities for learning at programme and organisation-levels. There is, therefore, an opportunity to develop organisation and programme-level evaluation processes that inform each other and the pathways to impact from science. To realise this opportunity, organisations could strengthen internal and external networks of evaluation practitioners and academics to bridge the gap between the theory and practice of monitoring and evaluation for learning (MEL) and to begin to reshape organisational culture by using evaluation methods that are grounded in co-production and integrated scientific and societal values.
Asunto(s)
Creación de Capacidad , Humanos , Irlanda , Nueva Zelanda , Evaluación de Programas y Proyectos de Salud , España , UruguayRESUMEN
Due to the climate change and increased attention toward environmental management issues, the agri-food sector has been extensively relying on research, development, and innovation (RDi) to transform conventional agricultural production into a sustainable and eco-friendly industry. While the academic contribution of research has been relatively easily identified in the literature, the assessment of its societal impact remains underdeveloped. Accordingly, this study employs mixed-method evaluation approaches, mainly ASIRPA framework and Impact Oriented Monitoring (IOM) model to better understand and measure the multi-dimensional impacts of RDi in the agri-food sector in Spain. The objective of this analysis is to identify the impact of research on the society and the ecosystem. An in-depth case study analysis is conducted to examine the "best practices" program to promote sustainable techniques in the rice cultivation. Empirical findings suggest a standardized index to measure the economic, socio-territorial, health, political, capacity building, and environmental impacts, involving the stakeholder-network evaluation. The study highlights important implications for firm management decisions monitoring research uptake and policy design in the agri-food sector.