TY - JOUR
T1 - Building sport for development practitioners' capacity for undertaking monitoring and evaluation - reflections on a training programme building capacity in realist evaluation
AU - Harris, Kevin
PY - 2018/4/4
Y1 - 2018/4/4
N2 - At present, the quality and practice of Monitoring and Evaluation (ME) in Sport for Development (SfD) projects is under close scrutiny, mainly concerning the capacity that sport has to create social change. Critics have argued that a deeper understanding of 'what works for whom and why' is required when evaluating SfD projects. This article explores practitioner involvement in ME, drawing upon a 'realist participatory ME training framework' developed to train student sport development practitioners to make sense of how and why their SfD projects worked. The training framework was evaluated utilising a realist approach to understand what approaches to evaluation worked for those involved in the training framework. Specifically, 15 practitioners participated in the training framework encompassing 5 community focused SfD innovation projects delivered within the Coaching Innovation Programme at a south coast university in the United Kingdom. The realist evaluation incorporated Q-method factor analysis with realist interviews and reflective blogs. Findings on the value of realist evaluation for practitioners emerged. Practical and transformational evaluation characteristics unfolded and four groups of practitioners emerged, depicting how the training framework worked. These groups were 'new and emerging evaluators', 'polished problem solvers', 'passive passengers', and 'proficient yet sceptical practitioners'. These were underpinned by holistic narratives in line with Q-method demonstrating shared viewpoints about the training framework. In conclusion, participatory approaches of ME can work with practitioners and should be embedded to enable application of realist evaluation.
AB - At present, the quality and practice of Monitoring and Evaluation (ME) in Sport for Development (SfD) projects is under close scrutiny, mainly concerning the capacity that sport has to create social change. Critics have argued that a deeper understanding of 'what works for whom and why' is required when evaluating SfD projects. This article explores practitioner involvement in ME, drawing upon a 'realist participatory ME training framework' developed to train student sport development practitioners to make sense of how and why their SfD projects worked. The training framework was evaluated utilising a realist approach to understand what approaches to evaluation worked for those involved in the training framework. Specifically, 15 practitioners participated in the training framework encompassing 5 community focused SfD innovation projects delivered within the Coaching Innovation Programme at a south coast university in the United Kingdom. The realist evaluation incorporated Q-method factor analysis with realist interviews and reflective blogs. Findings on the value of realist evaluation for practitioners emerged. Practical and transformational evaluation characteristics unfolded and four groups of practitioners emerged, depicting how the training framework worked. These groups were 'new and emerging evaluators', 'polished problem solvers', 'passive passengers', and 'proficient yet sceptical practitioners'. These were underpinned by holistic narratives in line with Q-method demonstrating shared viewpoints about the training framework. In conclusion, participatory approaches of ME can work with practitioners and should be embedded to enable application of realist evaluation.
U2 - 10.1080/19406940.2018.1442870
DO - 10.1080/19406940.2018.1442870
M3 - Article
SN - 1940-6940
VL - 10
SP - 795
EP - 814
JO - International Journal of Sport Policy
JF - International Journal of Sport Policy
IS - 4
ER -