Page - (000308) - in Evaluating Climate Change Action for Sustainable Development

pathways that cannot be exactly predicted at the outset of a project.18 One of the potentialapplicationsof theory-basedevaluation is to identifymeasures thatcanbe used formonitoring over time.19 But in complex systems relevant to CCA inter- ventions,“SMART”measuresmaynotbeable tobedeveloped inadvance,making pre-andpost-comparisons difficult. Whilst someversionsofprogramtheoryevaluation relyoncloseadherenceat a detailed level to the initial theory toguide theevaluation,wedonot take this strict definition. The complex character of CCA interventions far frommakes theory- based evaluation redundant. Rather, flexible application is needed, and a balance struckbetweenevaluationquestions thatarecloselyguidedbythe(initial) theoryof change,andanapproachthat isopentooutcomes,andthemeanstoachievingthem, emergingduring implementation itself.20 16.3.2 DevelopmentalEvaluation, or,Learning inComplex Systems ‘Developmental evaluation’was coined by Paton to describe the types of evalua- tions applicable in complex situationswhere outcomes are emergent,where activ- ities are not set in stone, and where it is not exactly known how, why or where activitieswill lead.21Developmentalevaluationaims to“support real-timelearning incomplexandemergentsituations”wherethefocus ison“adaptive learningrather than accountability.”22 Developmentpractitioners and researchershavewidely recognised that forpro- jects incomplexenvironments tobe successful, self-evaluationandongoing learn- ing is key. Developmental evaluation can be understood by considering what its purpose isnot– it isnot summative, in that itdoesn’t aimtoevaluateat theendofa programandmakea judgementaboutwhetherandhowtheprogramwill continue; 18Rogers, Patricia J. 2011. “Implications of Complicated and Complex Characteristics for Key TasksinEvaluation.” inEvaluatingtheComplex:Attribution,Contribution,andBeyond,editedby K.Forss,M.Marra andR.Schwartz.NewBrunswick,NewJersey:Transaction. 19Funnell, SC and PJ Rogers. 2011. Purposeful Program Theory: Effective Use of Theories of ChangeandLogicModels. SanFrancisco: JohnWiley andSons. 20Rogers,P.J.2008.“UsingProgrammeTheorytoEvaluateComplicatedandComplexAspectsof Interventions.”Evaluation14(1):29–48. doi: 10.1177/1356389007084674 21Gamble, JamieA.A. 2008.ADevelopmental Evaluation Primer: The J.W.McConnell Family Foundation. 22Dozois, Elizabeth,MarcLanglois andBlacnhet-Cohen. 2010.APractitioner’sGuide toDevel- opmentalEvaluation: The J.W.McConnell FamliyFoundation and the International Institute for ChildRights andDevelopment. 296 J.Chonget al.