ANZEA Conference 2015
The UN designated 2015 as the International Year of Evaluation to advocate and promote evaluation and its use. The theme of the International Year of Evaluation is Evidence for the world we want — using evaluation to improve people’s lives through better policy making.
2015 Keynote Speakers
Opening Words Via Video Uplink
Administrator of the United Nations Development Programme and Chair of the United Nations Development Group. Helen Clark will open the ANZEA 2015 conference with a video address.
Helen Clark became the Administrator of the United Nations Development Programme on 17 April 2009, and is the first woman to lead the organisation. She is also the Chair of the United Nations Development Group, a committee consisting of the heads of all UN funds, programmes and departments working on development issues.
Prior to her appointment with UNDP, Helen Clark served for nine years as Prime Minister of New Zealand, serving three successive terms from 1999 – 2008. Throughout her tenure as Prime Minister, Helen Clark engaged widely in policy development and advocacy across the international, economic, social and cultural spheres. Under her leadership, New Zealand achieved significant economic growth, low levels of unemployment, and high levels of investment in education and health, and in the well-being of families and older citizens. She and her government prioritised reconciliation and the settlement of historical grievances with New Zealand’s indigenous people and the development of an inclusive multicultural and multi-faith society.
Helen Clark advocated strongly for New Zealand’s comprehensive programme on sustainability and for tackling the problems of climate change. Her objectives have been to establish New Zealand as being among the world’s leading nations in dealing with these challenges. Helen Clark was also an active leader of her country’s foreign relations and policies, engaging in a wide range of international issues. As Prime Minister, Helen Clark was a member of the Council of Women World Leaders, an international network of current and former women presidents and prime ministers whose mission is to mobilize the highest-level women leaders globally for collective action on issues of critical importance to women and equitable development.
Helen Clark held ministerial responsibility during her nine years as Prime Minister for New Zealand’s intelligence agencies and for the portfolio of arts, culture and heritage. She has seen the promotion of this latter portfolio as important in expressing the unique identity of her nation in a positive way.
Helen Clark came to the role of Prime Minister after an extensive parliamentary and ministerial career. First elected to Parliament in 1981, Helen Clark was re-elected to her multicultural Auckland constituency for the tenth time in November 2008. Earlier in her career, she chaired Parliament’s Foreign Affairs Committee.
Between 1987 and 1990, she was a Minister responsible for first, the portfolios of Conservation and Housing, and then Health and Labour. She was Deputy Prime Minister between August 1989 and November 1990. From that date until December 1993 she served as Deputy Leader of the Opposition, and then as Leader of the Opposition until winning the election in November 1999.
Prior to entering the New Zealand Parliament, Helen Clark taught in the Political Studies Department of the University of Auckland. She graduated with a BA in 1971 and an MA with First Class Honours in 1974. She is married to Peter Davis, a Professor at Auckland University.
Helen Clark: Opening Video Address
Professor Konai Helu Thaman
Towards an Ethical and Inclusive Pedagogy for Pacific Learners in Higher Education: Further Observations
Professor of Education at University of the South Pacific, and scholar on teacher education, curriculum development, and culture and education.
Dr Konai Helu Thaman is a Tongan native Scholar and Professor at the University of South Pacific (USP) in Fiji. She holds a BA in Geography from the University of Auckland, an MA in International Education from the University of California at Santa Barbara, and PhD in Education from the USP. Dr Thaman’s PhD Dissertation entitled ‘Ako and Faiako: Cultural Values, Educational Ideas and Teachers’ Role Perceptions in Tonga was based on studies of the relationships between cultural values and educational ideas and how these were reflected in teachers’ perceptions of their professional role.
She has conducted research, consultancies and published widely in the areas of teacher education, curriculum development and culture and education and has held senior administrative positions in the USP including Director of the Institute of Education and Pro Vice Chancellor and Acting Deputy Vice Chancellor. Konai is a Fellow of APEID (Asia-Pacific Programme of Educational Innovation for Development) and has served as the UNESCO Chairperson in Teacher Education and Culture. Konai is also a widely published poet.
In an earlier paper, I had argued that the learning environments of formal educational institutions are often culturally undemocratic for the majority of Pacific Island students (Thaman, 2006). Korman (1974:105) had earlier suggested that the professional education of persons of culturally diverse backgrounds by those not competent in understanding of and providing services to such groups, is said to be unethical. In the context of higher education in the Pacific region, this is exactly what has occurred, and in many places, continue to occur. In this presentation, I explore the need for a rationale for a cultural perspective of teaching and learning in higher education and argue that higher education teaching personnel would need to not only be proficient in their respective disciplines but also have adequate understanding of the cultural backgrounds of their students in order to more effectively create ethical and culturally inclusive learning and research environments for students, both in terms of their relationship with them as well as in their evaluation of students’ work.
Thank you to Professor Konai Helu Thaman’s keynote sponsor – Pasifika Futures
Dr. John Gargani
The Emergence of Evaluation as a Global Enterprise
President elect (2016) of the American Evaluation Association (AEA) and founder of US-based Gargani + Company, Inc., a program design and evaluation firm.
John Gargani was recently elected the 2016 President of the American Evaluation Association.
He is President and Founder of Gargani + Company, Inc., a program design and evaluation firm located in Berkeley, California. Alongside supporting non-profit organizations, foundations, corporations, and government agencies achieve their social missions, John regularly writes about evaluation, shares his thoughts on at EvalBlog.com, teaches graduate classes on social entrepreneurship and program design, speaks at conferences around the world, and conducts workshops to train the next generation of evaluators.
Over the past 20 years, his work has taken him to diverse settings, including public housing projects, museums, countries adopting free market economies, and 19th century sailing ships. He has designed innovative social enterprises; directed large-scale randomized trials; and created novel technologies that measure how people think.
John holds three graduate degrees—a Ph.D. in Education from the University of California at Berkeley, where he studied measurement and evaluation; an M.S. in Statistics from New York University’s Stern School of Business; and an M.B.A. from the University of Pennsylvania’s Wharton School of Business.
In the world of evaluation, context is king. Local values, stakeholder perspectives, and the surrounding physical environment are the most important factors that shape our practice. At the same time, the profession has grown into a truly global enterprise. In our interconnected world, professional training, organisational membership, and communities of practice are no longer constrained by geography.
How do we serve local communities as part of a global professional community? Should our global community be planned and deliberate, or should it grow without direction? How can we ensure the participation of all, increase the quality of our work, and maximise the good evaluation can do? In this keynote, I suggest some answers to these questions as a starting point for a conversation. Together, let’s discuss what evaluation should be and how we can make it so.
Thank you to Dr John Gargani’s keynote sponsor – Ministry of Social Development
Sailing Into the Winds of Change to New Evaluation Zones
Head of Evaluation at the UK Department of International Development, and Chair of the OECD-DAC Network on Development Evaluation.
Penny Hawkins is an evaluation specialist with extensive experience in public sector evaluation in Aotearoa/New Zealand and the United Kingdom. She is the Head of Evaluation at the UK Department of International Development (DFID) and before taking up this role in 2013, worked with the Rockefeller Foundation in New York for several years. Before heading overseas, Penny held a number of evaluation management roles in New Zealand government departments including as Head of Evaluation for the New Zealand Aid Programme at the Ministry of Foreign Affairs and Trade.
Penny currently serves as the Chair of the OECD-DAC Network on Development Evaluation, is a former President of the Australasian Evaluation Society and from 2003-13 was a faculty member for the International Program for Development Evaluation Training (IPDET) at Carleton University in Canada. Penny has contributed to several evaluation publications including co-editing a book published in 2012, Evaluation Cultures – Sense Making in Complex Times. In 2007, she received the Australasian Evaluation Society Award for Outstanding Contribution to Evaluation. Penny’s longstanding commitment to the evaluation profession stems from her belief that evaluation can make a positive contribution to world development.
The world is changing fast and the winds of change are creating ripples of uncertainty across many areas. The field of evaluation has a history of adapting and evolving over time with new evaluation practices continuing to emerge.
Can the evaluation field adapt quickly enough as the pace of change accelerates in this century, or is it in danger of being grounded or caught in the doldrums as the tidal flows change? Let’s reflect for a moment on where we have come from, where we are now and where we are going, to get a clearer view of the horizon and the direction of travel, even if we don’t yet know the destination. Is the evaluation profession ready to surge forward to explore new territories and develop new approaches fit for the future?
Thank you to Penny Hawkins’ keynote sponsor – Accident Compensation Corporation (ACC)
Dr. Tamasailau Suaalii-Sauni
Englishing Pasifika/Pacific-ness in Programme Evaluation
Programme Director, Samoan Studies, and Senior Lecturer in Pacific Studies at Victoria University of Wellington.
Dr. Tamasailau Suaalii-Sauni is of Samoan descent, born in Saoluafata, Upolu, Samoa. She migrated to New Zealand at the age of 3 years and has lived in Auckland for over 30 years. Sailau is a Samoan graduate of The University of Auckland. She has a Law Degree and a BA, MA and PhD in Sociology. She began her academic career with The University of Auckland’s Department of Sociology in 1994. Since then, Sailau’s career has included working with the Clinical Research and Resource Centre in the Waitematā District Health Board, the Pacific Health Research Centre and Centre for Pacific Studies at the University of Auckland, the Centre for International Health, University of Otago, in partnership with the National University of Samoa.
Sailau is currently a Senior Lecturer in the Pacific Studies and Samoan Studies Programmes at Victoria University of Wellington. She is a current member of the Human Ethics Committees for the New Zealand Families Commission and the Victoria University of Wellington. She is an active Board member of Samoa’s only community-based mental health service, Goshen Mental Health Service Trust, Samoa. Her research and teaching interests are Pacific indigenous epistemologies, Pacific social research and evaluation methodologies, and Pacific jurisprudence.
A key challenge for Pasifika/Pacific peoples in Aotearoa New Zealand and the Pacific Islands is how best to ‘represent’ themselves and their values in programme evaluation. Ideas of ‘Pasifika-ness’ or ‘Pacific-ness’ speak to an identity that is geographically spread, socio-politically constructed, contemporary and deliberately pan-ethnic. When conducting formal programme evaluations of Pasifika/Pacific programmes, especially those that claim a distinctive Pasifika/Pacific-ness, programme evaluators are asked to find ways to ‘English’ this appropriately. This address explores different methodological approaches for enabling this and argues for why such an ‘Englishing’ exercise must happen and on what grounds. In doing so the address seeks to disrupt colonial framings by making visible possibilities for a ‘Pacific/Pasifika English’ in evaluation.
Prosaic or Profound? The Application of Systems Ideas to Evaluation
An international leader in systems thinking and evaluation, and winner of the 2014 AEA Lazarsfeld Award for evaluation theory.
Bob Williams has been at the forefront of promoting systems based approaches in evaluation. He has conducted workshops for evaluators on this topic in New Zealand, Europe, North America, Asia and Australia. He has considerable experience in writing and talking on systems, action research and evaluation topics in journals, books Internet discussion groups and conferences.
In 2014, Bob was awarded the AEA Lazarsfeld Award for evaluation theory, one of the highest accolades in the evaluation profession. Bob has published critical works in systems thinking and evaluation, including Systems Concepts in Action : A practitioner’s toolkit, written with book with Richard Hummelbrunner, and Wicked Solutions: A Systems Approach to Complex Problems, written with Sjon van t’ Hof. These build on a wealth of publishing and teaching in such areas as fundamentals of systems thinking, systems concepts in evaluation, soft systems methodology and complex adaptive systems.
All evaluation approaches have to address questions about their legitimacy, validity, relevance and usefulness. As the complexity of interventions is more widely acknowledged, evaluation appears to be especially vulnerable to these challenges. In more recent times, the question of how evaluations address the question of ethics has been placed on the table. It was the theme of last year’s European Evaluation Society conference focused on our role in creating equitable societies. Equity was also the subject of several papers at last year’s American Evaluation Association Conference. Do our usual approaches to evaluation stand up to these demands? How vulnerable are they? What does this mean for the criteria we use to judge merit, value and worth? Is our craft falling behind more recent demands of those who commission or use our evaluations?
A lot of hope is placed on the systems and complexity field to address these vulnerabilities. It has, to say the least, become fashionable. Is that hope justified? Can it deliver? And if so at what cost to our traditional evaluation methods and relationships?
In this keynote I’ll describe the systems field in terms of understanding interrelationships, engaging with multiple perspectives and reflecting on where boundaries are drawn in terms of those interrelationships and perspectives. I’ll argue that achieving a balance between these three elements is critical. An overemphasis on interrelationships is likely to bring only limited (prosaic) benefits to evaluation as a whole. On the other hand, a stronger emphasis on perspectives and boundaries could result in profound changes to the way in which evaluation is conceived and delivered – and reflect these new demands. However, it could change the nature of the relationship between the evaluator and key stakeholders, especially funders and managers of interventions. Is evaluation, as is currently conceived and practiced, able to cope with this emerging reality?
Whakawatea Te Haa – Evaluative Learning’s from an innovative marae-based approach to smoking cessation Te Pora Thompson-Evans and Louise Were
A critical analysis of the place of culture in evaluation Bridgette Masters-Awatere — Download presentation (PDF 346KB)
Exploring the depths of cultural fit and its challenge for evaluation in Aotearoa Debbie Goodwin, Pale Sauni and Louise Were
Wairua as a Compass for navigating evaluation waters – Part 1 Vivienne Kennedy, F. Cram, K. Paipa, K. Pipi, M. Baker and L. Porima
Wairua as a Compass for navigating evaluation waters – Part 2 Vivienne Kennedy et al
Reflecting Maaori Evaluation Practice: A panel share their whakaaro
Turning the tides: Otahuhu College Health Science Academy Melitta Rigamoto
Tapuaki Pacific Pregnancy: Taha Well Pacific Mothers Jacinta Fa’alili-Fidow, Mary Roberts and Amio Ikihele
Navigating uncharted waters: Rise Up Trust Cecily Taufelila and Rachael Trotman
Making Waves in Pacific Evaluation Gavin Faeamani, Seini Jensen and Melitta Rigamoto
Effectively Navigating for Pacific Success the impact of Va relationships on evaluation practice Dorothy Fotuali’I McGeady
The role and importance of Pacific evaluation Pacific Leaders and Evaluators Panel
Developing Evaluation Frameworks to support success Patricia Vermillion Peirce, Anna Scanlen, Ned Hardie-Boys and Christine Stewart
Mixed methods and the credibility of evidence in evaluation: Learnings from Physician Assistant demonstrations Sarah Appleton-Dyer and Adrian Field — Download presentation (PPTX 1.7MB)
Navigating our way through the changing conversation about causality Lisa Dyson
It’s time to ditch the 100 pager: Data viz infused evaluation reporting Andre van der Walt
Navigating inter-rater reliability: Ensuring consistency when using rubrics to measure youth health and wellbeing Rae Torrie and Robyn Bailey
All at Sea: the struggle of the case study worker Saville Kushner — Download presentation (PDF 4MB)
Challenges of the Gold Standard in practice: Using quasi-experimental studies for social research Lara Rapson — Download presentation (PPT 8MB)
Bradford Hill Criteria – a checklist to improve causal inference in evaluation? Julian King
Everything you wanted to know about using E-surveys in evaluation Part 1 Maggie Jakob-Hoff
Everything you wanted to know about using E-surveys in evaluation Part 2 Maggie Jakob-Hoff
A new compass for dealing with complexity when we are all at sea Judy Oakden — Download presentation (PDF 3MB)
Adapting the success case method for evaluation: illuminating successful practice in schools for learners at risk of underachievement in Aotearoa/NZ Christine Gold
Setting the compass to North: Student voice as an evaluation tool in an educational evaluation Roseanna Bourke and Jo MacDonald — Download presentation (937KB PDF)
Six Months in a Leaky Boat – Steering through the Choppy Waters of Education Alexandra McKegg
Keeping the destination in sight: Determining compass points in complex evaluations Sally Boyd and Jacky Burgon — Download presentation (1.5MB PDF)
Voyaging together: Supporting evaluative thinking in New Zealand schools Dr Michael Blewden, Kathryn Baldwin and Simon Chiaroni
Evaluation voyaging in a pop-up world David Stuart
Navigating culture: Is there a working compass for Pākehā evaluators? Rae Torrie, Mark Dalgety, Robin Peace and Robyn Bailey
What’s on the rubric horizon: taking stock of our current practice and thinking about what is next Melissa Weenink and Judy Oakden — Download Presentation (PDF 1.2MB)
Deep dive to explore praxis: A safe space to dialogue about how values, theory and practice enable change Louise Were
Lessons from Aristotle and Glen Turner in anchoring evaluation theory and practice in world of change and complexity John Wren — Download presentation (8.6MB Powerpoint)
Productivity Commission: Charting new waters in social service evaluation Ron Crawford — Download presentation (641KB Powerpoint)
Avoiding evaluation ‘all at sea’! Evaluation planning tips and tricks for smooth sailing Paula White and Jessie Wilson
Using the compass – challenges to the focus of evaluations at ACC Sally Faisandier — Download presentation (PPTX 3.5MB)
Casting the net: Weaving evaluative thinking into the fabric of our organisation and that of our colleagues in the Pacific Ingrid van Aalst, Elisabeth Poppelwell and Mei Lin Harley
Casting the Net: Evaluation and New Zealand Aid (IDG) Saville Kushner
Application of evaluative monitoring for adaptive planning, monitoring & evaluation in a bi-lateral aid partnership programme Kate Averill
To there and back again: a practical evaluation guide on how to survive sea sickness Sally Duckworth and Lisa Gregg
Evaluation and accountability of aid Suzanne Loughlin
A network-based mechanism for monitoring participation of agencies in multi-agency development projects Dr Salend Kumar
Working in partnership with NGO’s to understand what makes an effective evaluation culture: a pilot study with Maori and Pacific NGO’s Kirk Mariner
‘Finding out what’s really going on’: developing rapport and giving voice to community providers being evaluated Melanie Martin
Building a lighthouse of knowledge to illuminate a sea of unknowns Dr Kara Scally-Irvine and Diana Jones
Reaching across boundaries – evaluation of high stakes collaboration Kate McKegg, Judy Oakden and Debbie Goodwin — Download presentation (PDF 724KB)
Finding a compass: Evaluating in traumatic contexts Dr Annie Weir and Dr Carol Mutch
Toka Tū- Standing strong: An adaptive approach to building evaluation capacity and practice based evidence Sarah O’Connor
Navigating ‘Place’ in Evaluation: Making Waves in Aotearoa and across the Pacific Maxine Dignan — Download presentation (PDF 5.5MB)
Evaluative Capability Building – Casting the net into the field of science Toni White, Helen Percy, Bruce Small — Download presentation (PDF 886KB)
The value of developmental evaluation in health innovations Sarah Appleton and Nishadie Edirisuriya
Seeking a pan NZ Defence approach: A journey of evaluation discovery Jo Sheffield, (Andy Moore)
A strategic approach to building evaluation capability and culture: A New Zealand case study Angele Toomey — Download presentation (PDF 3.3MB)
Recognising quality, value and importance: Designing and embedding integrated evaluative systems to improve understanding and performance Dr Kara Scally-Irvine
Other ANZEA Conference Archives
Other conference archive are available here with similar access to speakers’ materials, notes and biographies for those who are interested.