1. Evaluation of the Shape the Community Sport Development Program: A Collaboration Presenters: Mr. Larry Romany, Trinidad and Tobago Olympic Committee (TTOC) Ms. Jay Mafukidze, University of Trinidad and Tobago (UTT) Ms. Jennie Petersen, Trinidad and Tobago Olympic Committee (TTOC) and Commonwealth Games Canada (CGC)

2. Presentation Outline Background Information The Need and the Opportunity Point Fortin as the Pilot Community The SCSD Program Evaluation of the SCSD Program Collaboration with UTT and CGC Clarification of Program Goals/ Objectives Evaluation Plan Development - Methods Results to Date and Challenges Next Steps Implications Lessons Learned Long-term Evaluation and Measurement

3. Background: Some Statistics on T&T Population: 1.3 Million (Stewart, 2009) In 2008, there were over 500 murders, massacres and missing persons Significant proportion of these crimes committed by youth ages15-18 (Stewart, 2009) In 2007, there were 14,000 people living with HIV/AIDS (Population Reference Bureau & UNAIDS, 2007) In the Caribbean, 1 in 10 school-going adolescents have been sexually abused (World Bank, 2003)

4. Background on SCSD: The Need Physical Education in Trinidad and Tobago (T&T) Structured programming offered on an ad-hoc basis in schools Prevalence of overweight/obesity in the Caribbean: Increased from 7% in men and 20% in women in the 1970s to 22% in men and 58% in women, in the 1990’s (Alleyne, 2005) Community Sport Club Structure Development across T&T Limited out of school sports programming available Limited pool of coaching/recreational leader resources A Vehicle for Community Development Increasing crime rates, teenage pregnancy, poor academic performance

5. Background: The Opportunity Partnership Opportunity National Sport Organizations Schools Local Community Organizations Universities Government Bodies Sponsorship Opportunity Atlantic LNG TTOC as the Linkage

7. Population: ~19,000

8. Ten Primary Schools

9. ~3000 primary school students

11. Background: The SCSD Program Community Coaching Structure TTOC administrators based in Point Fortin Local community members trained as coaches ~35 Community Coaches trained to date Trained by local National Sporting Organizations

12. Evaluation of the SCSD Program A collaboration between the TTOC and the UTT TTOC contracted the UTT for the evaluation A collaboration also in association with Commonwealth Games Canada (CGC) A CGC intern working with TTOC acts as the link between the UTT and the TTOC

13. Clarification of Program Goals/ Objectives Goal #1 To improve health and well being of school age children by increasing their opportunities for sport, recreation and physical education. Goal #2 To provide the local community with a cadre of certified personnel capable of independently developing and maintaining sport programs in the community. Goal #3 To enrich community life by developing a community ethos where sport, recreation and physical education is viewed by all stakeholders as a key component in the development of the economic, social and physical well being of society.

14. Clarification of Program Goals/ Objectives Goal #4 To build long-term capacity for sport, recreation and physical education opportunities in the community by forging working relationships between all stakeholders in the community and establishing linkages across sporting organizations. Goal #5 Increase awareness of the importance of sport, recreation and physical education across the broader population of Trinidad and Tobago

15. Evaluation Objectives To determine the level of success or impact of the SCSD on the community To determine areas for improvement and develop a set of programmatic recommendations for further program developments To determine whether the program was implemented as planned and identify potential areas for improvement

16. Impact Evaluation Plan – Phase 1 Impact on students - individual level outcomes (Goal 1) Pre-post design Fitness Testing Anthropometric Measures Surveys – Most Significant Change Students, Teachers, Parents, Coaches Student life skills and academic assessment Timeline March to June 2010

17. Impact Evaluation Plan – Phase 2 Impact on community - community level outcomes (Goal’s 2-5) Retrospective design Surveys teachers, coaches Focus Groups teachers, coaches, parents Individual Interviews principals, National Sporting Organizations Timeline March to July 2010

18. Process Evaluation Purpose To determine program implementation integrity To identify potential areas for improvement To examine whether standardized processes are in place to achieve a sustainable program Data Collection Subjects TTOC Administrators, coaches, teachers, National Sporting Organizations Method Surveys, Focus Groups, Interviews Timeline March to June 2010

19. Participation – 2009/2010 School Year

20. Where Are We At Now? Still collecting data! Pilot testing The Challenges: Complexities of Large-scale Programs and Evaluation Planning Cultural Challenges Human Resource Challenges Ethics Approval Organizational/ Administrative Challenges Attendance/ Tracking

21. Lessons Learned Start evaluation planning when you start planning your program Be clear about what you are trying to achieve Clear goals and objectives A Logic Model is a very helpful tool to identify and plan all evaluation processes Helps ensure your program goals/ objectives and the evaluation goals are aligned Continually make everyone is on the same page as you plan and conduct your evaluation

22. Lessons Learned Continued Conduct an ‘Evaluability’ Assessment Know who your key stakeholders, their prime interest in your program and what they want to know about the impact of the program Very important to take into consideration of the culture for program AND evaluation planning Plan around cultural festivals/events Plan around school schedules Face to face interactions Literacy

23. Programmatic Implications Impact on the students and on the development of the community Recommendations for further program developments Expansion to other parts of Trinidad and Tobago Improvements to existing programs in Point Fortin Sustainability assessment

24. Broader Implications Insight on relations between key stakeholders in the sporting community and changes as a result of the program Insight and recommendations for other international sport development programs Insight on the integration of structured sports/ physical activity programming into the school system

25. Next Steps: Long-Term Evaluation Integrated as a regular part of the program Regular data collection Beginning and end of school year Potential for long-term study Evaluation of additional communities Beginning September 2010 Mayaro, Trincity

26. Acknowledgements Atlantic LNG Oasis Water Commonwealth Games Canada TTOC Staff and Coaches UTT Student Testers