Measurement

We collect a mix of qualitative (i.e., internal and external program observations, interviews, focus groups) and quantitative data (i.e., survey scores) which provide exploratory insights and useful context to build compelling narratives about our programs. We track growth and change in each outcome through pre and post surveys and use secondary research as a comparative benchmark to approximate what it would have been like otherwise for each youth by comparing their experience and results with similar youth who did not participate in our programs. We use industry leading frameworks and tools to help us understand how our programs are facilitated, continually identify areas for improvement, and provide a high-quality experience for all youth. Our measurement efforts are all-encompassing as we connect with campers, the Youth Advisory Council, alumni, and staff to fully understand the camp experience.

We firmly believe that measurement is continual. We don’t just measure once, but instead we measure multiple times using a cycle. Through continual measurement we identify what we’re doing well, determine where we can improve, and implement key changes to our programs and staff training.

Program quality is key to understanding how Tims Camps programs are facilitated for our youth. Aligned with many other educational settings and out-of-school-time programs, the fields of positive youth development and camp are prioritizing a program quality lens to ensure that every youth has a quality experience at camp. Through participation in high-quality settings and programs, youth develop greater positive outcomes that are associated with wellbeing and thriving in young adulthood. We seek to measure program quality across all our programs and use program quality data to inform changes and improvements to our programs.

Program quality refers to how programs are facilitated at camp through staff practices that create four environments. The David P. Weikart Centre for Youth Program Quality (part of the Forum for Youth Investment) structures these environments in a pyramid, similar to Maslow’s hierarchy of needs. The lower levels of the pyramid must be satisfied (i.e., the environments must be created) before higher levels of the pyramid can be reached. Health and safety standards are addressed in accreditation models, and therefore program quality focuses primarily on social emotional aspects of the program.

At Tims Camps, we began assessing program quality through our participation in the American Camp Association’s Camp Program Quality Initiative (CPQI). This was a pilot program to understand and develop sustainable systems of program quality in the camp space. We were honoured to be selected to participate in the CPQI pilot.

Through our participation in the CPQI and our initial assessment, we realized the need to prioritize program quality in all that we do and have launched a full-scale continuous improvement cycle focused on program quality assessment. We are using a research-validated measurement tool for internal and external assessments, engaging multiple stakeholders in the assessment process (i.e., staff across the organization, campers, Youth Advisory Council members, school partners), and creating new and unique ways of understanding program quality from the youth perspective. We are using program quality data to reflect on our programs and make changes to better serve youth.

Tims Camps Summer Program is a strength-based, high-impact leadership development program with a rigorous learning model based on research. Our program frameworks are grounded in evidence that focuses on developing tangible skills to help youth succeed and thrive in young adulthood. We intentionally design our programs to meet the short, medium, and long-term needs of the youth we serve, and we rigorously measure these outcomes with our youth to identify program areas to target.

Our Summer Program methodology assesses each individual youth’s progress towards demonstrating the priority outcomes of social and emotional skills, learning and innovation skills, post-secondary access and independent living capability. See the program outcome definitions listed below.

In creating this framework, we mapped our outcomes against similar organizations to answer two primary questions:

Working with schools in priority neighbourhoods for day or overnight camp sessions per school year, our School Program inspires students to become visible, positive leaders in their schools and make their communities more positive places. This model allows us to leverage the capacity of our camps and serve more youth in our communities in a meaningful way.

In addition to the focus on social and emotional skills and learning and innovation skills, the School Program focuses on positive contributions to the school environment including motivation to learn, volunteerism and classroom behaviour. The long-term goal is to strengthen communities with productive avenues for family involvement, supportive neighbourhoods and empowered youth. This program truly relies on collective impact - working hand-in-hand with educators, schools and school boards to move the needle on these key indicators. See the program outcome definitions listed below.

School Program evaluation includes a pre- and post-youth survey, evaluating changes to key indicators using report card data (where applicable) and a retrospective pre- and post-educator survey.