Reflecting on the 2023 ATE Evaluation Summit: Advancing Evaluation Practices in the ATE Program

Evaluation plays a crucial role in assessing the effectiveness and impact of programs. In the realm of Advanced Technological Education (ATE), where innovation and education intersect, evaluation is vital for informing decision-making and shaping future initiatives.

The 2023 ATE Evaluation Summit, held virtually May 22, 23, and 25, 2023, was a significant milestone in fostering collaboration and dialogue among people who share a commitment to advancing ATE evaluation practices.

Coming Together for a Common Goal

The ATE Evaluation Summit brought together a diverse group invested in enhancing ATE evaluation. Participants included EvaluATE staff, NSF program officers, ATE PIs, project staff, grants professionals, and ATE evaluators. By intentionally inviting individuals with a range of experiences, perspectives, and backgrounds, the event acknowledged the multiple facets of ATE evaluation and its influencing factors.

The summit had three main goals:

• Defining High-Quality ATE Evaluation: The first objective was to collectively identify what constitutes high-quality ATE evaluation in practice. Participants explored existing evaluation standards, particularly the JCSEE program evaluation standards, and applied them to the ATE context. This exercise aimed to establish a common understanding of evaluation excellence and guide future efforts.
• Identifying Barriers and Facilitators: The second goal was to recognize barriers and facilitators that impact ATE evaluation. Through small and large group discussions, participants shared their insights and experiences, uncovering challenges and potential enablers in the evaluation process. This exercise provided a holistic view of the current evaluation landscape, preparing participants to create targeted strategies to overcome obstacles.
• Strengthening Relationships: The third objective was to strengthen relationships between ATE project staff, evaluators, and NSF program officers. The summit aimed to enhance communication and mutual understanding by fostering connections and collaborations. Strong partnerships can improve evaluation practices and lead to more impactful outcomes within the ATE program.

The virtual format of the ATE Evaluation Summit allowed participants to engage in meaningful discussions over three days. Together, they examined the findings from the report The State of Evaluation in the ATE Program, delved into the intricacies of ATE evaluation, and sought to bridge the gap between the current state and future aspirations.

In addition to the dynamic discussions, the summit incorporated a unique visual element. As participants shared their insights, perspectives, and experiences, a talented graphic artist actively listened and transformed the key ideas and concepts into visually engaging illustrations. These graphic recordings distilled complex discussions, making them more accessible and adding a layer of creativity and storytelling to the summit.

Looking Ahead

The summit was not a stand-alone event but part of a larger effort to propel ATE evaluation forward. It served as a moment of reflection, where participants came together to evaluate evaluation, so to speak. The commitment to ongoing collaboration, learning, and improvement will ensure that ATE evaluation continues to evolve, meeting the needs of an ever-changing landscape.

The 2023 ATE Evaluation Summit showcased the collective dedication of ATE project staff, evaluators, NSF program officers, and EvaluATE to improve evaluation practices within the ATE program. By defining high-quality evaluation, identifying barriers and facilitators, and strengthening relationships, the summit laid the groundwork for future advancements.

As the ATE community moves forward, we hope that the insights gained from this event will catalyze continuous improvement, ensuring that ATE evaluation remains effective, efficient, and impactful in the years to come.