What were the goals of the summit?
The ATE Evaluation Summit aimed to bring together ATE project staff, evaluators, NSF program officers, and EvaluATE to discuss the current and future state of ATE evaluation.
Through discussions, we aimed to contribute to the improvement of ATE evaluation by:
- Collectively identifying what high-quality ATE evaluation looks like in practice,
- Identifying barriers and facilitators in ATE evaluation, and
- Strengthening relationships between ATE project staff, evaluators, and NSF program officers.
Graphic recordings from the 2023 ATE Evaluation Summit
A graphic artist from The Sketch Effect joined our event. He listened throughout our small and large group discussions to bring our conversation to life in a visually compelling and memorable way. You can view the discussion topics and their visual representations below.
Reflection on The State of Evaluation in the ATE Program report
Identified meaningful trends and interpretations from current practices in ATE evaluation. Built a shared foundation for future conversations.
- How did the findings in the report reflect your experience with evaluation in the ATE program?
- How did the findings in the report not reflect your experience with evaluation in the ATE program?
- What is one finding that stood out to you in the report? Why?
ATE Evaluation Hopes and Fears
Working to understand the expectations and hesitations around ATE evaluations from various perspectives and gaining a shared understanding of ATE evaluation.
- What are your hopes for evaluation in the ATE program? What do you hope it accomplishes?
- What are your fears for ATE evaluation? What makes you hesitant or cautious about evaluation in the ATE program?
What would bad ATE evaluation look like?
Thinking of the worst ideas possible can help us reverse to find solutions.
- What would bad ATE evaluation look like?
- How might we facilitate bad ATE evaluation?
Mapping the systems surrounding ATE evaluation
To understand connections, drivers, and patterns around ATE evaluation, we worked to identify the facilitators and barriers to closing the gap between the current state of ATE evaluation and future aspirations.
- Reflecting on a cluster mapping activity that was conducted, what patterns emerged? Was anything surprising?
- What are some facilitators to good ATE evaluation?
- What are some barriers to good ATE evaluation?
Start, Stop, Continue
To get balanced, actionable feedback, groups were encouraged to optimize and improve a situation with clear actions.
- To achieve the aspirations we have discussed for high-quality evaluation, what needs to start, stop, and continue?
Who participated in the summit?
NSF Program Officers
ATE PIs and Project Staff
Lyssa Wilson Becho