Evaluator Procurement Policies and Practices

In this study, we’re learning about the challenges that ATE grant seekers and grantees face when attempting to obtain evaluation services. Ultimately, we expect to identify promising practices for overcoming or managing those challenges so we can share these lessons learned with the ATE community.

Read Initial Findings

What problem does this study address?

ATE principal investigators (PIs) often face conflicting conditions when it comes to identifying evaluators to include in their funding proposals:

NSF proposal reviewers want to see specific evaluators named in ATE proposals.
Both PIs and evaluators believe proposals are stronger when evaluators are involved early in the proposal development process.
Some institutional and/or state procurement policies make it difficult for project planners to select evaluators in a timely way to assist in proposal development.

Why is this study important?

Selecting a qualified evaluator is a critical first step towards having a sound project evaluation. If PIs are unable to navigate that process in a timely way, it can limit a project’s chances for success.

How will EvaluATE (or others) use the study findings?

We will develop resources to help grant writers, project leaders, and evaluators navigate the procurement policies and procedures. We’ll also prepare white papers and publications to inform and possibly influence those who set those policies and procedures.

How are the researchers conducting the study?

The study involves leveraging EvaluATE’s surveys of ATE principal investigators and evaluators to learn about the issues they face when establishing business relationships. We are collecting and reviewing institutional procurement policy documents and interviewing people who have had both positive and negative experiences with the process.

These methods will provide data for answering the three main research questions:

How do ATE grantees and grant seekers select evaluators for their projects?
What barriers do ATE grantees and grant seekers encounter when attempting to procure evaluation services?
What practices or policies for evaluator procurement have enabled grant seekers and grantees to successfully secure evaluation services in a timely way?