Does the data articulate trends or patterns over time?
Pre-/post- tests that measure growth
Graphical displays of progress
Formative and summative data
Single summative data point
Multiple data points that do not align with each other
Connected to inputs and plans
Are various data points clearly connected?
Makes explicit connection between data and practice
Identifies the problem and the impact of the solution
Tells the story of data driven decision making and resulting outcomes
Lists of facts and/or data without connecting it to the context or prompt question
Appendix B: Data sources in Edwin
The graphic below indicates what data metrics are available in what Edwin report. For more information about the types of questions you can answer in each report, see the Edwin Overview page.
Appendix C: Sharing Quantitative Data in the Formal Review
ESE collects and reports on a number of output data measures; ESE and reviewers use several of these measures to inform decisions made in the formal review for program approval.1SOs have the opportunity to share state-collected or SO-collected data along with additional context, analysis, and their own conclusions based on the data to demonstrate the extent to which they are meeting ESE expectations as outlined in the Program Approval Criteria.
Below are general guidelines to consider while incorporating quantitative data into the offsite portion of the formal review to ensure data included provides the review team with the information they need to incorporate the data in their decision making process:
Guidance
Rationale
Example
Share data from the three most recent years
Although SOs may choose to include data from any year, by including the last three years of data at a minimum, reviewers get an indication of the program in its most current iteration.
“Candidates who completed between 2014 and 2016 agreed…”
Include the n-size
This will help reviewers understand how representative this data is of the population of stakeholders.
“In 2014, we surveyed 8 completers and found that…”
If sharing survey data, include the entire survey scale for the item in the prompt response.2
It is important for reviewers to understand the full range of responses in SO-collected data.
“TCs are given Practicum Surveys exiting the program. 80% stated that they were very satisfied with their advising. (See supplement #1 Program Survey data)”
Appendix D: High-Quality Evidence of Impact Checklist