Promising Practices Rating System (PPRS): Activity Promising Practices Rating Form

This observation rating tool is designed to rate research-based, promising practices in after-school programs. Observers must follow the rubric described in the manual to make ratings of each practice. The tool also includes space where observers can take detailed notes before and after each activity.
The promising practices rated by this tool include are: (a) Supportive Relations with Adult; (b) Supportive Relations with Peers; (c) Level of Engagement; (d) Opportunities for Cognitive Growth; (e) Appropriate Structure; (f) Over-control; (g) Chaos; and (h) Mastery Orientation.

Administration Method
Number of Questions
Creator(s) of Tool
Complete measurement tool reference:
Vandell, D. L., Reisner, E. R., Brown, B. B., Dadisman, K., Pierce, K. M., Lee, D., & Pechman, E. M. (2005, March). The Study of Promising After School Programs: Examination of intermediate outcomes in year 2. Report to the Charles Stewart Mott Foundation.

Complete measurement tool hyperlink:
Scoring / Benchmarking
Point values may be assigned as follows:
4 = highly characteristic. The construct is highly evident. Exemplars are observed more than one time, and for more than one student. The program is viewed as “the very definition of” the construct.
3 = somewhat characteristic. There is good evidence that the construct is present, but it is not pervasive.
2 = somewhat uncharacteristic. The construct was not characteristic of the program; exemplars were observed infrequently or with only one staff or student.
1 = highly uncharacteristic. Little or no evidence of the construct is observed.

Average scores may be obtained by adding the score of each response and dividing by the number of responses. Higher scores indicate better implementation.

When relying on data from observations, it is a good idea to compare ratings from at least two observers. Data may be considered reliable when ratings between raters are consistent.

No benchmarks have been developed for this measure.
Background / Quality
From the developer of this tool:

Promising Practices Rating System: Interrater Reliability. A set of reliability observations was conducted with the Promising Practices Rating System (PPRS) in programs that did not participate in the Study of Promising After-School Programs. The observed programs were representative of what is generally available in the community. The programs served elementary and/or middle school students. Psychometrics for the reliability observations, including reliability statistics, are shown below.

Kappa Statistics:
Supportive relations with adults =.94
Supportive relations with peers = .68
Student engagement = .77
Opportunities for cognitive growth = .89
Mastery orientation = .75
Appropriate structure =.78
Chaos = .73
Staff overcontrol = .63

The February 2012 update to the PPRS included a new rating scale, Productive Homework Help, for which we do not have reliability statistics.
Is there a cost associated with this tool?
Rate this listing
1 vote