An IERI – International Educational Research Institute Journal
Table 1 Evaluation elements and aspects of standard-setting procedures.
From: The standard setting process: validating interpretations of stakeholders
Evaluation element | Description of our validation |
|---|---|
Procedural | |
Explicitness | Clear and explicit communication within the process |
Implementation | Clear, systematic, and rigorous implementation of the procedures as well as the selection and training of the participants |
Feedback | Experts’ confidence in the process and the resulting cut scores |
Internal | |
Consistency within method | Variability of the estimates of the cut scores |
External | |
Comparison to other sources of information | Relationship between decisions based on cut scores and lessons taught in science, mathematics, and German |
Consequential | |
Reasonableness of cut scores | Relationship between cut scores and intended as well as pursued studies in science and non-science fields |