Skip to main content

Table 1 Evaluation elements and aspects of standard-setting procedures.

From: The standard setting process: validating interpretations of stakeholders

Evaluation element Description of our validation
Procedural
 Explicitness Clear and explicit communication within the process
 Implementation Clear, systematic, and rigorous implementation of the procedures as well as the selection and training of the participants
 Feedback Experts’ confidence in the process and the resulting cut scores
Internal
 Consistency within method Variability of the estimates of the cut scores
External
 Comparison to other sources of information Relationship between decisions based on cut scores and lessons taught in science, mathematics, and German
Consequential
 Reasonableness of cut scores Relationship between cut scores and intended as well as pursued studies in science and non-science fields