Skip to main content

An IERI – International Educational Research Institute Journal

Table 9 Mastery/non-mastery agreement rates (%) between each pair of Q-matrices based on five-countries and country-specific data

From: Using country-specific Q-matrices for cognitive diagnostic assessments with international large-scale data

 

Whole numbers and integers

Fractions, decimals and proportions

Patterns

Expressions, equations and functions

Lines, angles and shapes

 

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Original vs. Stepwise(cs)

92.46

89.03

67.41

79.37

68.83

92.96

83.41

90.89

82.28

95.48

Original vs. Chiu(cs)

86.31

84.70

81.87

58.27

75.75

71.41

80.17

78.49

49.89

70.34

Stepwise(cs) vs. Chiu(cs)

82.50

84.18

87.05

56.60

78.36

67.81

78.96

73.74

51.20

70.07

Original vs. Stepwise(fc)

87.85

80.11

81.83

60.69

59.54

88.02

75.56

82.65

56.73

65.32

Original vs. Chiu(fc)

87.28

86.37

64.27

49.52

54.34

48.68

82.65

87.49

44.61

72.21

Stepwise(cs) vs. Stepwise(fc)

83.28

85.00

71.21

65.09

59.76

53.79

74.21

80.73

55.75

79.41

Chiu(cs) vs. Chiu(fc)

85.18

80.57

75.12

48.55

81.59

92.62

72.23

76.15

58.94

65.37

 

Measurement

Location and movement

Data organisation, representation and interpretation

Probability

Average of Nine Attributes

 

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Mastery

Non-mastery

Original vs. Stepwise(cs)

63.58

82.37

92.32

94.80

95.84

91.63

76.60

80.80

80.30

88.59

Original vs. Chiu(cs)

68.62

88.50

78.28

63.60

78.67

83.54

62.84

64.11

73.60

73.66

Stepwise(cs) vs. Chiu(cs)

57.69

76.94

78.03

62.75

75.02

83.21

69.52

69.13

73.15

71.60

Original vs. Stepwise(fc)

74.64

67.72

76.57

79.76

87.71

76.63

68.41

47.66

74.32

72.06

Original vs. Chiu(fc)

74.99

89.90

82.76

85.54

83.51

86.83

60.41

49.65

70.54

72.91

Stepwise(cs) vs. Stepwise(fc)

75.98

83.48

68.80

82.08

77.68

80.77

62.31

51.33

69.89

73.52

Chiu(cs) vs. Chiu(fc)

66.37

59.05

78.21

80.30

86.17

78.41

80.06

57.76

75.99

70.98

  1. “cs” referred to using the country-specific data for that method, and “fc” referred to using the five-countries-combined data for that method