Skip to main content

An IERI – International Educational Research Institute Journal

Table 5 Standard Deviations of Different Factors of Analytical Decisions for Cross-Sectional Country Means in PISA Mathematics Obtained from a Variance Component Analysis

From: Evaluating the effects of analytical decisions in large-scale assessments: analyzing PISA mathematics 2003-2012

 

Source of Variance

2003\(^{\mathrm{a}}\)

2006\(^{\mathrm{a}}\)

2009\(^{\mathrm{a}}\)

2012\(^{\mathrm{a}}\)

1

Country

48.69

47.23

44.52

43.30

2

Sample

0.00

0.82

1.80

0.00

3

Items

0.00

0.80

1.02

1.19

4

Estimation

0.02

0.71

0.36

0.00

5

Calibration

4.78

1.05

0.81

0.01

6

Country:sample

0.10

0.02

0.09

0.00

7

Country:items

2.58

2.02

1.71

4.63

8

Country:estimation

0.10

0.07

0.09

0.00

9

Country:calibration

0.15

0.17

0.12

0.12

10

Sample:items

0.00

0.00

0.00

0.97

11

Sample:estimation

0.00

0.42

0.38

0.16

12

Sample:calibration

0.00

0.22

0.04

0.02

13

Estimation:items

0.03

0.08

0.47

0.86

14

Calibration:items

0.00

0.00

0.08

0.36

15

Calibration:estimation

0.02

1.22

1.58

0.20

16

Country:sample:items

0.00

0.00

0.00

0.12

17

Country:sample:estimation

0.00

0.00

0.00

0.00

18

Country:sample:calibration

0.05

0.06

0.03

0.06

19

Country:estimation:items

0.09

0.00

0.10

0.60

20

Country:calibration:items

0.04

0.10

0.05

0.07

21

Country:calibration:estimation

0.06

0.00

0.09

0.11

22

Sample:estimation:items

0.00

0.00

0.03

0.15

23

Sample:calibration:items

0.00

0.24

0.22

0.33

24

Sample:calibration:estimation

0.00

3.87

6.65

3.03

25

Calibration:estimation:items

0.01

0.10

0.26

0.51

26

Residual

0.37

0.44

0.42

0.45

  1. \(^{\mathrm{a}}\) Variance components considering 40 countries.