Skip to main content

An IERI – International Educational Research Institute Journal

Table 4 Standard Deviations of Different Factors of Analytical Decisions for Trend Estimates in PISA Mathematics Obtained from a Variance Component Analysis

From: Evaluating the effects of analytical decisions in large-scale assessments: analyzing PISA mathematics 2003-2012

 

Source of variance

2003-2006\(^{\mathrm{a}}\)

2006-2009\(^{\mathrm{b}}\)

2009-2012\(^{\mathrm{c}}\)

1

Country

7.28

11.51

8.96

2

Sample

0.14

0.12

0.43

3

Calibration

0.00

0.36

0.47

4

Items

0.46

0.00

2.27

5

Estimation

0.00

0.00

0.00

6

Sample:country

0.00

0.00

0.00

7

Calibration:country

0.14

0.03

0.29

8

Items:country

2.59

2.04

4.10

9

Estimation:country

0.00

0.16

0.12

10

Sample:calibration

0.00

0.11

0.07

11

Sample:items

0.10

0.04

1.04

12

Estimation:sample

0.00

0.00

0.00

13

Items:calibration

0.00

0.19

0.00

14

Estimation:calibration

0.00

0.00

0.29

15

Estimation:items

0.11

0.33

0.02

16

Sample:calibration:country

0.10

0.00

0.00

17

Sample:items:country

0.25

0.20

0.20

18

Estimation:sample:country

0.00

0.00

0.00

19

Items:calibration:country

0.15

0.00

0.00

20

Estimation:calibration:country

0.09

0.08

0.23

21

Estimation:items:country

0.23

0.00

1.02

22

Sample:items:calibration

0.09

0.02

0.03

23

Estimation:sample:calibration

0.11

0.08

0.11

24

Estimation:sample:items

0.10

0.01

0.10

25

Estimation:items:calibration

0.08

0.13

0.23

26

Residual

0.55

0.54

0.58

  1. Variance components including number of countries: \(^{\mathrm{a}}\)40, \(^{\mathrm{b}}\)57 and \(^{\mathrm{c}}\) 63.