Skip to main content

An IERI – International Educational Research Institute Journal

Table 2 Comparison of Country Means Standard Errors and Confidence Intervals for OECD Method and Rescaling for 13 Countries

From: Evaluating the effects of analytical decisions in large-scale assessments: analyzing PISA mathematics 2003-2012

country

2003

2006

OECD Meth.

Rescaling

OECD Meth.

Rescaling

M

SE

\(M_{aver.}\)\(^{\mathrm{a}}\)

\(SE_{comp.}\)\(^{\mathrm{b}}\)

\(\Delta _{BI}\)\(^{\mathrm{c}}\)

M

SE

\(M_{aver.}\)\(^{\mathrm{a}}\)

\(SE_{comp.}\)\(^{\mathrm{b}}\)

\(\Delta _{BI}\)\(^{\mathrm{c}}\)

HKG

548.30

(3.75)

546.32

(5.46)

11.46

549.61

(2.13)

551.78

(3.37)

8.34

KOR

540.15

(2.69)

539.41

(3.45)

7.80

548.98

(2.92)

549.92

(3.97)

9.01

FIN

542.26

(1.77)

543.33

(2.46)

5.81

549.55

(2.10)

551.51

(3.51)

8.71

BEL

530.43

(2.05)

529.34

(2.77)

6.51

525.53

(2.34)

525.25

(3.04)

7.18

AUS

523.60

(1.90)

522.85

(2.62)

6.05

521.05

(1.80)

522.30

(2.89)

6.76

DEU

503.48

(2.95)

504.51

(3.91)

8.92

508.84

(3.07)

510.46

(4.80)

10.89

ISL

514.48

(1.57)

512.60

(3.60)

8.10

508.24

(1.91)

507.14

(3.31)

7.99

DNK

513.58

(2.52)

512.16

(3.85)

8.29

515.34

(2.30)

514.23

(3.35)

8.50

IRL

501.83

(2.15)

500.63

(3.37)

7.40

504.40

(2.34)

503.93

(3.28)

7.59

USA

482.53

(2.59)

481.68

(3.79)

8.36

478.05

(3.24)

476.27

(5.00)

11.44

PRT

466.87

(2.99)

466.36

(3.33)

7.37

471.24

(2.33)

470.93

(3.00)

7.90

ESP

485.00

(2.20)

484.66

(2.63)

6.03

483.79

(1.83)

483.08

(2.55)

6.49

ITA

466.53

(2.53)

470.06

(6.21)

13.17

466.96

(1.81)

467.41

(2.42)

6.25

country

2009

2012

OECD Meth.

Rescaling

OECD Meth.

Rescaling

M

SE

\(M_{aver.}\)\(^{\mathrm{a}}\)

\(SE_{comp.}\)\(^{\mathrm{b}}\)

\(\Delta _{BI}\)\(^{\mathrm{c}}\)

M

SE

\(M_{aver.}\)\(^{\mathrm{a}}\)

\(SE_{comp.}\)\(^{\mathrm{b}}\)

\(\Delta _{BI}\)\(^{\mathrm{c}}\)

HKG

556.29

(2.48)

558.04

(3.52)

9.43

566.40

(2.83)

564.73

(5.54)

14.65

KOR

548.65

(2.92)

550.83

(4.07)

9.53

557.53

(3.93)

554.87

(6.97)

16.56

FIN

541.87

(1.71)

543.48

(2.74)

6.80

523.34

(1.55)

527.71

(5.51)

14.51

BEL

519.56

(1.80)

521.03

(2.65)

6.89

519.83

(1.85)

518.59

(3.79)

10.07

AUS

517.65

(2.06)

519.05

(2.74)

6.86

509.03

(1.43)

511.85

(3.89)

11.20

DEU

516.03

(2.40)

516.58

(3.15)

7.59

518.02

(2.48)

519.79

(3.92)

10.12

ISL

510.46

(1.75)

510.92

(2.62)

7.00

496.91

(1.73)

497.21

(3.16)

9.74

DNK

505.41

(2.48)

507.05

(3.06)

7.46

504.78

(2.06)

504.53

(3.41)

9.31

IRL

493.36

(2.01)

493.63

(3.08)

8.42

505.98

(1.92)

507.35

(3.16)

9.05

USA

490.05

(2.80)

490.01

(3.95)

9.77

485.62

(3.05)

485.98

(4.06)

10.99

PRT

489.33

(2.21)

489.25

(3.76)

10.71

492.58

(3.31)

491.52

(5.16)

13.34

ESP

487.68

(1.85)

487.76

(2.88)

7.54

489.83

(1.63)

490.58

(2.58)

8.09

ITA

486.19

(1.48)

486.40

(3.00)

7.90

490.18

(1.75)

489.61

(3.19)

8.96

  1. \(^{\mathrm{a}}\)Mean aggregated Country mean (\(M_{aver.}\)) across 32 combinations of analytical decisions
  2. \(^{\mathrm{b}}\)compound Standard error (\(SE_{comp.}\)) accounting for method variance across 32 combinations of analytical decisions
  3. \(^{\mathrm{c}}\)Range of error from constructed confidence interval (\(\Delta _{BI}\)) based on highest and lowest country mean estimates and their respective standard errors to account for methodvariance.