Skip to main content

An IERI – International Educational Research Institute Journal

Table 4 Mean facet level item Difficulty across reading facets and levels

From: Comparing the score interpretation across modes in PISA: an investigation of how item facets affect difficulty

Facet

Level

All items

Mode invariant items

\({\overline{\mathrm{b}} }_{\mathrm{PBA}}\)

\({\overline{\mathrm{b}} }_{\mathrm{CBA}}\)

Wald test χ2 (N = 11795)

\({\overline{\mathrm{b}} }_{\mathrm{PBA}}\)

\({\overline{\mathrm{b}} }_{\mathrm{CBA}}\)

Wald test χ2 (N = 11795)

Situation

Public

−0.16 (0.04)

0.10 (0.04)

χ2 (3) = 34.34*

−0.44 (0.05)

−0.35 (0.04)

χ2 (3) = 9.16*

Personal

−0.55 (0.04)

−0.24 (0.04)

p < 0.01

−0.69 (0.04)

−0.43 (0.04)

p = 0.03

Educational

−0.72 (0.05)

−0.31 (0.06)

 

−0.39 (0.07)

−0.14 (0.12)

 

Occupational

−0.65 (0.04)

−0.57 (0.05)

 

−0.78 (0.05)

−0.62 (0.07)

 

Text format

Continuous

−0.55 (0.04)

−0.30 (0.04)

χ2 (3) = 26.15*

−0.59 (0.04)

−0.36 (0.06)

χ2 (3) = 12.93*

Mixed

−0.07 (0.04)

0.43 (0.05)

p < 0.01

0.00 (0.05)

0.36 (0.10)

p < 0.01

Non-continuous

−0.63 (0.04)

−0.31 (0.04)

 

−0.69 (0.05)

−0.59 (0.05)

 

Multiple

−0.99 (0.05)

−0.56 (0.04)

 

−1.07 (0.06)

−0.73 (0.06)

 

Aspect

Integrate and interpret

−0.47 (0.04)

−0.16 (0.05)

χ2 (2) = 15.86*

−0.42 (0.05)

−0.15 (0.09)

χ2 (2) = 1.76

Reflect and evaluate

−0.45 (0.04)

−0.26 (0.04)

p < 0.01

−0.39 (0.04)

−0.22 (0.04)

p = 0.41

Access and retrieve

−0.81 (0.05)

−0.44 (0.04)

 

−1.17 (0.07)

−1.04 (0.05)

 
  1. *Significant difference between PBA and CBA variation in estimated mean item difficulty within facet