Student test-taking effort in low-stakes assessments: evidence from the English version of the PISA 2015 science test

Large-scale Assessments in Education

An IERI – International Educational Research Institute Journal

Table 4 At each cluster position, the average success percentage for responses where (i) SB = 0, (ii) SB = 1 and (iii) difference in success percentages

Country	Cluster position	Average percentage of success:
		RT below the threshold (SB = 0)		RT above the threshold (SB = 1)		Difference (above-below)
		\(\widehat{\mu }\)	SE	\(\widehat{\mu }\)	SE	\(\widehat{d}\)	SE
AUS	1	18.12	0.98	53.51	0.46	35.38	1.07
	2	16.49	0.76	52.58	0.47	36.09	0.91
	3	16.71	0.87	53.34	0.44	36.64	0.94
	4	13.67	0.58	51.40	0.53	37.73	0.64
CAN	1	16.76	1.12	56.60	0.53	39.85	1.20
	2	16.03	0.74	55.28	0.57	39.25	0.90
	3	16.59	0.92	55.56	0.59	38.97	1.18
	4	15.73	0.64	54.92	0.49	39.19	0.65
GBR	1	15.28	0.86	54.22	0.58	38.94	0.98
	2	14.99	0.69	54.15	0.63	39.15	0.82
	3	15.93	0.84	54.16	0.67	38.23	1.07
	4	15.11	0.63	53.00	0.69	37.89	0.86
IRL	1	15.58	0.93	51.30	0.54	35.72	0.98
	2	12.65	0.75	50.95	0.56	38.30	0.85
	3	13.82	0.68	52.35	0.52	38.53	0.77
	4	13.57	0.78	50.45	0.56	36.89	0.92
NZL	1	14.43	1.05	55.89	0.71	41.47	1.20
	2	12.52	0.68	53.44	0.76	40.92	0.93
	3	13.64	1.08	53.41	0.68	39.77	1.32
	4	11.87	0.76	51.12	0.71	39.25	1.07
USA	1	10.81	1.01	50.17	0.71	39.37	1.26
	2	14.18	0.83	49.79	0.72	35.60	0.93
	3	15.37	0.75	49.81	0.80	34.43	1.01
	4	17.15	0.87	49.12	0.81	31.96	0.98

Omitted and not-reached items were recoded as incorrect answers; if an item had a polytomous score, the maximum score was coded as correct and partial scores as incorrect