Enhancing response time thresholds with response behaviors for detecting disengaged examinees

Large-scale Assessments in Education

An IERI – International Educational Research Institute Journal

Table 1 Number and percentage of examinees identified with rapid-disengagement behavior by response time-only (RT) and enhanced (E) methods and their differences

Threshold	Method	Number and percentage of examinees identified by RT and enhanced
		Question
		CD item 1		CD item 2		CD item 3		Star item 1		Star item 2		Star item 3		Star item 4
5	RT	5	0.33	4	0.26	11	0.72	4	0.26	6	0.40	11	0.72	22	1.45
5	E	4	0.26	4	0.26	11	0.72	4	0.26	6	0.40	10	0.66	22	1.45
10	RT	10	0.66	19	1.25	33	2.17	7	0.46	6	0.40	21	1.38	18	1.19
10	E	7	0.46	11	0.72	30	1.98	7	0.46	6	0.40	19	1.25	18	1.19
20	RT	75	4.94	81	5.34	66	4.35	26	1.71	139	9.16	118	7.77	177	11.66
20	E	54	3.56	47	3.10	53	3.49	18	1.19	125	8.23	68	4.48	153	10.08
30	RT	162	10.67	158	10.41	113	7.44	44	2.90	427	28.13	190	12.52	408	26.88
30	E	119	7.84	83	5.47	88	5.80	22	1.45	372	24.51	78	5.14	349	22.99
40	RT	307	20.22	229	15.09	163	10.74	65	4.28	694	45.72	277	18.25	715	47.10
40	E	190	12.52	118	7.77	105	6.92	29	1.91	582	38.34	95	6.26	607	39.99
50	RT	520	34.26	318	20.95	240	15.81	97	6.39	901	59.35	393	25.89	968	63.77
50	E	279	18.38	150	9.88	123	8.10	35	2.31	719	47.36	108	7.11	810	53.36
60	RT	757	49.87	417	27.47	329	21.67	133	8.76	1067	70.29	558	36.76	1177	77.54
60	E	345	22.73	176	11.59	141	9.29	41	2.70	792	52.17	114	7.51	967	63.70