Large-scale Assessments in Education

An IERI – International Educational Research Institute Journal

Table 6 Item-by-country exact match ratio (ChatGPT)

From: Combining machine translation and automated scoring in international large-scale assessments

	C1	C2	C3	C4	C5	C6	C7	C8	Average
Item 1	0.88	0.91	0.94	0.90	0.92	0.92	0.93	0.87	0.91
Item 2	0.92	0.99	0.95	0.95	0.95	0.97	0.94	0.95	0.95
Item 3	0.98	0.98	0.97	0.95	0.92	0.99	0.97	0.97	0.97
Item 4	0.95	0.93	0.85	0.90	0.88	0.86	0.94	0.90	0.90
Item 5	0.92	0.90	0.85	0.86	0.85	0.92	0.92	0.92	0.89
Item 6	0.98	0.96	0.94	0.91	0.96	0.77	0.94	0.87	0.92
Average	0.94	0.95	0.92	0.91	0.91	0.91	0.94	0.91	0.92

Note C1 & C2 = German-speaking countries; C3 = French-speaking country; C4 = Turkish-speaking country; C5 = English-speaking country; C6 & C7 = Chinese-speaking countries; C8 = Korean-speaking country

Back to article page