Large-scale Assessments in Education

An IERI – International Educational Research Institute Journal

Table 2 Experiment Results 1–Overall Average Prediction Performance

From: An engagement-aware predictive model to evaluate problem-solving performance from the study of adult skills' (PIAAC 2012) process data

^aDV	Attention-LSTM			Effort-Aware Attention-LSTM
	Performance			Performance			Engagement
	ACC	AUC	F1	ACC	AUC	F1	ACC	AUC	F1
US	0.779 (0.080)	0.751 (0.101)	0.824 (0.098)	0.802 (0.113)	0.821 (0.110)	0.875 (0.106)	0.872 (0.050)	0.878 (0.052)	0.937 (0.050)
SK	0.751 (0.091)	0.700 (0.102)	0.828 (0.110)	0.859 (0.115)	0.824 (0.120)	0.886 (0.108)	0.845 (0.017)	0.857 (0.020)	0.881 (0.048)
GB	0.778 (0.087)	0.771 (0.100)	0.816 (0.108)	0.883 (0.103)	0.835 (0.098)	0.900 (0.097)	0.844 (0.082)	0.858 (0.068)	0.920 (0.098)

US: United States; SK: South Korea; GB: United Kingdom
^aDV: Dependent Variable; The performance and engagement level is simultaneously predicted in the second model

Back to article page