- Research
- Open Access
- Published:
Effects of classroom and school climate on language minority students’ PISA mathematics self-concept and achievement scores
Large-scale Assessments in Education volume 11, Article number: 11 (2023)
Abstract
Grounded in ecological theory, this study investigated relative contributions of perceived classroom and school climate variables to mathematics self-concept and achievement of English-at-home and English learner (EL) students using PISA 2012 data for American middle-grade students. For both outcomes, results of 3-step hierarchical linear regression models for the combined sample closely mirror those of English-at-home students and mask the unique characteristic of ELs. For self-concept, six (classroom management, cognitive activation, disciplinary climate, teacher support, sense of belonging, and teacher student relations) out of seven predictors were statistically significant and positive predictors for English-at-home students (teacher support being the strongest); only two predictors (disciplinary climate, and teacher student relations) were significant and positive for ELs. Similarly, group discrepancies were found for mathematics achievement. Five variables (classroom management, teacher support, disciplinary climate, sense of belonging to school, and teacher student relations), were significant predictors of English-at-home students. Yet, only three variables (classroom management, disciplinary climate, and teacher support) significantly predicted achievement of ELs. Classroom climate was consistently an important predictor across outcomes and student populations and was the strongest contributor for ELs. Implications and future directions are discussed.
Introduction
Mathematics is an important subject for all students to learn. Not only does it afford students a critical foundation to pursue science, technology, engineering, and mathematics (STEM) careers, it cultivates thinking skills (e.g., logical reasoning, problem solving) and dispositions (e.g., perseverance) that can support students in immerging knowledge-based economy (Melguizo & Wolniak, 2012). There is accumulating evidence that learning in general and learning mathematics in particular is a complex and nuanced process impacted by students’ individual characteristics, current and accumulated classroom experiences, and school-related factors (Engberg & Wolniak, 2013; Han, 2019). These factors not only impact students’ mathematics achievement on standardized tests, but also shape their mathematics self-concept, the evaluative perceptions about themselves as doers of mathematics (Dicke et al., 2018; Parajes & Schunk, 2001). Yet research about how these factors may impact different populations of students, in particular language minority students, is still limited (Sandilos et al., 2020).
As the student population in the United States becomes more diverse, the teaching profession as a whole becomes less diverse. Currently, over five million students enrolled in the U.S. public schools speak a language other than English at home (Hussar et al., 2020). At the same time, schoolteachers and leaders currently lack diversity—the majority are white, middle class, monolingual—and are projected to become even less diverse (Hansen & Quintero, 2019). As reported by the U.S. Department Of Education National Center for Statistics (NCES, 2020), the demographics of teachers nationally indicate that 79.3% of the teachers are White, non-Hispanic; 6.7% are Black, African American, non-Hispanic; 9.3% are Hispanic, regardless of the race; 2.1% are Asian, non-Hispanic; 0.2% are Native Hawaiian/Pacific Islander, non-Hispanic; 0.5% are American Indian/Alaska Native, non-Hispanic; and 1.8% are Two or more races, non-Hispanic. This demographic imbalance and a lack of preparation among school teachers and leaders to work with diverse students (e.g., Goodwin, 2017; King & Butler, 2015; Okhremtchouk & Sellu, 2019) may be one of the factors underlying the long-existing achievement gaps between language minority (LM) and English-speaking language majority students, especially in STEM subjects. In 2019, for example, the average National Assessment of Educational Progress (NAEP) mathematics score for 4th-grade LM students was 24 points lower than that of English-speaking majority students; the 8th-grade LM gap was 42 points (Hussar et al., 2020, pp. 85–86). For these reasons, there is a need to understand what students with culturally and linguistically different backgrounds might need to support their mathematics achievement and self-concepts, especially in higher grades.
Recognizing that LM students negotiate multiple academic and social contexts that influence their learning and the still-limited body of research focused on this important student population, our exploratory study seeks to examine the impacts of two such layers of social contexts. In particular, within an ecological model (Bronfenbrenner, 1977) and using U.S. data from the large-scale assessment Programme for International Student Assessment (PISA), we examine the contributions of classroom learning environment and school climate to students’ mathematics achievement and self-concept with particular attention to how these factors impact LM versus English-speaking majority students.
Developing more nuanced understandings of what works for different student populations to achieve “success for all students” is paramount as literature highlighting what works for advantaged students “typically fails to reveal the social and cultural advantages that make their success possible” (p. 76) and generating more research on successfully educating minority students remains a high priority (Ladson-Billings, 2014). Focusing on better understanding the impacts of classroom learning environment and school climate is particularly important as current culturally and linguistically responsive pedagogy literature (e.g., Aguirre & Zavala, 2013; Fulton, 2009; see Aronson & Laughter, 2016; de Araujo et al., 2018) emphasizes the importance of teachers and schools in supporting LM students.
We recognize that LM students are a heterogeneous group of students who could be referred to in the literature as culturally and linguistically diverse, emergent bilingual, English learner, or multilingual students. In the present investigation, we use the term LM students to more closely align with how PISA categorizes student populations by language-at-home status.
Study background and conceptual framing
Large international assessments play a vital role allowing educational researchers and policymakers to compare effectiveness, gauge progress, and identify areas for improvement. Starting in 2000, PISA began administering large-scale standardized learning assessments to 15-year-olds in such fields as reading, mathematics, and science, with one of these major academic fields selected as primary (i.e., additional data collected) during each 3-year cycle. Pisa’s main objective is to use student achievement data to document and benchmark the effectiveness of international educational systems across academic domains near the end of secondary school. This age bracket is chosen by PISA because students at this age are approaching the end of compulsory education in many countries that are Organisation for Economic Co-operation and Development (OECD) members. Overall, PISA evaluates students’ abilities to produce knowledge, predictions, and applications on a specific issue, based on their understanding of concepts and situations (OECD, 2009a, 2009b). This data informs both international comparisons (what are other countries doing that works well?) as well as internal comparisons (what groups of students should we focus policies towards?).
PISA also allows for comparisons across student population subgroups, such as language at home, and provides additional background and contextual information, such as family backgrounds, attitudes towards learning, and perceptions of school environments (OECD, 2013). Collecting comparable data across countries with various cultural backgrounds and different languages spoken is challenging (Vonkova et al., 2018). Addressing some of such challenges, the present study used USA-only sample data from the PISA 2012 cycle (OECD, 2014). The primary domain of the PISA 2012 cycle was mathematical literacy, which was defined as the capability of the individuals to create, engage, interpret, and assess mathematical concepts in a variety of settings (OECD, 2013). Variables used in the present study were not manipulated, but rather used as provided, reflecting the original context.
Aligned with PISA Framework (OECD, 2014), this study is grounded in Bronfenbrenner’s (1977) ecological systems framework which considers factors affecting learning and development across multiple systems. Such systems of interest to the present study range from the individual, an individual’s prior experiences and resources such as home language, to microsystems, settings where interaction leading to learning or development occurs, such as the classroom and the school (Crawford et al., 2019). In other words, a learning or a developmental outcome is understood as a function of interaction among individual characteristics and immediate and larger environmental contexts. The framework has been applied across age groups and learning domains (e.g., Ardasheva & Tretter, 2013; Dai et al., 2023; Farrant & Zubrick, 2012). Regarding mathematics in particular, there is emergent evidence that individual characteristics and immediate and larger environmental contexts impact both motivational (self-concept) and cognitive (academic) outcomes, with some variation depending on students’ linguistic and cultural backgrounds (Han, 2019; Sandilos et al., 2020). Thus, there is a need to explore both the existence and the directionality of such impacts on language minority versus language majority students.
In what follows, we first discuss self-concept and how it relates to academic achievement, then transition to discussing classroom and school climate as theoretical and/or empirical predictors of self-concept and achievement. While these concepts overlap and interact with one another, the following structure was adopted to provide readers with clarity and allow the authors to discuss each one in turn.
Self-concept and academic achievement
Self-concept, broadly defined, is a person's perception of themselves (Shavelson et al., 1976). It is distinct from self-efficacy, which is typically about the completion of discrete tasks and involves immediate feedback (success or failure), whereas self-concept includes other appraisals including how the task may make you feel (e.g., anxious) or whether you belong (e.g., ‘if no one in class looks like me, do I belong in this class?’; Bong & Clark, 1999). These broader self-concept perceptions are formed through one’s experience with and interpretations of one's environment, and are influenced by reinforcements, evaluations of significant others, and one's attributions for one's own behavior.
Self-concept can be defined by seven critical features outlined in Shavelson et al. (1976) (For a quantitative integration of these theoretical constructs, see Marsh et al., 2018). First, self-concept is organized in such a way that people can categorize information about themselves and relate these categories to one another (Aronson & Steele, 2005). Second, self-concept is multifaceted, with each facet reflecting the category system adopted by a particular individual (regardless of what that category system is). Third, self-concept becomes increasingly multi-faceted as the individual develops from infancy to adulthood (Cvencek et al., 2011). Fourth, self-concept is hierarchical, with perceptions of behavior at the base, moving to inferences about self in subareas, and then to general self-concept (Green et al., 2012). Fifth, general self-concept is stable but, as one ascends the hierarchy, self-concept becomes increasingly situation-specific and, therefore, less stable (Anderman & Midgley, 1997) Sixth, self-concept has both a descriptive and an evaluative dimension such that individuals may describe themselves (‘I am happy’) and evaluate themselves (e.g., ‘I am good at school’) (Byrne & Shavelson, 1986). And finally, self-concept can be differentiated from other constructs, such as academic achievement (Bong & Skaalvik, 2003). (The specific aspects of mathematics self-concept captured by PISA items are summarized in Appendix C.
For example, let us take Robert, an 18-year-old student whose primary language is Spanish, as he enrolls in his first engineering class at Local State University. Having completed high school, Robert has a relatively well-developed self-concept including his ability at academic disciplines, sports, social life, etc. Overall, his self-concept should be fairly stable (e.g., ‘I am a happy, sociable person who is good at school’), but as he engages in different courses, his self-concept for specific disciplines may become more nuanced, continually updated to reflect his experiences and interpretations of those experiences (‘Overall I am a good student; I still need to work on improving my English skills, but I am great at mathematics’). Such continuous changes over time may create a tension for Robert, because while some courses are explicitly language-based (English 101), others may rely heavily on English for instruction (Mathematics 101). This tension may have drastic outcomes for Robert’s future academic choices. For example, if Robert continues experiencing significant difficulties in college mathematics courses, and attributes those difficulties to his mathematics self-concept (rather than his English language skills); he may be discouraged from pursuing a degree in engineering (or perhaps drop out of the university entirely).
Self-concept can be distinguished from academic achievement, although research on the relation between self-concept and indices of academic achievement such as grades and test scores has found positive correlations and reciprocal influences (Arens et al., 2017). And as one would expect, as the measure of self-concept becomes more nuanced (from general self-concept to academic self-concept to mathematics self-concept), the relationship between self-concept and achievement becomes stronger. For example, while general self-concept predicts academic achievement, academic self-concept is a stronger predictor, and indeed subject matter self-concept (mathematics or English, for example) is an even better predictor (e.g., Lauermann et al., 2020; Marsh & Shavelson, 1985). Said another way, thinking of yourself as a science person would positively predict achievement in a physics class, whereas thinking of yourself as a physics person would most likely be an even stronger predictor of physics achievement.
Let us return to Robert. As he continues through college, he begins to delineate and further refine his mathematics self-concept. He may begin to specialize in courses that are less reliant on English and seek out classes and majors in which he feels he can excel. This self-selected delineation has been demonstrated as students move through their formal academic settings. For example, Marsh (1986) found that academic self-concept had a direct effect on subsequent school performance beyond the effects of academic ability and prior school performance. Thus, after accounting for both ability and previous school achievement, academic self-concept still predicted a significant amount of the variance in school performance, indicating that the way students feel in the classroom (if they are challenged, feel they belong, and feel that they can do well) is carried not only into the specific grade, but since academic self-concept is relatively stable, they carry this with them throughout their schooling experience. So, while a number of researchers have focused on younger students in an attempt to alter their science or mathematics trajectories (Polikoff et al., 2018; Sinatra et al., 2017), any intervention has the potential to influence how students engage with coursework in the future.
Kurtz-Costes and Schneider (1994) and Arens et al., (2017) found that self-concept and achievement are bi-directionally related, thus creating a positive or negative spiral. This is similar in nature to the “Matthew Effect” as described by Stanovich in 1986 (albeit related to mathematics rather than reading). For example, consider a student that feels they have a strong mathematics self-concept. They will likely enroll in higher level (and more challenging) mathematics courses, spend more time engaged with mathematics content (in and out of school), report more positive attitudes towards mathematics concepts, and ultimately do better on standardized tests of mathematics achievement. These actions will further strengthen their mathematics self-concept, producing a feedback loop wherein they continue to lean into mathematics content. In contrast, a student who feels that they have a weak mathematics self-concept will likely avoid higher level mathematics courses (and perhaps enroll in “easier” math courses to fulfill requirements), spend less time engaged with mathematics content (in and out of school), report more negative attitudes towards mathematics concepts, and ultimately perform worse on tests, further weakening their mathematics self-concept.
It is important to note that beside this self-fulfilling prophecy effect, environmental factors (e.g., parents, teachers, classmates) can have a large influence on students’ self-concepts as well as on academic achievement, which is not surprising, provided the reciprocal relationships (Arens et al., 2017; Kurtz-Costes & Schneider, 1994) between these two outcomes. That is, left alone, these feedback loops can exacerbate the academic gaps between students with relatively small differences in mathematics self-concept. However, parents, teachers, and classmates can play a large role in supporting (or not) positive mathematics self-concept. We now turn to two of these environmental factors in students’ lives—the dynamics of the classroom and the dynamics of the school.
Classroom learning environment
Classroom learning environment has been defined as “the social, psychological, and pedagogical contexts in which learning occurs and which affect student achievement and attitudes” (Fraser, 1998, p. 3). Classroom learning environment research has been conducted around the world to study a host of learning domains such as disciplinary attitudes, achievement, teacher practices, and program evaluation (see Lim & Fraser, 2018). Typically, although with some variations, learning environments are operationalized in terms of classroom climate, teacher support, and cognitive activation (Chionh & Fraser, 2009; Fast et al., 2010).
Both theoretical (Bourdieu, 1986) and empirical (e.g., Braun, 1976; Lucas et al., 1990) research identify positive classroom learning environments as essential for supporting students’ effective learning and their positive perceptions of themselves as learners. In a large-scale study of middle school students, without sub-analyses by language status, Fraser and Kahle (2007) found that although classroom, home, and peer environment significantly contributed to students’ attitudes toward mathematics and science, only classroom environment significantly predicted achievement. In a meta-analysis of 119 studies conducted across a range of educational settings but with no sub-analyses by language status, Cornelius-White (2007) found strong associations between classroom environments and student social and academic outcomes. Teacher-student relationships had the strongest associations with student outcomes. Analyses also indicated that classroom characteristics had positive association with both student social/behavioral outcomes such as self-beliefs (average r = 0.35) and cognitive/academic outcomes such as grades (average r = 0.31). Regarding academic outcomes, Cornelius-White (2007) found that the highest associations were with mathematics (r = 0.36) and verbal (r = 0.34) achievement.
Studies focused on mathematics (e.g., Lewis et al., 2012; Riconscente, 2014) also found that different aspects of classroom learning environments may impact student mathematics attitudes and achievement either directly or indirectly via self-beliefs and/or disciplinary attitudes. In a longitudinal study of 1163 upper elementary students, Fast et al. (2010) found that classroom environments perceived by students as more caring, challenging, and mastery-oriented were associated with higher levels of mathematics self-beliefs, which, in turn, predicted higher levels of mathematics performance. Mathematics-focused research also documented higher associations between classroom characteristics and student social/behavioral outcomes (self-beliefs, motivation, interest) than between classroom characteristics and academic outcomes (end-of-the-year grades, achievement; Fast et al., 2010). Riconscente (2014) found that classroom environments—in combination with student individual difference characteristics such as beginning-of-the-year self-beliefs—accounted for about 61% and 36% of the variance in students’ mathematics interest and self-beliefs, respectively, but only for about 24% of the variance in student end-of-the year grades.
Although limited and inconsistent (e.g., Hsieh et al., 2019), there is evidence to suggest that positive learning environments may have a greater impact on LM students’ perceptions of ability and achievement. In a study of 1119 secondary language majority and minority students, den Brok et al. (2010) found that classroom environment accounted for a substantial amount of the variance in student subject-related attitudes and achievement across comparison groups. The relationship with student academic achievement was only indirect among majority and second-generation LM students. Mediated by attitudes toward the subject studied, this relationship was direct among first-generation LM students. Interestingly, for this student population, attitudes toward the subject studied had no direct effect on academic achievement. Den Brok et al. attributed such greater reliance on the teacher—rather than on one’s own attitudes toward the subject—to plausibly fewer economic resources available to this group of students.
Similarly, Lewis et al.’s (2012) study found that a positive classroom learning environment bolstered can-do attitudes and achievement in mathematics; with this association being more pronounced among LM students. By contrast, Hsieh et al. (2019) found that although perceived support from teachers positively predicted disciplinary (science) self-concept and attitudes, LM (immigration) status was not significantly associated with student subject-specific motivation either initially, or in terms of changes over time. The generalizability of these findings to mathematics, especially to mathematics self-concept beliefs is yet to be investigated.
School climate
School climate has been broadly defined as school life experiences reflecting “norms, goals, values, interpersonal relationships, teaching and learning practices, and organizational structures” (National School Climate Council [NSCC], 2007, p. 5). Recognizing the potential that distinctive school cultures may affect the life and learning of students, research on school climate has seen an increase in systematic inquiry around the world (see Thapa et al., 2013). These studies have documented relationships between school climate and such outcomes as healthy relationships, engagement, and improved efforts. Schools with positive climates, in particular, were found to have lower rates of negative behaviors (e.g., suspensions), fewer student–teacher issues, and, most pertinent to our study, higher rates of socioemotional, behavioral, and academic adjustments (e.g., Shochet et al., 2006; Thapa et al., 2013).
While there is not a definitive consensus on the dimensions of school climate that are most important, there does seem to be a general agreement that the following four, interrelated facets matter: safety, teaching and learning, relationships, and the institutional environment (NSCC, no date; Thapa et al., 2013). We briefly discuss each facet below.
Safety
Maslow (1943) argued that a feeling of safety—mental, emotional, physical, and intellectual safety—is a basic human need that must be met in order for individuals to flourish. Safety is typically established through the supportive norms, rules, relationships, and structures of a school. In schools lacking these supportive structures, students are more likely to suffer “violence, peer victimization, and punitive disciplinary actions” (Thapa et al., 2013 p. 4). As a consequence, these schools also tend to have high levels of absenteeism and lower academic achievement (Astor et al., 2009). Unfortunately, although the adults associated with schools report perceiving these threats as “mild-to-moderately severe,” students tend to report them as “severe” (see Cohen, 2006). Presently, research on school safety has largely focused on school rules, structures, and bullying behaviors. While this work is important, the present study heightens the need to broaden the scope of this work to focus future research on LM students as well. The little research that exists on this student population, indicates that LM students may find themselves in less safe and supportive schools or may “perceive their schools to be less safe and supportive than their peers” (Sanders et al., 2018, p. 649; see Watkins & Melde, 2009). Importantly, while overall school climate measures are important to “take the temperature” of the school, they may not accurately capture the experiences of subgroups within the school.
Teaching and learning
At the heart of a student’s school experience is teaching and learning, one of the core facets of school climate. Schools with positive climates tend to promote teaching and learning characteristics, such as “cooperative learning, group cohesion, respect, and mutual trust,” that positively impact students’ learning environments (Thapa et al., 2013, p. 365; see Kerr et al., 2004). At all levels of schooling, research has shown that school climate is directly related to academic achievement. Though this is also true for LM students, there are particular characteristics of the school climate related to the learning environments that matter. In their examination of California schools successful in supporting Hispanic/Latino LM students, Lucas et al. (1990) found that these schools placed value on students' languages and cultures, placed high expectations on students, provided supports for teachers to specifically serve LM students more effectively and offered a variety of courses and programs to support LM students. In general, it seems the climate of teaching and learning at these schools supported teachers to meet students’ learning needs and see students’ LM status as an asset rather than a deficit.
Relationships
Another key facet of school climate is the relationships between various players in the school and the level of connection people feel toward one another (Thapa et al., 2013). Unsurprisingly, students who feel a greater sense of connection and belonging tend to exhibit fewer behavioral issues, more engagement, higher self-esteem, better grades, and less depressive symptoms (e.g., Gregory & Cornell, 2009; Jia et al., 2009). For students, some of the key relationships that impact their experiences are teacher-student and the student–student relationships. Research has shown, however, that different groups of students may perceive different relational aspects as more or less impactful. For example, Slaughter-Defoe and Carlson (1996) found that Hispanic/Latino students considered “teacher fairness, caring, praise of effort as well as the importance of moral order” (p. 60) as essential dimensions of school climate while their African American peers valued being listened to and teachers being available to comfort and help as most important. Again, not much research has explored the specific school relational-experiences of LM students. However, based on existing literature (e.g., Lucas et al., 1990), when the school staff (at all levels) are committed to empowering their LM students and take concrete actions (such as “taking extra time,” p. 325), LM students are more likely to achieve academic success.
Institutional environment
A final facet of school climate is the institutional environment, which includes both school connectedness, and the physical resources and structure of the school. School connectedness can be thought of as “the belief by students that adults and peers in the school care about their learning as well as about them as individuals” (Center for Disease Control and Prevention, 2009, p. 3). Like other facets of school climate, research has shown that when students experience a feeling of school connectedness or a sense of belonging, they have fewer behavior issues, engage in less risky behavior, and have better academic outcomes (e.g., Loukas et al., 2006; Ruus et al., 2007). The limited research on LM students does suggest that a sense of belonging, connection, and feeling welcomed at their schools is also important for this student population (Lucas et al., 1990).
Much like classroom climate, there are three main points that arise when reviewing the literature on school climate. First, the perceived school climate has important consequences for student’s physical and mental wellbeing and academic achievement and is theoretically expected to have impacts on students’ self-concepts as well (Arens et al., 2017; Kurtz-Costes & Schneider, 1994). Second, while commonalities exist, there are still important group differences which need to be better understood so that teachers and schools can support all students. Finally, for LM students in particular, there is little research about how their needs may differ from the general population. As numbers of LM students increase, there is urgency to better understand the unique impact of factors like classroom climate and school climate for this important student population.
It is noteworthy that in the present study, we have not considered the social-economic status (SES) of the participants in our analyses. This decision has been made for the following reasons. When creating the composite variable of SES—referred to as economic, social and cultural status (ESCS) in the PISA datasets—PISA integrates indicators of parents’ educational background, family wealth, and home educational resources and possessions (OECD, 2013). However, Hauser, (1994) and Sirin, (2005) argued that combining these factors when measuring SES is problematic as this traditional understanding of SES has not always been strongly associated with educational outcomes across students from different backgrounds (Thomson, 2018). For example, highly educated immigrants may not reach the same levels of wealth as non-immigrants at the same level of education.
The present study
Overall, limited work has focused on LM students, especially in STEM, and examined the relative contributions of both the classroom and school learning environments to their academic achievement and self-concept. This is unfortunate, provided that “the environment of schooling extends beyond the classroom to hallways and after-school activities of students” (Carhill et al., 2008, p. 1160) to impact students’ behavioral, socioemotional, and academic outcomes. Hence, we sought to investigate the following research questions:
-
1.
What are the contributions of the classroom learning environment and school climate to students’ mathematics self-concept?
-
2.
What are the contributions of the classroom learning environment and school climate to students’ mathematics self-concept when disaggregated by home language?
-
3.
What are the contributions of the classroom learning environment and school climate to students’ mathematics achievement?
-
4.
What are the contributions of the classroom learning environment and school climate on students’ mathematics achievement when disaggregated by home language?
Methods
This study used the 2012 PISA data on U.S. students and employed separate hierarchical linear regression models on the combined sample (all students) and on the subsamples disaggregated by home language status (to allow for main analyses of interest).
Participants
The sampling strategy of PISA 2012 administration consisted of six main phases: (a) defining the age of students to be surveyed; (b) creating a list of schools in which eligible students are enrolled; (c) selecting school sample from the list; (d) developing a list of eligible students in terms of age; and (e) selecting student sample from the list (OECD, 2014).
The current study focuses on the 4978 U.S. students who participated (number of students per analysis may vary, per administration). Almost 86% of participants indicated that English was the primary language spoken at home; 14% reported their primary language spoken at home as Spanish or Other languages. Approximately 49% of the participants self-reported their gender as female.
Data sources: PISA scales
Mathematics served as the major domain of PISA 2012 cycle, which also collected a wide range of student-, teacher- and school-level variables specific to mathematics (OECD, 2013). We used seven student-reported independent variables in our study (all measured on a 4-point Likert scale, with anchors ranging from strongly disagree to strongly agree or from never/hardly ever to every lesson, or from rarely to always) and two dependent variables (see below). Given that PISA utilized item response theory as a scaling method for the variables of interest listed below, the means and standard deviations represent the means and standard deviations after the scaling procedures (OECD, 2014).
Independent variables
Perceived prior mathematics classroom learning environment
-
1)
Mathematics teacher’s classroom management (M = 0.197, SD = 1.002, a = 0.75). This scale included 4 items measuring classroom management (sample item: Thinking about the mathematics teacher who taught your last mathematics class: “My teacher keeps the class orderly”). Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4.”
-
2)
Mathematics teacher’s support (M = 0.254, SD = 1.055, a = 0.84). This scale included 4 items measuring mathematics teacher support (sample item: Thinking about the mathematics teacher who taught your last mathematics class: “My teacher provides extra help when needed”). Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4.”
-
3)
Cognitive activation in mathematics lessons (M = 0.388, SD = 1.122, a = 0.87). This scale included 9 items measuring cognitive activation in mathematics lessons (sample item: Thinking about the mathematics teacher who taught your last mathematics class: “The teacher asks questions that make us reflect on the problem”). Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4.”
Perceived current mathematics classroom learning environment
-
4)
Disciplinary climate (M = 0.049, SD = 0.999, a = 0.89). This scale included 5 items measuring disciplinary climate (sample item: How often to these things happen in your mathematics lessons?: “There is noise and disorder”). Four response categories ranged from “every lesson = 1”, “most lessons = 2”, “some lessons = 3”, to “never or hardly ever = 4.”
-
5)
Teacher support (M = 0.163, SD = 0.973, a = 0.87). This scale included 5 items measuring teacher support (sample item: How often to these things happen in your mathematics lessons?: “The teacher gives extra help when students need it”). Four response categories ranged from “every lesson = 1”, “most lessons = 2”, “some lessons = 3”, to “never or hardly ever = 4.”
Perceived school climate
-
6)
Sense of Belonging to School (M = -0.056, SD = 1.001, a = 0.32). This scale included 9 items measuring sense of belonging to school (sample item: “I feel happy at school”). Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4.” Because sense of belonging to school significantly correlated with all other variables of interest in the present study, a decision was made to include it in the analyses despite relatively low reliability. This decision was grounded in previous empirical studies (i.e., Jeremie, 2017; Stankov et al., 2017). Further, higher Cronbach’s alpha does not always reflect higher degree of internal consistency as it can be influenced by other factors such as the length of a test (Tavakol & Dennick, 2011).
-
7)
Teacher Student Relations (M = 0.179, SD = 0.973, a = 0.83). This scale included 5 items measuring student–teacher relations outside of mathematics classrooms (sample item: “Students get along well with most teachers”). Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4”.
Please see Appendix C for a full list of items for each scale.
Dependent variables
-
1)
Mathematics self-concept (M = 0.303, SD = 1.004, a = 0.90). This scale comprised 5 items measuring mathematics self-concept. Sample items include “I learn mathematics quickly” and “I get good grades in mathematics.” Four response categories ranged from “strongly agree = 1” to “strongly disagree = 4”.
-
2)
Mathematics achievement (M = 481.694, SD = 86.683, a = 0.99). This scale included 5 plausible values (OECD, 2013) items gauging students’ mathematical literacy. Examples of mathematical literacy domains tested included, formulating situations mathematically; employing mathematical concepts, facts, procedures and reasoning; interpreting, applying and evaluating mathematical outcomes; space; shape, change and relationships; quantity and uncertainty and data. Appendix B provides descriptive statistics (e.g., means, standard deviation, skewness, kurtosis). Since PISA assessments cannot measure all mathematics outcomes of all students (due to time and student fatigue constraints), missing data occurred in achievement scores by design (different assessment booklets given to different students). Therefore, PISA employed an imputation strategy in the achievement scores to generate plausible variables. In other words, plausible variables refer to those achievement scores which were obtained via imputations based on existing scores (OECD, 2014).
Data analyses
Before running our analyses, we used the International Database Analyzer (IDB Analyzer) to extract the relevant data as well as to generate SPSS codes/syntax to run all statistical analyses. The IDB Analyzer is a windows-based software application created by the IEA Data Processing and Research Center (IEA-DPC). IDB Analyzer creates SAS code or SPSS syntax allowing users to work with (inter)national large-scale assessments such as PISA. The analyzer makes use of replicate weights, in addition to the sample weights, in the PISA dataset to adjust standard errors to account for the clustered sample design and allows for performing statistical analyses with plausible values (IEA, 2016; OECD, 2009a, 2009b).Once extracted, the data were screened to ensure all statistical assumptions were met. Please see Appendix A for more details.
Missing data
Although they are not classified as missing data, plausible values for mathematics achievement scores have been imputed by PISA and are provided for the public use. Plausible values can be defined as “random values from the posterior distributions” for the achievement scores which occur due to the design of PISA. That is, PISA utilizes a design wherein not all participants take the same set of questions for the mathematics achievement scores (also see the description of dependent variables above) (). That is, these imputed scores are by design (students did not have the opportunity to answer), which is in contrast to the truly missing data for the predictor variables. To handle the missing data that occur in the predictor variables, we applied a listwise deletion method, which allowed us to use all complete cases. Listwise deletion typically removes the cases with one or more missing values, and it subsequently provides all complete cases to conduct statistical analyses. Listwise deletion is one of the most common missing data handling methods (Briggs et al., 2003; Peugh & Enders, 2004). It also has an advantage to be used with any kind of statistical analysis (Nakai & Ke, 2011). Several studies in which PISA 2012 data was used have been conducted using only complete cases within the predictor variables (e.g., Caro et al., 2016; Salas-Velasco & Sánchez-Campillo, 2018).
Analysis
For both dependent variables, separate 3-step hierarchical linear regression models were run on the combined sample (to establish baseline) and on the subsamples desegregated by home language status (to allow for main analyses of interest). This approach helps explain the unique variance of predictors entered into the model in order of their theoretical/hypothesized importance through significant improvements in R2 (Cohen, 2014). The order of variable entry into models was as follows: perceived prior mathematics classroom learning environment (mathematics teacher’s classroom management, mathematics teacher’s support, and cognitive activation in mathematics lessons), perceived current mathematics classroom learning environment (disciplinary climate, teacher support), and finally school-related factors (sense of belonging to school, teacher student relations).
Results
Research question 1
Table 1 summarizes the results of the school and classroom climate contributions to mathematics self-concept in three steps. These included, perceived prior mathematics classroom learning environment (Step 1), perceived current mathematics classroom learning environment (Step 2), and perceived school climate (Step 3) factors. Results indicated that, except for mathematics teacher’s support, all classroom- and school-related climate variables were significant predictors across all models.
The combined baseline results in Step 1, which consists of perceived prior mathematics classroom learning environment variables, indicated that mathematics teacher’s classroom management, mathematics teacher’s support, and cognitive activation in mathematics lessons explained 7.4% of the variance in student mathematics self-concept scores (R2 = 0.074, p < 0.001, f2 = 0.080), suggesting a small effect size (Cohen, 1988). When disciplinary climate and teacher support representing perceived current mathematics classroom learning environment variables were added in Step 2, the model explained 2.4% additional variance in self-concept scores (ΔR2 = 0.024, p < 0.001, f2 = 0.027), indicating a small effect size. When perceived school climate factors including sense of belonging to school and teacher student relations were entered in Step 3, the model explained an additional 1.3% of the variance in student mathematics self-concept scores (ΔR2 = 0.013, p < 0.001, f2 = 0.015), suggesting a small effect size (Cohen, 1988).
In the final model and considering relative (standardized) contributions, teacher support, a classroom-related predictor, was the strongest statistically significant contributor to mathematics self-concept (β = 0.121, p < 0.001), whereas sense of belonging to school, a school-related predictor, was the weakest contributor (β = 0.064, p < 0.01). Mathematics teacher’s support (p = 0.306) was the only non-significant predictor of mathematics self-concept in the combined sample.
Research question 2
Table 2 reports self-concept results disaggregated by language at home. In the baseline Step 1 model, mathematics teacher’s classroom management, mathematics teacher’s support and cognitive activation in mathematics lessons explained 7.7% of the variance in student mathematics self-concept scores for the English-at-home group with a small effect size (R2 = 0.077, p < 0.001, f2 = 0.083) and 5.2% of the variance for the other-language-at-home group (R2 = 0.052, p < 0.001, f2 = 0.054), suggesting a small effect size (Cohen, 1988).
In Step 2, when disciplinary climate and teacher support were entered, the model explained 2.4% additional variance in student mathematics self-concept scores (ΔR2 = 0.024, p < 0.001, f2 = 0.026) for the English-at-home group and 3.9% of additional variance for other-language-at-home group (ΔR2 = 0.039, p < 0.001, f2 = 0.043) suggesting small effect sizes for both groups (Cohen, 1988).
In Step 3, when sense of belonging to school and teacher student relations were added, 1.1% of additional variance were explained for the English-at-home group (ΔR2 = 0.011, p < 0.001, f2 = 0.012) and 2.6% of additional variance for the other-language-at-home group (ΔR2 = 0.026, p < 0.001, f2 = 0.029) indicating small effect sizes for both groups (Cohen, 1988).
In the final model, teacher support was the strongest significant contributor to mathematics self-concept for the English-at-home group (β = 0.130, p < 0.001); the relative contributions of the remaining school and classroom variables were about the same (β range: 0.065–0.092), except for mathematics teacher’s support which, similar to the combined sample, was the only non-statistically significant predictor of self-concept for this group (p = 0.270). For the other-language-at-home group, only disciplinary climate, β = 0.183, p < 0.001, CI 95% [0.085, 0.281], and teacher student relations, β = 0.142, p < 0.01, CI 95% [0.022, 0.262], significantly predicted student mathematics self-concept. Statistically, these contributions were the same for the English-at-home group as indicated by the overlapping confidence intervals for disciplinary climate, β = 0.075, p < 0.001, CI 95% [0.026, 0.124], and teacher student relations, β = 0.067, p < 0.01, CI 95% [0.008, 0.126], effects.
Research question 3
Table 3 provides a summary of the results of the perceived school and classroom climate contributions to mathematics achievement in three steps. The baseline results in Step 1 indicate that mathematics teacher’s classroom management, mathematics teacher’s support and cognitive activation in mathematics lessons explained 4.9% of the variance in student mathematics achievement (R2 = 0.049, p < 0.001, f2 = 0.029), suggesting a small effect size (Cohen, 1988). When disciplinary climate and teacher support were entered in Step 2, the model explained an additional 4.5% of the variance in mathematics achievement (ΔR2 = 0.045, p < 0.001, f2 = 0.050) with a small effect size (Cohen, 1988). When sense of belonging to school and teacher student relations were added to the model in Step 3, the model explained an additional 0.8% of the variance in mathematics achievement (ΔR2 = 0.008, p < 0.001, f2 = 0.009), indicating a small effect size (Cohen, 1988).
Except for cognitive activation in mathematics lessons, prior mathematics classroom experiences variables remained statistically significant across models. Among overall mathematics classroom experiences variables, only disciplinary climate was a statistically significant predictor in Models 2 and 3. Similarly, among school-related climate variables, only teacher student relations was a statistically significant predictor in Model 3. In the final model and considering relative contributions, disciplinary climate, and mathematics teacher’s classroom management, both classroom-related variables, were the strongest significant contributors to mathematics achievement (β = 0.230 and β = 0.117, respectively, p < 0.001) immediately followed by teacher student relations, a school-related predictor (β = 0.103, p < 0.001). Cognitive activation in mathematics lessons, teacher support, and sense of belonging to school were not statistically significant contributors to mathematics achievement in the final, combined sample model.
Research question 4 Footnote 1
Table 4 summarizes mathematics achievement results desegregated by language at home. In the baseline model, mathematics teacher’s classroom management, mathematics teacher’s support and cognitive activation in mathematics lessons explained 4.4% of the variance in student mathematics achievement for the English-at-home group (R2 = 0.044, p < 0.001, f2 = 0.046) and 9.5% of the variance for the other-language-at-home group (R2 = 0.095, p < 0.01, f2 = 0.105), suggesting small effect sizes for both groups (Cohen, 1988). The Step 2 including disciplinary climate and teacher support explained an additional 5% of the variance in student mathematics achievement for the English-at-home group (ΔR2 = 0.050, p < 0.001, f2 = 0.055) and 3.7% for other-language-at-home group (ΔR2 = 0.037, p < 0.001, f2 = 0.043) with small effect sizes for both groups (Cohen, 1988). School-related predictors explained 0.6% additional variance for the English-at-home group (ΔR2 = 0.006, p < 0.001, f2 = 0.009) and 1.1% for other-language-at-home group (ΔR2 = 0.011, p < 0.001, f2 = 0.013), indicating small effect sizes for both groups (Cohen, 1988).
In the final model and unlike for the combined sample, teacher support and cognitive activation in mathematics lessons were the only statistically nonsignificant predictors of mathematics achievement for the English-at-home group. The relative contributions of other predictors closely mirrored those of the combined model: Disciplinary climate and mathematics teacher’s classroom management, both classroom-related variables, were the strongest significant contributors to mathematics achievement (β = 0.232 and β = 0.105, respectively, p < 0.001) immediately followed by teacher student relations, a school-related predictor (β = 0.110, p < 0.001).
Similar to the English-at-home group, disciplinary climate and mathematics teacher’s classroom management were the closely strongest contributors to mathematics achievement for the other-language-at-home group (respectively, β = 0.228, CI 95% [0.157, 0.299] and β = 0.174, CI 95% [0.047, 0.301], p < 0.001). Statistically, these contributions were the same for the English-at-home group as indicated by the overlapping confidence intervals for disciplinary climate, β = 0.232, p < 0.001, CI 95% [0.177, 0.287], and mathematics teacher’s classroom management, β = 0.105, p < 0.001, CI 95% [0.046, 0.164], effects. Unlike for the English-at-home group, teacher support was a significant and negative predictor of achievement for the other-language-at-home group (β = − 0.108, p < 0.05) and neither of the two school-related predictors were statistically significant.
Discussion
Ample evidence suggests that student socioemotional, behavioral, and academic adjustments are influenced by school-related contextual variables such as school climate (e.g., Arens et al., 2017; Thapa et al., 2013). In recent decades, teacher-related contextual variables also received heightened attention fueled by teacher quality and merit-based compensation and promotion for teachers (see Riconscente, 2014). At the same time, as evidence suggests that teacher and school quality are particularly critical when students are at risk (Ardasheva et al., 2012; Riconscente, 2014), research on factors affecting LM students’ learning experiences, especially in STEM, is still only emergent (de Araujo et al., 2018; Sandilos et al., 2020). This is especially the case when it comes to simultaneously examining influences of both teacher- and school-related contextual variables. Contributing to filling this gap, our study investigated relative contributions of perceived classroom environment and school climate variables to mathematics self-concept and achievement of English-at-home and LM students using 2012 PISA USA data.
Although there have been studies that examined the relationship between mathematics achievement and mathematics self-concept (see a meta-analysis by Luo et al., 2014; Möller et al., 2020; Sewasew et al., 2018), there have also been studies examining those two variables separately (e.g., Lindberg et al., 2013; Luo et al., 2014; Sewasew et al., 2018; Trautwein et al., 2006). We chose to follow the second line of investigation because in the present study we were interested in exploring contributors to mathematics achievement and mathematics self-concept for LM vs. English-speaking majority students, rather than in the relationship between mathematics achievement and self-concept.
Implications for theory and research
From a theoretical perspective, this study contributes to a limited body of work focusing on understanding factors that may shape LM students’ mathematical self-concept and achievement.
With respect to students’ mathematics self-concept, the final model for English-at-home students closely mirrors the final model for the combined student sample: the same six factors are significant, positive predictors of mathematics self-concept for both the combined and the English-at-home sample. In contrast, for LM students, only two of these factors—perceived disciplinary climate and teacher-student relationships, a classroom- and a school-related factor, respectively—appeared important for mathematics self-concept. In other words, congruent with other research (Maltese & Tai, 2011), the mathematics self-concept of all students is supported by safe, organized mathematics classroom environments and a school climate in which students perceive teachers to like students and treat them fairly.
Similar to self-concept results, the final models for the aggregated and disaggregated samples indicate that disciplinary climate is an important predictor of mathematics achievement. In addition, in all three mathematics achievement final models, the perceived classroom climate in last mathematics classroom was a significant predictor of student achievement. This factor was a weaker predictor for English-at-home students (ß = 0.105) as compared to for LM students (ß = 0.174). One possible explanation for this difference in strength may be that LM populations can be more vulnerable. In particular, the ways in which teachers may stereotype and treat LM students in their classrooms may set both a precedent for other students and a tone that can negatively impact LM students' learning (Appel et al., 2015).
There are some surprising negative predictors across mathematics achievement models. For LM students in particular, perceived teacher support was a negative predictor of achievement, suggesting that when students perceived their teachers’ as offering more support, the students had lower mathematics scores. It could be that although LM students are receiving some support, the type of support may not have been targeted to meet their learning needs (de Araujo et al., 2018). Indeed, this would align with research suggesting that teachers are generally underprepared to meet the needs of their diverse learners, particularly LM students (e.g., Okhremtchouk & Sellu, 2019). Because, similar to English-at-home students, LM students are not a heterogeneous group, this finding needs further investigation. In particular, large-scale assessments such as PISA need to make efforts to cast a larger net in sampling LM students and collecting more variables regarding their home and school language proficiency to allow for more nuanced analyses by proficiency subgroups (Sandilos et al., 2020). For English-at-home students, the negative contribution of sense of belonging to school to mathematics achievement was also unexpected. Possible explanations of this finding may be the conflation of student perceptions of school belonging with that of positive relationships with peers, who may sometimes negatively influence academic motivation (Goodenow & Grady, 1993) or a possibility of a mediated relationship among students’ perceptions of the school climate, their sense of school belonging, and their achievement (see Maxwell et al., 2017). Future studies exploring these relationships may also consider the extent to which schools emphasize academics to more fully understand the role school belonging may play in achievement of both English-at-home and LM students.
Consistently, perceived classroom disciplinary climate, a classroom-related variable, was an important predictor across outcomes and student populations and it was most impactful for LM students. This classroom-related variable was captured by items gauging high-to-low frequency (from ‘every lesson’ to ‘never or hardly ever’) of such problematic classroom events as noise/disorder, students’ inability to focus on work, loss of instructional time. Our finding linking classroom environments perceived as safer and more organized with higher mathematics self-concept and achievement across student populations is consistent with Maslow’s (1943) theory. The theory holds that the feeling of physical, emotional, mental, and intellectual safety—with physical and emotional safety, arguably, being foundational for other safety types—is a basic human need that must be met in order for individuals to flourish. In a classroom, students need to feel that they are safe, and this safety is typically established through supportive norms, rules, relationships, and structures. In environments lacking these supportive structures, students are more likely to experience victimization, violence, and disciplinary punishments, often associated with higher levels of absenteeism and lower academic achievement (Astor et al., 2009; Thapa et al., 2013).
Perceived relationships with other school teachers, a school-related variable, was also an important contributor to mathematics self-concept of both English-at-home and LM students; however, its contribution to mathematics achievement was statistically significant only for English-at-home students. This finding, as well as the finding that perceived teacher support (a classroom-related variable) were positive contributors to English-at-home students’ mathematics self-concept and achievement, is consistent with empirical evidence suggesting that fostering positive student–teacher (or staff) relationships is associated with students’ socioemotional, behavioral, and academic adjustment and with higher academic engagement and achievement (Anderson et al., 2004; Murray & Malmgren, 2005). Indeed, students’ feelings of greater connections have been found to be associated with a host of positive learning outcomes, including higher perceptions of ability and better grades (e.g., Jia et al., 2009; Thapa et al., 2013).
However, research also has shown that the specific aspects of relationships students perceive as more impactful may differ for learners of different backgrounds. For example, Schneider and Duran (2010) found that middle school Hispanic/Latino LM students “considered personal relationships with teachers as more important than modeling of positive behaviors—contrasting with the preference of White and Asian students” (Thapa et al., 2013, p. 364). Notably, differences in student backgrounds are also known to impact teacher perspectives of student–teacher relationships. In a meta-analysis on this topic, Nurmi (2012), for example, found that teachers reported better relationships with their students exhibiting higher levels of engagement and motivation. In turn, research suggests that LM students may be perceived as less motivated and less capable (Datnow et al., 2005; Gage, 2017) due to their not sharing the same values as their teachers. Datnow and colleagues (2003, 2005) concluded that cultural stereotyping was a major hindrance in improving academic achievement for LM students as teachers in their educational-reform-focused work perceived LM students as lacking abilities and skills, linking such perceptions to students’ cultural backgrounds rather than to effort. This body of work may provide an alternative explanation as to why teacher support may be a negative predictor of LM students’ mathematics achievement, as, teachers showing “interest in every student’s learning” or continuing teaching “until the students understand” (example teacher support items) may come from a different set of assumptions, expectations, and instructional approaches for LM students, which may interfere with LM students’ academic persistence and performance (Zurawsky & Gordon, 2004).
Small amounts of variance explained across models, suggests that future studies need to explore additional classroom and school climate characteristics not explored in the present study (Cornelius-White, 2007; NSCC, 2007), while also considering other-than-language-at-home individual differences (e.g., Arens et al., 2017; Lauermann et al., 2020).
Implications for policy and practice
The results of this study suggested that, for all students and LM students in particular, classroom climate is impactful on both mathematics self-concept and mathematics achievement. As mentioned earlier in the discussion, a prerequisite for student learning is a physically and intellectually safe environment. This strongly suggests that schools committed to their students need to consider ways to improve and support teachers in creating safe classrooms and supportive classroom management. Various interventions such as professional development or peer-teacher mentorships could be utilized to help teachers develop better classroom management. Additionally, schools can give consideration to how veteran versus novice teachers are assigned to classes since veterans tend to have better classroom management.
Though according to our findings LM students will also benefit from better classroom management, there are still unique supports they need from their classroom and schools. These needs have implications again for the type of support and professional development mathematics teachers receive to meet the specific needs of these students. For example, research has shown that curricula that include multimodal learning opportunities better support LM students in learning mathematics (de Araujo et al., 2018). Teachers could be supported to either use this type of curricula or create tasks that provide space for multimodal communication. This type of instruction is even more impactful when it draws on students’ funds of knowledge by using culturally relevant and meaningful contexts and tasks (de Araujo et al., 2018). For culturally relevant pedagogy to work, however, it must be embraced “as a guiding ethos” (Aronson & Laughter, 2016, p. 198) both within the classroom and the school, centering LM student affirmation as a commitment that is individual and school-wide (Khalifa et al., 2016).
In their meta-analysis of studies focused on policies and practices supporting LM students in schools, de Araujo et al. (2018) argued that their findings brought to light the importance of building intellectual spaces for LM students. This is because participation in rich classroom communication about mathematics is not only possible for LM students, “but also vitally important for their development of mathematical understandings” (p. 907). For that aim, Araujo et al. argued, educators need to challenge their beliefs about LM students often rooted in deficit notions of speakers of other languages to trump ideologies inhibiting implementation of most optimal pedagogies for LM students. A potential venue to addressing this issue suggested by the meta-analysis is for educators and policy makers to be aware of harmful effects of social constraints (e.g., low expectations, power dynamics) and structural restraints (e.g., course placements and tracking/lack of access to gifted education; Barajas-López, 2014; Lauermann et al., 2020) undermining schooling experiences and learning of LM students to systematically identify and eliminate the causes of such inequities. An important component of this is for policy makers, educators, school personnel, and students to “work against the grain when they attempt to create democratic, long-term, and trusting relationships that challenge the institutionalized norm of alienation” (Barajas-López, 2014, p. 17).
Limitations
All studies have limitations, and this research is no different. First, there are likely a number of other variables (e.g., relationships with peers) that would increase the amount of variance predicted, and we encourage future studies to introduce other variables to the model. For example, as mentioned in Footnote 1 and as suggested by anonymous reviewers, we introduced such student-level control variables as PISA’s ESCS (a proxy for SES) as well as dummy variables for race/ethnicity and immigration status. The results aligned with Li et al. (2020), indicating that while SES variables do predict achievement, the connection between SES and self-concept, in particular, is more opaque.
Additionally, we want to acknowledge that while these variables do contribute to the overall predictive variance of the model, these measures may be interpreted as causing the reduced achievement, rather than reflecting a larger societal change. This relationship has been long substantiated (e.g., Korous et al., 2022; Liu et al., 2022) and has changed little across the nearly 50 years since the publication of the Coleman report (Coleman, 1966) nor across over 20 years of PISA data collection. However, there are a number of issues with SES, both as a construct (Andreoni et al., 2021) and as a predictor of outcomes, especially when it comes to comparing its impacts within individual students vs. across schools. The latter, in particular, seems to be more impactful than the former (that is, lower SES students who attend higher SES schools, on average, outperform higher SES students who attend lower SES schools, Fischer et al., 2016; Thomson, 2018).
However, our goal for the present investigation was not to evaluate the relative contributions of select predictors for both LM and non-LM students, but rather, to highlight that the predictors themselves may serve differential functions across groups. We believe this is an important distinction as while SES may predict achievement, teachers and administrators can often do little to influence individual or community SES. However, if our analysis reveals that inclusive classroom practices and safety (e.g., positive teacher-student relations) are stronger predictors for LM students, teachers and practitioners can choose to adopt and modify pedagogy to be more inclusive for all learners. Also, these results may highlight that while teachers are engaged in practices that work for most students (e.g., teacher support or sense of belonging to school), these practices may not be significant predictors of achievement for all students.
The second limitation is that the present study focused only on participant’s languages spoken at home, without considering the immigration status. However, since immigrants with the same backgrounds are culturally heterogeneous (e.g., Ladison-Billings, 2014; Niedenthal et al., 2018), future studies are encouraged to add the immigration status of the participants to the model. This is important as even though the primary language at home may not be English even after several generations in a country, the phenomenon of cultural syncretism may occur, plausibly resulting in different predictors of achievement and self-concept. Of interest to note to future studies considering immigration, most native English speakers who participated in PISA 2012 lived in the U.S. for at least two generations; most participating LM students, in turn, were first or second generations, suggesting that either students themselves, or their parents, or both were foreign-born (OECD, 2013).
Finally, the present study used large scale, self-reported data which prevent drawing causative conclusions. While the large-scale PISA data has advantages, future studies should also employ experimental or multi-wave designs which would allow for the inclusion of additional control variables or researcher-created scales (e.g., the use of instructional practices recommended for LM students in STEM education, such as translanguaging; Suárez, 2020), which may explain some of the variance in the achievement gap between LM and non-LM students. Of course, this is not an intervention study, so our goal here is simply to illustrate whether the relationships of interest are present, and if they are, future studies may create interventions to further expand on and potentially determine causal relationships. For a similar argument (although a dissimilar context), we look to Lombardi et al. (2016). In this experimental study, the authors presented pre-service teachers with either a refutation or expository text to determine how the intervention would influence their thinking processes. The authors found (among other things) that the intervention was effective in promoting learners to rely more on their critical thinking abilities, whereas those without the intervention relied more heavily on their prior knowledge.
Availability of data and materials
The datasets generated and/or analyzed during the current study are available in the PISA repository, https://www.oecd.org/pisa/pisaproducts/pisa2012database-downloadabledata.htm.
Notes
At the reviewer's request, we have replicated the analyses for the final models in the present study with the control background variables such as race/ethnicity, immigration status, and PISA’s economic, social and cultural status (ESCS). The results from these analyses did not substantially alter the present findings and are included as Supplemental Tables 1 and 2.
References
Aguirre, J. M., & Zavala, M. (2013). Making culturally responsive mathematics teaching explicit: a lesson analysis tool. Pedagogies: an International Journal, 8(2), 163–190. https://doi.org/10.1080/1554480X.2013.768518
Anderman, E. M., & Midgley, C. (1997). Changes in achievement goal orientations, perceived academic competence, and grades across the transition to middle− level schools. Contemporary Educational Psychology, 22(3), 269–298. https://doi.org/10.1006/ceps.1996.0926
Anderson, A. R., Christenson, S. L., Sinclair, M. F., & Lehr, C. A. (2004). Check & connect: The importance of relationships for promoting engagement with school. Journal of School Psychology, 42(2), 95–113. https://doi.org/10.1016/j.jsp.2004.01.002
Andreoni, J., Nikiforakis, N., & Stoop, J. (2021). Higher socioeconomic status does not predict decreased prosocial behavior in a field experiment. Nature Communications. https://doi.org/10.1038/s41467−021−24519−5
Appel, M., Weber, S., & Kronberger, N. (2015). The influence of stereotype threat on immigrants: Review and meta− analysis. Frontiers in Psychology, 6, 1–15. https://doi.org/10.3389/fpsyg.2015.00900
Ardasheva, Y., Tretter, T. R., & Kinny, M. (2012). English language learners and academic achievement: Revisiting the threshold hypothesis. Language Learning, 62(3), 769–812. https://doi.org/10.1111/j.1467-9922.2011.00652.x
Ardasheva, Y., Tong, S., & Tretter, T. R. (2012). Validating the English Language Learner Motivation Scale (ELLMS) to measure language learning motivational orientations among school-aged ELLs. Learning and Individual Differences, 22(4), 473–483. https://doi.org/10.1016/j.lindif.2012.03.001
Ardasheva, Y., & Tretter, T. R. (2013). Contributions of individual differences and contextual variables to reading achievement of English learners: An empirical investigation using hierarchical linear modeling. TESOL Quarterly, 47(2), 323–351. https://doi.org/10.1002/tesq.72
Arens, A. K., Marsh, H. W., Pekrun, R., Lichtenfeld, S., Murayama, K., & vom Hofe, R. (2017). Math self− concept, grades, and achievement test scores: Long− term reciprocal effects across five waves and three achievement tracks. Journal of Educational Psychology, 109(5), 621–634. https://doi.org/10.1037/edu0000163
Aronson, B., & Laughter, J. (2016). The theory and practice of culturally relevant education: A synthesis of research across content areas. Review of Educational Research, 86(1), 163–206. https://doi.org/10.3102/0034654315582066
Aronson, J., & Steele, C. M. (2005). Stereotypes and the fragility of academic competence, motivation, and self− concept. In A. J. Elliot & C. S. Dweck (Eds.), Handbook of competence and motivation (pp. 436–456). Guilford Publications.
Astor, R. A., Benbenisty, R., & Estrada, J. N. (2009). School violence and theoretically atypical schools: The principal’s centrality in orchestrating safe schools. American Educational Research Journal, 46, 423–461. https://doi.org/10.3102/0002831208329598
Barajas−López, F. (2014). Mexican immigrant students’ schooling experiences and the construction of disengagement in mathematics learning contexts. Journal of Latinos and Education, 13(1), 14–32. https://doi.org/10.1080/15348431.2013.800818
Bong, M., & Clark, R. E. (1999). Comparison between self− concept and self− efficacy in academic motivation research. Educational Psychologist, 34(3), 139–153. https://doi.org/10.1207/s15326985ep3403_1
Bong, M., & Skaalvik, E. M. (2003). Academic self− concept and self− efficacy: How different are they really? Educational Psychology Review, 15(1), 1–40. https://doi.org/10.1023/A:1021302408382
Bourdieu, P. (1986). The forms of capital. In J. G. Richardson (Ed.), Handbook of theory and research for the sociology of education (pp. 241–258). Westport: Greenwood press.
Braun, C. (1976). Teacher expectations: Sociopsychological dynamics. Review of Educational Research, 46, 185–213. https://doi.org/10.3102/00346543046002185
Briggs, A., Clark, T., Wolstenholme, J., & Clarke, P. (2003). Missing... presumed at random: cost-analysis of incomplete data. Health economics, 12(5), 377–392. https://doi.org/10.1002/hec.766
Bronfenbrenner, U. (1977). Toward an experimental ecology of human development. American Psychologist, 32(7), 513–531. https://doi.org/10.1037/0003−066X.32.7.513
Byrne, B. M., & Shavelson, R. J. (1986). On the structure of adolescent self− concept. Journal of Educational Psychology, 78(6), 474–481. https://doi.org/10.1037/0022−0663.78.6.474
Carhill, A., Suárez− Orozco, C., & Páez, M. (2008). Explaining English language proficiency among adolescent immigrant students. American Educational Research Journal, 45(4), 1155–1179. https://doi.org/10.3102/000283120450041155
Caro, D. H., Lenkeit, J., & Kyriakides, L. (2016). Teaching strategies and differential effectiveness across learning contexts: Evidence from PISA 2012. Studies in Educational Evaluation, 49, 30–41. https://doi.org/10.1016/j.stueduc.2016.03.005
Centers for Disease Control and Prevention. (2009). School connectedness: Strategies for increasing protective factors among youth. Retrieved from https://www.cdc.gov/healthyyouth/protective/pdf/connectedness.pdf
Chionh, Y. H., & Fraser, B. J. (2009). Classroom environment, achievement, attitudes and self-esteem in geography and mathematics in Singapore. International Research in Geographical and Environmental Education, 18(1), 29-44. https://doi.org/10.1080/10382040802591530
Cohen, B. H. (2014). Explaining psychological statistics (4th ed.). Hoboken: Wiley.
Cohen, J. E. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Abingdon: Lawrence Erlbaum Associates Inc. https://doi.org/10.4324/9780203771587
Cohen, J. (2006). Social, emotional, ethical and academic education: Creating a climate for learning, participation in democracy and well− being. Harvard Educational Review, 76(2), 201–237. https://doi.org/10.17763/haer.76.2.j44854x1524644vn
Coleman, J. S. (1966). Equality of educational opportunity. Washington, DC: Department of Health, Education, and Welfare, Office of Education. https://files.eric.ed.gov/fulltext/ED012275.pdf
Cornelius− White, J. (2007). Learner− centered teacher–student relationships are effective: A meta− analysis. Review of Educational Research, 77, 113–143. https://doi.org/10.3102/003465430298563
Crawford, B. F., Snyder, K. E., & Adelson, J. L. (2019). Exploring obstacles faced by gifted minority students through Bronfenbrenner’s bioecological systems theory. High Ability Studies, 31(1), 43–74. https://doi.org/10.1080/13598139.2019.1568231
Cvencek, D., Meltzoff, A. N., & Greenwald, A. G. (2011). Math–gender stereotypes in elementary school children. Child Development, 82(3), 766–779. https://doi.org/10.1111/j.1467−8624.2010.01529.x
Datnow, A., Stingfield, S., & Castello, M. (2005). School reform and the education of culturally and linguistically diverse students. In C. R. O’Donnell & L. A. Yamauchi (Eds.), Culture and context in human behavior change: Theory, research, and application (pp. 179–204). Peter Lang.
Dai, S., Hao, T., Ardasheva, Y., Ramazan, O., Danielson, R. W., & Austin, B. W. (2023). PISA reading achievement: Identifying predictors and examining model generalizability for multilingual students. Reading and Writing. 1–33. https://doi.org/10.1007/s11145-022-10357-
de Araujo, Z., Roberts, S. A., Willey, C., & Zahner, W. (2018). English learners in K–12 mathematics education: A review of the literature. Review of Educational Research, 88(6), 879–919. https://doi.org/10.3102/0034654318798093
den Brok, P., van Tartwijk, J., Wubbels, T., & Veldman, I. (2010). The differential effect of the teacher-student interpersonal relationship on student outcomes for students with different ethnic backgrounds. British Journal of Educational Psychology, 80(2), 199–221. https://doi.org/10.1348/000709909X465632
Dicke, T., Marsh, H. W., Parker, P. D., Pekrun, R., Guo, J., & Televantou, I. (2018). Effects of school− average achievement on individual self− concept and achievement: Unmasking phantom effects masquerading as true compositional effects. Journal of Educational Psychology, 110, 1112–1126. https://doi.org/10.1037/edu0000259
Engberg, M. E., & Wolniak, G. C. (2013). College student pathways to the STEM disciplines. Teachers College Record, 115(1), 1–27.
Farrant, B. M., & Zubrick, S. R. (2012). Early vocabulary development: The importance of joint attention and parent− child book reading. First Language, 32(3), 343–364. https://doi.org/10.1177/0142723711422626
Fast, L. A., Lewis, J. L., Bryant, M. J., Bocian, K. A., Cardullo, R. A., Rettig, M., & Hammond, K. A. (2010). Does math self− efficacy mediate the effect of the perceived classroom environment on standardized math test performance? Journal of Educational Psychology, 102(3), 729–740. https://doi.org/10.1037/a0018863
Fischer, C., Fishman, B., Levy, A. J., Eisenkraft, A., Dede, C., Lawrenz, F., Jia, Y., Kook, J. F., Frumin, K., & McCoy, A. (2016). When do students in Low− SES schools perform better− than− Expected on a high− stakes test? Analyzing school, teacher, teaching, and professional development characteristics. Urban Education, 55(8–9), 1280–1314. https://doi.org/10.1177/0042085916668953
Fraser, B. J. (1998). Classroom environment instruments: Development, validity and applications. Learning Environments Research, 1(1), 7–34. https://doi.org/10.1023/A:100993251
Fraser, B. J., & Kahle, J. B. (2007). Classroom, home and peer environment influences on student outcomes in science and mathematics: An analysis of systemic reform data. International Journal of Science Education, 29(15), 1891–1909. https://doi.org/10.1080/09500690601167178
Fulton, R. (2009). A case study of culturally responsive teaching in middle school mathematics. Electronic Theses and Dissertations. https://digitalcommons.du.edu/etd/217
Gage, J. B. (2017). Teachers’ first impression of students: Characteristics, expectations, and effects (Doctoral dissertation). ProQuest Dissertations & Theses database. (10688601). http://hdl.handle.net/10211.3/199477
Goodenow, C., & Grady, K. E. (1993). The relationship of school belonging and friends’ values to academic motivation among urban adolescent students. Journal of Experimental Education, 62(1), 60–71. https://doi.org/10.1080/00220973.1993.9943831
Goodwin, A. L. (2017). Who is in the classroom now? Teacher preparation and the education of immigrant children. Educational Studies, 53(5), 433–449. https://doi.org/10.1080/00131946.2016.1261028
Green, J., Liem, G. A. D., Martin, A. J., Colmar, S., Marsh, H. W., & McInerney, D. (2012). Academic motivation, self− concept, engagement, and performance in high school: Key processes from a longitudinal perspective. Journal of Adolescence, 35(5), 1111–1122. https://doi.org/10.1016/j.adolescence.2012.02.016
Gregory, A., & Cornell, D. (2009). “Tolerating” adolescent needs: Moving beyond zero tolerance policies in high school. Theory into Practice, 48(2), 106–113. https://doi.org/10.1080/0040584090277632
Han, F. (2019). Self− concept and achievement in math among Australian primary students: Gender and culture issues. Frontiers in Psychology, 10, 1–9. https://doi.org/10.3389/fpsyg.2019.00603
Hansen, M., & Quintero, D. (2019). The diversity gap for public school teachers is actually growing across generations. Retrieved from https://www.brookings.edu/blog/brown-center-chalkboard/2019/03/07/the-diversity-gap-for-public-school-teachers-is-actually-growing-across-generations/
Hauser, R. M. (1994). Measuring socioeconomic status in studies of child development. Child Development, 65(6), 1541. https://doi.org/10.2307/1131279
Hsieh, T. −Y., Liu, Y., & Simpkins, S. D. (2019). Changes in United States Latino/a high school students’ science motivational beliefs: Within group differences across science subjects, gender, immigrant status, and perceived support. Frontiers in Psychology, 10(380), 1–12. https://doi.org/10.3389/fpsyg.2019.00380
Hussar, B., Zhang, J., Hein, S., Wang, K., Roberts, A., Cui, J., Smith, M., Bullock Mann, F., Barmer, A., & Dilig, R. (2020). The condition of education 2020 (NCES 2020-144). Washington DC: U.S. Department of Education. https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2020144
IEA. (2016). Help Manual for the IDB Analyzer. Hamburg, Germany. Retrieved from the IEA Data Processing and Research Center (IEA-DPC). https://www.iea.nl/data
Jeremie, J. N. (2017). Contrasting student perceptions on perseverance and student engagement in the United States, Germany, and South Korea (10741787) [Doctoral dissertation]. ProQuest Dissertations and Theses Global.
Jia, Y., Way, N., Ling, G., Yoshikawa, H., Chen, X., Hughes, D., & Lu, Z. (2009). The influence of student perceptions of school climate on socioemotional and academic adjustment: A comparison of Chinese and American adolescents. Child Development, 80(5), 1514–1530. https://doi.org/10.1111/j.1467−8624.2009.01348.x
Kerr, D., Ireland, E., Lopes, J., Craig, R., & Cleaver, E. (2004). Citizenship education longitudinal study: Second annual report: First longitudinal study (RR531). Retrieved from https://core.ac.uk/download/pdf/4155186.pdf
Khalifa, M. A., Gooden, M. A., & Davis, J. E. (2016). Culturally responsive school leadership: A synthesis of the literature. Review of Educational Research, 86(4), 1272–1311. https://doi.org/10.3102/0034654316630383
King, E., & Butler, B. R. (2015). Who cares about diversity? A preliminary investigation of diversity exposure in teacher preparation programs. Multicultural Perspectives, 17(1), 46–52. https://doi.org/10.1080/15210960.2015.994436
Korous, K. M., Causadias, J. M., Bradley, R. H., Luthar, S. S., & Levy, R. (2022). A systematic overview of meta− analyses on socioeconomic status, cognitive ability, and achievement: The need to focus on specific pathways. Psychological Reports, 125(1), 55–97. https://doi.org/10.1177/0033294120984127
Kurtz− Costes, B. E., & Schneider, W. (1994). Self− concept, attributional beliefs, and school achievement: A longitudinal analysis. Contemporary Educational Psychology, 19(2), 199–216. https://doi.org/10.1006/ceps.1994.1017
Ladison− Billings, G. (2014). Culturally relevant pedagogy 2.0: A. K. A. the remix. Harvard Educational Review, 84(1), 74–84. https://doi.org/10.17763/haer.84.1.p2rj131485484751
Lauermann, F., Meißner, A., & Steinmayr, R. (2020). Relative importance of intelligence and ability self− concept in predicting test performance and school grades in the math and language arts domains. Journal of Educational Psychology, 112(2), 364–383. https://doi.org/10.1037/edu0000377
Lewis, J., Ream, R. K., Bocian, K. M., Cardullo, R. A., Hammond, K. A., & Fast, L. A. (2012). Con cariño: Teacher caring, math self− efficacy, and math achievement among Hispanic English learners. Teachers College Record, 114(7), 1–42.
Li, S., Xu, Q., & Xia, R. (2020). Relationship between SES and academic achievement of junior high school students in China: The mediating effect of self− concept. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2019.02513
Lim, C. T. D., & Fraser, B. J. (2018). Learning environments research in English classrooms. Learning Environments Research, 21(3), 433–449. https://doi.org/10.1007/s10984−018−9260−6
Lindberg, S., Linkersdörfer, J., Ehm, J. H., Hasselhorn, M., & Lonnemann, J. (2013). Gender differences in children's math self-concept in the first years of elementary school. Journal of Education and Learning, 2(3),1-8. https://doi.org/10.5539/jel.v2n3p1
Liu, J., Peng, P., Zhao, B., & Luo, L. (2022). Socioeconomic status and academic achievement in primary and secondary education: A meta− analytic review. Educational Psychology Review. https://doi.org/10.1007/s10648−022−09689−y
Lombardi, D., Danielson, R. W., & Young, N. (2016). A plausible connection: Models examining the relations between evaluation, plausibility, and the refutation text effect. Learning and Instruction, 44, 74–86. https://doi.org/10.1016/j.learninstruc.2016.03.003
Loukas, A., Suzuki, R., & Horton, K. D. (2006). Examining school connectedness as a mediator of school climate effects. Journal of Research on Adolescence, 16(3), 491–502. https://doi.org/10.1111/j.1532−7795.2006.00504.x
Lucas, T., Henze, R., & Donato, R. (1990). Promoting the success of Latino language− minority students: An exploratory study of six high schools. Harvard Educational Review, 60(3), 315–341. https://doi.org/10.17763/haer.60.3.0160105tt9kgkq51
Luo, W., Hogan, D., Tan, L. S., Kaur, B., Ng, P. T., & Chan, M. (2014). Self− construal and students’ math self− concept, anxiety and achievement: An examination of achievement goals as mediators. Asian Journal of Social Psychology, 17(3), 184–195. https://doi.org/10.1111/ajsp.12058
Marsh, H. W. (1986). Verbal and math self− concepts: An internal/External frame of reference model. American Educational Research Journal, 23(1), 129–149. https://doi.org/10.3102/00028312023001129
Marsh, H. W., Pekrun, R., Murayama, K., Arens, A. K., Parker, P. D., Guo, J., & Dicke, T. (2018). An integrated model of academic self− concept development: Academic self− concept, grades, test scores, and tracking over 6 years. Developmental Psychology, 54(2), 263–280. https://doi.org/10.1037/dev0000393
Marsh, H. W., & Shavelson, R. (1985). Self− concept: Its multifaceted, hierarchical structure. Educational Psychologist, 20(3), 107–123. https://doi.org/10.1207/s15326985ep2003_1
Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50(4), 370–396. https://doi.org/10.1037/h0054346
Maxwell, S., Reynolds, K. J., Lee, E., Subasic, E., & Bromhead, D. (2017). The impact of school climate and school identification on academic achievement: Multilevel modeling with student and teacher data. Frontiers in Psychology, 8, 1–21. https://doi.org/10.3389/fpsyg.2017.02069
Maltese, A. V., & Tai, R. H. (2011). Pipeline persistence: Examining the association of educational experiences with earned degrees in STEM among U. S. Students. Science Education, 95(5), 877–907. https://doi.org/10.1002/sce.20441
Melguizo, T., & Wolniak, G. C. (2012). The earnings benefits of majoring in STEM fields among high achieving minority students. Research in Higher Education, 53(4), 383–405. https://doi.org/10.1007/s11162−011−9238−z
Möller, J., Zitzmann, S., Helm, F., Machts, N., & Wolff, F. (2020). A meta− analysis of relations between achievement and self− concept. Review of Educational Research, 90(3), 376–419. https://doi.org/10.3102/0034654320919354
Murray, C., & Malmgren, K. (2005). Implementing a teacher–student relationship program in a high− poverty urban school: Effects on social, emotional, and academic adjustment and lessons learned. Journal of School Psychology, 43(2), 137–152. https://doi.org/10.1016/j.jsp.2005.01.003
Nakai, M., & Ke, W. (2011). Review of the methods for handling missing data in longitudinal data analysis. International Journal of Mathematical Analysis, 5(1), 1–13.
National School Climate Council [NSCC]. (2007). The school climate challenge: Narrowing the gap between school climate research and school climate policy, practice guidelines and teacher education policy. Retrieved from National School Climate Council. https://www.schoolclimate.org/themes/schoolclimate/assets/pdf/policy/school−climate−challenge−web.pdf
National School Climate Center [NSCC]. (no date). What is school climate and why is it important? Retrieved from https://www.schoolclimate.org/school-climate
NCES. (2020, September). Race and ethnicity of public school teachers and their students. National Center for Education Statistics (NCES), a part of the U.S. Department of Education. https://nces.ed.gov/pubs2020/2020103/index.asp
Niedenthal, P. M., Rychlowska, M., Wood, A., & Zhao, F. (2018). Heterogeneity of long− history migration predicts smiling, Laughter and positive emotion across the globe and within the United States. PLoS ONE, 13(8), e0197651. https://doi.org/10.1371/journal.pone.0197651
Nurmi, J. E. (2012). Students’ characteristics and teacher–child relationships in instruction: A meta− analysis. Educational Research Review, 7(3), 177–197. https://doi.org/10.1016/j.edurev.2012.03.001
OECD. (2009a). PISA 2009 assessment framework—Key competencies in reading, mathematics and science. Paris: OECD Publishing. https://doi.org/10.1787/9789264062658−en
OECD. (2009b). PISA data analysis manual. Paris: OECD Publishing. https://doi.org/10.1787/9789264056275−en
OECD. (2013). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. Paris: OECD Publishing. https://doi.org/10.1787/9789264190511−en
OECD. (2014). PISA 2012 technical report. Paris, France: OECD Publishing.
Okhremtchouk, I. S., & Sellu, G. S. (2019). Teacher readiness to work with English language learners: Arizona context. The Teacher Educator, 54(2), 125–144. https://doi.org/10.1080/08878730.2018.1533058
Pajares, F., & Schunk, D. (2001). Self− beliefs and school success: Self− efficacy, self− concept, and school achievement. In R. J. Riding & S. G. Rayner (Eds.), International perspectives on individual differences: Self− perception Westport. Westport: Ablex Publishing.
Peugh, J. L., & Enders, C. K. (2004). Missing data in educational research: A review of reporting practices and suggestions for improvement. Review of Educational Research, 74(4), 525–556. https://doi.org/10.3102/00346543074004525
Polikoff, M., Le, Q. T., Danielson, R. W., Sinatra, G. M., & Marsh, J. A. (2018). The impact of speedometry on student knowledge, interest, and emotions. Journal of Research on Educational Effectiveness, 11(2), 217–239. https://doi.org/10.1080/19345747.2017.1390025
Riconscente, M. M. (2014). Effects of perceived teacher practices on Latino high school students’ interest, self-efficacy, and achievement in mathematics. Journal of Experimental Education, 82(1), 51–73. https://doi.org/10.1080/00220973.2013.813358
Ruus, V., Veisson, M., Leino, M., Ots, L., Pallas, L., Sarv, E., & Veisson, A. (2007). Students’ well− being, coping, academic success, and school climate. Social Behavior & Personality: An International Journal, 35(7), 919–936. https://doi.org/10.2224/sbp.2007.35.7.919
Salas− Velasco, M., & Sánchez− Campillo, J. (2018). The knowledge and skills that are essential to make financial decisions: First results from PISA 2012. FinanzArchiv, 74(3), 293. https://doi.org/10.1628/fa−2018−0009
Sanders, S. M., Durbin, J. M., Anderson, B. G., Fogarty, L. M., Giraldo− Garcia, R. J., & Voight, A. (2018). Does a rising school climate lift all boats? Differential associations of perceived climate and achievement for students with disabilities and limited English proficiency. School Psychology International, 39(6), 646–662. https://doi.org/10.1177/0143034318810319
Sandilos, L. E., Baroody, A. E., Rimm− Kaufman, S. E., & Merritt, E. G. (2020). English learners’ achievement in mathematics and science: Examining the role of self− efficacy. Journal of School Psychology, 79, 1–15. https://doi.org/10.1016/j.jsp.2020.02.002
Schneider, S. H., & Duran, L. (2010). School climate in middle schools: A cultural perspective. Journal of Research in Character Education, 8(2), 25–37.
Sewasew, D., Schroeders, U., Schiefer, I. M., Weirich, S., & Artelt, C. (2018). Development of sex differences in math achievement, self− concept, and interest from grade 5 to 7. Contemporary Educational Psychology, 54, 55–65. https://doi.org/10.1016/j.cedpsych.2018.05.003
Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976). Self− concept: Validation of construct interpretations. Review of Educational Research, 46(3), 407–441. https://doi.org/10.3102/00346543046003407
Shochet, I. M., Dadds, M. R., Ham, D., & Montague, R. (2006). School connectedness is an underemphasized parameter in adolescent mental health: Results of a community prediction study. Journal of Clinical Child & Adolescent Psychology, 35(2), 170–179. https://doi.org/10.1207/s15374424jccp3502_1
Sinatra, G. M., Mukhopadhyay, A., Allbright, T. N., Marsh, J. A., & Polikoff, M. S. (2017). Speedometry: A vehicle for promoting interest and engagement through integrated STEM instruction. The Journal of Educational Research, 110(3), 308–316. https://doi.org/10.1080/00220671.2016.1273178
Sirin, S. R. (2005). Socioeconomic status and academic achievement: A meta− analytic review of research. Review of Educational Research, 75(3), 417–453. https://doi.org/10.3102/00346543075003417
Slaughter− Defoe, D. T., & Carlson, K. (1996). Young African American and Latino children in high− poverty urban schools: How they perceive school climate. Journal of Negro Education, 65, 60–70. https://doi.org/10.2307/2967368
Stankov, L., Lee, J., & Von Davier, M. (2017). A note on construct validity of the anchoring method in PISA 2012. Journal of Psychoeducational Assessment, 36(7), 709–724. https://doi.org/10.1177/0734282917702270
Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 22, 360–407.
Suárez, E. (2020). “Estoy Explorando Science”: Emergent bilingual students problematizing electrical phenomena through translanguaging. Science Education, 104(5), 791–826. https://doi.org/10.1002/sce.21588
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s Alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Thapa, A., Cohen, J., Guffey, S., & Higgins− D’Alessandro, A. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. https://doi.org/10.3102/0034654313483907
Thomson, S. (2018). Achievement at school and socioeconomic background—an educational perspective. Npj Science of Learning. https://doi.org/10.1038/s41539-018-0022-0
Trautwein, U., Lüdtke, O., Köller, O., & Baumert, J. (2006). Self-esteem, academic self-concept, and achievement: How the learning environment moderates the dynamics of self-concept. Journal of Personality and Social Psychology, 90(2), 334–349. https://doi.org/10.1037/0022-3514.90.2.334
Vonkova, H., Papajoanu, O., & Stipek, J. (2018). Enhancing the cross− cultural comparability of self− reports using the Overclaiming technique: An analysis of accuracy and exaggeration in 64 cultures. Journal of Cross− Cultural Psychology, 49(8), 1247–1268. https://doi.org/10.1177/0022022118787042
Watkins, A. M., & Melde, C. (2009). Immigrants, assimilation, and perceived school disorder: An examination of the ‘other’ ethnicities. Journal of Criminal Justice, 37(6), 627–635. https://doi.org/10.1016/j.jcrimjus.2009.09.011
Zurawsky, C., & Gordon, E. W. (2004). Closing the gap: High achievement for students of color. Research Points, 2(3), 1–4.
Acknowledgements
The authors would like to thank Dr. Brian F. French and Dr. Shenghai Dai whose insightful advice and feedback have greatly improved the quality of the manuscript.
Funding
The present study has been funded by College of Education Collaborative Research Retreat Funding Awards, Washington State University.
Author information
Authors and Affiliations
Contributions
OR served as leading author; led study conceptualization, data preparation, management, and analysis, and the development of the methods and results sections of the manuscript; contributed to other complements of the manuscript development. RWD contributed to the study conceptualization, design of the study, and to other components of the manuscript development. AR contributed to the study conceptualization, and to other components of the manuscript development. YA contributed to study conceptualization, data analyses, and to other components of the manuscript development. BWA contributed to data analyses, data management and preparation. All authors discussed and provided critical feedback and helped shape the research, analysis, and final manuscript. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author was at College of Education, Washington State University when all work was completed for the manuscript. However, the author now practices as an independent researcher.
Supplementary Information
Additional file 1:
Supplemental Tables for the Additional Analysis with Control Variables.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ramazan, O., Danielson, R.W., Rougee, A. et al. Effects of classroom and school climate on language minority students’ PISA mathematics self-concept and achievement scores. Large-scale Assess Educ 11, 11 (2023). https://doi.org/10.1186/s40536-023-00156-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40536-023-00156-w
Keywords
- Classroom environment
- School climate
- Mathematics self-concept
- Mathematics achievement
- PISA
- Language minority students