Skip to main content

An IERI – International Educational Research Institute Journal

Table 2 Simulated Web Search Tool Action Labels by Subconstruct Categories

From: Combining cognitive theory and data driven approaches to examine students’ search behaviors in simulated digital environments

Alignment to Inquiry Subconstructs

Description

Action Label

Mean Frequency (SD)

Plan Search

Student constructs or revises their search terms or consults reference materials to generate a query for the search task

Construct Search

8.4% (3.6%)

View Reference Materials

9.5% (8.9%)

Locate Information

Student submits a search by pressing search button

Run Search

10% (4.2%)

View Previous Search

5% (3.1%)

Search results are displayed. Results were coded in terms of their task relevance. Completely off-topic results automatically triggered a search term hint

Results (High-relevance; i.e., two useful websites appear in list)

13.2% (6.7%)

Results (Medium-relevance, i.e., one useful website appears in list)

9.6% (7.1%)

Results (Low-relevance, i.e., no useful websites appear in list)

11.2% (7.1%)

Off-topic Results

6.6% (4.7%)

Sources (i.e., websites and image results) were coded in terms of their task relevance and reliability

View Source (High-quality, i.e., highly relevant and highly reliable)

4.7% (2.7%)

View Source (Medium-quality, i.e., partially relevant and mixed reliability)

4.5% (2.8%)

View Source (Low-quality, i.e., tangentially relevant, and low reliability)

7.4% (4%)

Evaluate Sources

Websites were evaluated by students in terms of Usefulness and Trustworthiness

Evaluate (High-quality, i.e., student rates source as high usefulness and trustworthiness)

5.7% (3.7%)

Evaluate (Mixed-quality, i.e., student ratings of usefulness and trustworthiness are mixed)

5.0% (3.3%)

Evaluate (Low-quality, i.e., student rates source as low usefulness and trustworthiness)

4.4% (2.9%)

Evaluate (No Rating)

3.6% (3.3%)

Interface actions

Start and End Session; these states aid in interpretation of strategies

Start Session

6.4% (5.4%)

Finish Session

5.9% (4.6%)

Specific help actions triggered by the system if students appear to be off-task

Timer Alert (i.e., system warns students they have 5 min left to search)

4.7% (4.4%)

Key Source Resetting (i.e., system provides students with relevant resource)

4.6% (3.8%)

Search Term Hint (i.e., system provides students with suggested search terms)

6.2% (4.1%)

Students can ask for help and receive instructions about using the interface

Help (i.e., students can press a button to access contextual help menu)

5.7% (5.6%)

Pauses between actions

Between 2.5 and 10 s

Short Pause

18.9% (7.6%)

Between 10 and 30 s

Medium Pause

12.2% (5.5%)

Greater than 30 s

Long Pause

8.6% (5.1%)

  1. Process data logs were translated into 24 action labels alongside descriptions and alignment to the ELA inquiry construct. We also report the mean frequency with which these actions occur within students’ search sequences (standard deviation in parentheses reflects variation of these frequencies across sequences)