Short answer
Design for persistence: create systems that support and reward ongoing engagement, and provide clear pathways for users to recover from periods of low engagement.
- Field
- User-Centred Design
- Source
- Computers & Education (2023)
- Method
- Longitudinal data analysis using learning analytics and life-course methods.
- Sample
- 106 participants
- Evidence
- Strong effect
Consistent, long-term student engagement is a more reliable predictor of sustained academic achievement than engagement at any single point in time. This user-centred design research insight is drawn from a 2023 study published in Computers & Education. Using Longitudinal data analysis using learning analytics and life-course methods. with 106 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design for persistence: create systems that support and reward ongoing engagement, and provide clear pathways for users to recover from periods of low engagement.
Sustained Engagement, Not Sporadic, Predicts Long-Term Academic Success
Consistent, long-term student engagement is a more reliable predictor of sustained academic achievement than engagement at any single point in time.
Computers & Education · 2023
Key Findings
- 01Online engagement at a single time-point is not a consistent indicator for high achievement.
- 02Longitudinal high grades or sustained high engagement (individually or combined) indicate a stable academic trajectory.
- 03Disengagement at any point is consistently associated with lower achievement among low-engaged students.
- 04Improving engagement is linked to acceptable achievement levels and infrequent dropouts.
- 05Lack of improvement or 'catching up' is a significant indicator for proactive intervention.
Application
Design takeaway
Design for persistence: create systems that support and reward ongoing engagement, and provide clear pathways for users to recover from periods of low engagement.
How to apply
When designing educational software or learning management systems, prioritize features that encourage regular use and provide users with insights into their progress over extended periods. Implement proactive nudges or support systems for users showing declining engagement trends.
Project actions
- 01When designing a product or service, consider how to keep users engaged over the entire lifespan of their interaction, not just the initial phase.
- 02Think about how to provide feedback that shows users their progress over time, not just their current status.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Longitudinal study design allows for tracking changes over time.
- +Analysis across a full academic program provides a comprehensive view of engagement-achievement dynamics.
Limitations
The study was conducted in an online learning context, so findings might not directly apply to all types of user engagement. The specific measures of engagement used might also influence the results.
Reliability & validity
The study's reliance on learning analytics data provides objective measures of engagement, enhancing reliability. The longitudinal nature and analysis across a full program contribute to external validity within similar academic contexts. However, the specific definitions and measurements of engagement and achievement could impact construct validity.
Think critically
How might the definition and measurement of 'engagement' influence the observed relationship between engagement and achievement, and what alternative metrics could provide a more nuanced understanding?
Design Principles
"Foster sustained interaction through adaptive support and continuous feedback loops."
This insight highlights the importance of fostering continuous engagement rather than focusing on short-term interventions. For design practice, it suggests that systems and learning environments should be designed to support ongoing participation and motivation throughout a user's journey, not just at the beginning or during specific modules.
What This Means for Your Design
To do well in a course or program over a long time, it's more important to stay engaged regularly than to be super engaged just once in a while. If you start to disengage, it's a warning sign, and if you don't improve, you're likely to fall behind.
How to use in your project
- 1.Use this research to justify the importance of designing for long-term user engagement in your design project, explaining how consistent interaction leads to better user outcomes.
Add to My Project
Quick Cite
Paragraph starter
This research highlights that sustained user engagement is a critical factor for achieving long-term success, rather than sporadic interaction. For my design project, this means prioritizing features that encourage consistent use and provide ongoing value, as this is more likely to lead to desired user outcomes and prevent disengagement over time.
Source
Computers & Education
The longitudinal association between engagement and achievement varies by time, students’ profiles, and achievement state: A full program study
journal · 2023
View sourceQuestions About This Research
- What does the research say about sustained engagement, not sporadic, predicts long-term academic success?
- Design for persistence: create systems that support and reward ongoing engagement, and provide clear pathways for users to recover from periods of low engagement. Evidence: Computers & Education (2023).
- Why does "Sustained Engagement, Not Sporadic, Predicts Long-Term Academic Success" matter for design?
- This insight highlights the importance of fostering continuous engagement rather than focusing on short-term interventions. For design practice, it suggests that systems and learning environments should be designed to support ongoing participation and motivation throughout a user's journey, not just at the beginning or during specific modules.
- How can designers apply this research?
- Design for persistence: create systems that support and reward ongoing engagement, and provide clear pathways for users to recover from periods of low engagement.
- What were the main findings?
- Online engagement at a single time-point is not a consistent indicator for high achievement.. Longitudinal high grades or sustained high engagement (individually or combined) indicate a stable academic trajectory.. Disengagement at any point is consistently associated with lower achievement among low-engaged students.. Improving engagement is linked to acceptable achievement levels and infrequent dropouts.
- What research method was used?
- Longitudinal data analysis using learning analytics and life-course methods. with 106 participants.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2023 journal from Computers & Education.
- What should I do differently in my next project?
- When designing educational software or learning management systems, prioritize features that encourage regular use and provide users with insights into their progress over extended periods. Implement proactive nudges or support systems for users showing declining engagement trends.
- What are the limitations?
- The study focused on a specific cohort within a four-year program, and findings might vary across different academic disciplines, program lengths, or educational contexts. The definition of 'engagement' can also be multifaceted and may not capture all forms of user interaction.