Short answer
Design assessment tools that measure both cognitive and non-cognitive factors to better predict user success in a new environment.
- Field
- Human Factors
- Source
- ETS Research Report Series (2015)
- Method
- Psychometric study and scale development
- Evidence
- Strong effect
Assessing non-cognitive and academic skills in high school students provides a standardized metric for identifying areas needing support to facilitate successful transition to higher education. This human factors research insight is drawn from a 2015 study published in ETS Research Report Series. Using Psychometric study and scale development, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design assessment tools that measure both cognitive and non-cognitive factors to better predict user success in a new environment.
Non-cognitive skills assessment predicts college readiness
Assessing non-cognitive and academic skills in high school students provides a standardized metric for identifying areas needing support to facilitate successful transition to higher education.
ETS Research Report Series · 2015
Key Findings
- 01The High School SuccessNavigator (HSSN) assessment effectively measures non-cognitive and academic skills crucial for college readiness.
- 02The assessment provides a standardized metric to identify students' strengths and areas for improvement.
- 03HSSN can be used by counselors and administrators to guide individualized support for students preparing for postsecondary education.
Application
Design takeaway
Design assessment tools that measure both cognitive and non-cognitive factors to better predict user success in a new environment.
How to apply
Develop and validate assessments that measure a range of skills, including resilience, self-regulation, and collaboration, in addition to academic knowledge, for users transitioning to new roles or environments.
Project actions
- 01When designing a product or service for a specific user group, consider what non-functional attributes (like ease of use, intuitiveness, or emotional appeal) are critical for their success.
- 02Think about how to measure these non-functional attributes in a way that is objective and reliable, similar to how academic skills are measured.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Focuses on a holistic view of student preparedness.
- +Provides a standardized and quantifiable approach to assessment.
Limitations
The assessment might not account for external factors like financial stability or family support, which also significantly impact college success.
Reliability & validity
The study reports on structural analyses, reliability, and validity, indicating that the HSSN scales were rigorously tested to ensure consistent and accurate measurement of the intended constructs.
Think critically
To what extent can non-cognitive assessments truly predict success, and how might cultural or socioeconomic backgrounds influence these measured skills?
Design Principles
"Holistic assessment leads to more effective support."
Understanding a student's non-cognitive strengths and weaknesses is crucial for designing targeted interventions. This approach moves beyond purely academic metrics to offer a more holistic view of preparedness, enabling educators and counselors to provide personalized guidance.
What This Means for Your Design
This study shows that measuring things like how well students can manage their time and stay motivated (non-cognitive skills), along with their grades, helps predict if they'll do well in college. This means we can help students better by looking at more than just their test scores.
How to use in your project
- 1.Use the concept of assessing non-cognitive skills to justify the inclusion of user research methods that explore psychological factors, such as user interviews focusing on motivation, stress management, or learning styles, in your design project.
Add to My Project
Quick Cite
Paragraph starter
This research highlights the importance of assessing non-cognitive factors, such as self-regulation and motivation, in addition to academic performance when evaluating readiness for a new challenge. The development of the High School SuccessNavigator (HSSN) demonstrates how a standardized metric can be created to identify individual strengths and areas for support, thereby facilitating a smoother transition and improving outcomes. This principle can be applied to design projects by ensuring that user research delves into psychological and behavioral aspects crucial for the intended user's success in the designed context.
Source
ETS Research Report Series
Anticipating College Enrollment: Adapting <i><scp>SuccessNavigator</scp></i><sup>®</sup> for High School Students
journal · 2015
View sourceQuestions About This Research
- What does the research say about non-cognitive skills assessment predicts college readiness?
- Design assessment tools that measure both cognitive and non-cognitive factors to better predict user success in a new environment. Evidence: ETS Research Report Series (2015).
- Why does "Non-cognitive skills assessment predicts college readiness" matter for design?
- Understanding a student's non-cognitive strengths and weaknesses is crucial for designing targeted interventions. This approach moves beyond purely academic metrics to offer a more holistic view of preparedness, enabling educators and counselors to provide personalized guidance.
- How can designers apply this research?
- Design assessment tools that measure both cognitive and non-cognitive factors to better predict user success in a new environment.
- What were the main findings?
- The High School SuccessNavigator (HSSN) assessment effectively measures non-cognitive and academic skills crucial for college readiness.. The assessment provides a standardized metric to identify students' strengths and areas for improvement.. HSSN can be used by counselors and administrators to guide individualized support for students preparing for postsecondary education.
- What research method was used?
- Psychometric study and scale development.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2015 journal from ETS Research Report Series.
- What should I do differently in my next project?
- Develop and validate assessments that measure a range of skills, including resilience, self-regulation, and collaboration, in addition to academic knowledge, for users transitioning to new roles or environments.
- What are the limitations?
- The study's psychometric validation may not fully capture all contextual factors influencing college success; generalizability to all educational systems requires further investigation.