Short answer

Design assessments that require analysis, evaluation, and synthesis of information, rather than simple recall, to better prepare users for complex problem-solving.

Field
User-Centred Design
Source
E-Journal of Humanities Arts and Social Sciences (2023)
Method
Qualitative case study
Sample
4 technology lecturers
Evidence
Moderate effect

Technology lecturers can design summative assessments that effectively prompt students to apply critical thinking skills, moving beyond rote memorization to deeper analytical and evaluative engagement. This user-centred design research insight is drawn from a 2023 study published in E-Journal of Humanities Arts and Social Sciences. Using Qualitative case study with 4 technology lecturers, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design assessments that require analysis, evaluation, and synthesis of information, rather than simple recall, to better prepare users for complex problem-solving.

Study
User-Centred DesignRecentModerate effect

Summative assessments can be designed to actively cultivate critical thinking in technology students.

Technology lecturers can design summative assessments that effectively prompt students to apply critical thinking skills, moving beyond rote memorization to deeper analytical and evaluative engagement.

E-Journal of Humanities Arts and Social Sciences · 2023

01

Key Findings

  • 01Technology lecturers, to some extent, design assessments that elicit critical thinking.
  • 02Modern education necessitates the development of critical thinking for technological problem-solving.
02

Application

Design takeaway

Design assessments that require analysis, evaluation, and synthesis of information, rather than simple recall, to better prepare users for complex problem-solving.

How to apply

When designing educational materials or training programs, consider how the assessment components actively engage users in critical thinking processes.

Project actions

  • 01When designing a product or system, consider how users will need to think critically to use it effectively.
  • 02Develop user testing scenarios that go beyond simple task completion to assess deeper understanding and problem-solving.
03

Method & Evidence

AimTo what extent do technology lecturers design summative assessments that stimulate students' critical thinking skills?
MethodQualitative case study
ProcedureThe study analyzed summative assessment questions set by technology lecturers, evaluating them against a framework for critical thinking skills (Facione's framework).
Sample4 technology lecturers
ContextUniversity technology education

Variables

IVType of summative assessment question (e.g., recall vs. application)
DVLevel of critical thinking skills elicited
CVSubject area (technology education), Lecturer's teaching experience, Module content
04

Strengths & Limitations

Strengths

  • +Focuses on a crucial aspect of modern education: critical thinking.
  • +Employs a qualitative approach to gain in-depth understanding.

Limitations

The study's findings might not apply to all subject areas or educational levels.

Reliability & validity

The qualitative nature of the study may present challenges in terms of inter-rater reliability when assessing critical thinking. Validity is supported by the use of a recognized framework (Facione's).

Think critically

How can assessment design be a proactive tool for developing critical thinking, rather than just a measure of existing knowledge?

05

Design Principles

"Assessments should mirror real-world problem-solving by demanding higher-order thinking skills."

In design practice, understanding how users (students) process information and apply knowledge is crucial for effective learning and skill development. Designing assessments that foster critical thinking ensures that future designers and engineers can tackle complex, novel problems with confidence and innovation.

06

What This Means for Your Design

Teachers can create tests that make students really think hard and solve problems, not just remember facts, which is important for future jobs.

How to use in your project

  • 1.Reference this study when discussing the importance of user engagement and higher-order thinking in your design process.
  • 2.Use the findings to justify the design of user interfaces or educational tools that promote analytical skills.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the importance of designing summative assessments that actively cultivate critical thinking skills, a principle directly applicable to user-centred design. By creating user experiences that necessitate analysis, evaluation, and synthesis, designers can empower users to tackle complex challenges and foster deeper engagement with products and systems.

09

Source

E-Journal of Humanities Arts and Social Sciences

Assessing the Implementation of Critical Thinking Skills in the University: A Focus on Technology Education

journal · 2023

View source

Questions About This Research

What does the research say about summative assessments can be designed to actively cultivate critical thinking in technology students?
Design assessments that require analysis, evaluation, and synthesis of information, rather than simple recall, to better prepare users for complex problem-solving. Evidence: E-Journal of Humanities Arts and Social Sciences (2023).
Why does "Summative assessments can be designed to actively cultivate critical thinking in technology students." matter for design?
In design practice, understanding how users (students) process information and apply knowledge is crucial for effective learning and skill development. Designing assessments that foster critical thinking ensures that future designers and engineers can tackle complex, novel problems with confidence and innovation.
How can designers apply this research?
Design assessments that require analysis, evaluation, and synthesis of information, rather than simple recall, to better prepare users for complex problem-solving.
What were the main findings?
Technology lecturers, to some extent, design assessments that elicit critical thinking.. Modern education necessitates the development of critical thinking for technological problem-solving.
What research method was used?
Qualitative case study with 4 technology lecturers.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2023 journal from E-Journal of Humanities Arts and Social Sciences.
What should I do differently in my next project?
When designing educational materials or training programs, consider how the assessment components actively engage users in critical thinking processes.
What are the limitations?
The study focused on a limited number of lecturers and modules within a single university, potentially limiting the generalizability of findings.