Short answer

Designers should prioritize a holistic approach to usability, combining objective performance metrics with subjective user feedback and expert heuristic reviews to identify and address all facets of user experience.

Field: User-Centred Design
Source: INSERT (2025)
Method: Mixed-methods usability evaluation
Sample: 32 participants
Evidence: Moderate effect

A usability score of 64.76 suggests that while a research submission system is functional, it requires targeted improvements to enhance user experience and satisfaction. This user-centred design research insight is drawn from a 2025 study published in INSERT. Using Mixed-methods usability evaluation with 32 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should prioritize a holistic approach to usability, combining objective performance metrics with subjective user feedback and expert heuristic reviews to identify and address all facets of user experience.

Study

User-Centred DesignNew This WeekModerate effect

System Usability Score of 64.76 indicates a need for interface refinement in research submission platforms.

A usability score of 64.76 suggests that while a research submission system is functional, it requires targeted improvements to enhance user experience and satisfaction.

INSERT · 2025

Key Findings

01The System Usability Scale (SUS) score was 64.76, indicating the system is not yet fully acceptable and requires improvements.
02Effectiveness was high, with success rates of 100% for expert users and 97.9% for novice users, exceeding the 80% benchmark.
03Efficiency was moderate, with expert users taking approximately 2.35 minutes per task and novice users taking approximately 2 minutes per task.
04Concurrent Think Aloud and Heuristic Evaluation effectively identified the root causes of issues identified by the SUS and efficiency metrics.

Application

Design takeaway

How to apply

When designing or evaluating digital interfaces, use a combination of SUS questionnaires, task-based performance tracking (success rate and time), and expert heuristic reviews to gain a complete picture of usability.

Project actions

01Clearly define the tasks users will perform during usability testing.
02Ensure your heuristic evaluation criteria are well-defined and consistently applied.
03Triangulate findings from different methods to strengthen your conclusions.

Method & Evidence

AimTo evaluate the usability of a research ethics submission system and provide actionable recommendations for improvement.

MethodMixed-methods usability evaluation

ProcedureThe study employed a combination of usability testing techniques, including Concurrent Think Aloud (CTA), Heuristic Evaluation (HE), and the System Usability Scale (SUS). Participants performed tasks within the system, verbalizing their thoughts (CTA), while experts assessed the interface against established heuristics (HE). User satisfaction was measured using the SUS questionnaire.

Sample32 participants

ContextAcademic research submission systems

Variables

IVUsability testing methods (CTA, HE, SUS), user expertise (expert vs. novice)

DVEffectiveness (success rate), efficiency (time per task), user satisfaction (SUS score)

CVSystem interface, task complexity, participant demographics (implicitly controlled by sampling)

Strengths & Limitations

Strengths

+Utilized a robust combination of established usability evaluation methods.
+Provided specific, actionable recommendations for system improvement.

Limitations

The sample size may be small for broad generalizations, and the specific context of academic research submission might not apply to all digital products.

Reliability & validity

The use of multiple established methods (SUS, CTA, HE) enhances the validity of the findings. Reliability would depend on the consistency of task execution and interpretation of qualitative data.

Think critically

How might the specific domain of academic research submission influence the interpretation of usability scores compared to a general consumer application?

Design Principles

"Usability is a multi-faceted quality that encompasses effectiveness, efficiency, and user satisfaction, requiring a blend of quantitative measurement and qualitative insight for thorough evaluation."

Understanding user interaction with complex digital systems is crucial for effective design. Low usability scores can lead to user frustration, decreased efficiency, and potential errors, impacting the overall adoption and success of the system.

What This Means for Your Design

Even if people can use a system to get their work done, it might not be the easiest or most pleasant experience. This study shows how to check for those problems and make the system better.

How to use in your project

1.Use the System Usability Scale (SUS) as a quantitative measure of user satisfaction in your design project.
2.Incorporate heuristic evaluation principles to identify potential usability flaws in your design prototypes.

Add to My Project

Quick Cite

Paragraph starter

This research evaluated the usability of a digital system using a mixed-methods approach, combining quantitative measures like the System Usability Scale (SUS) with qualitative feedback from Concurrent Think Aloud and expert Heuristic Evaluation. The findings revealed a moderate usability score, indicating that while tasks were largely achievable, opportunities for enhancing user efficiency and satisfaction exist, necessitating targeted design refinements.

Source

INSERT

Evaluasi Usability Sistem Informasi Pengajuan Etik Penelitian (Sietik) Undiksha Berdasarkan Metode Usability Testing Menggunakan Teknik Concurrent Think Aloud, Heuristic Evaluation Dan System Usability Scale

journal · 2025

View source

Questions About This Research

What does the research say about system usability score of 64.76 indicates a need for interface refinement in research submission platforms?: Designers should prioritize a holistic approach to usability, combining objective performance metrics with subjective user feedback and expert heuristic reviews to identify and address all facets of user experience. Evidence: INSERT (2025).
Why does "System Usability Score of 64.76 indicates a need for interface refinement in research submission platforms." matter for design?: Understanding user interaction with complex digital systems is crucial for effective design. Low usability scores can lead to user frustration, decreased efficiency, and potential errors, impacting the overall adoption and success of the system.
How can designers apply this research?: Designers should prioritize a holistic approach to usability, combining objective performance metrics with subjective user feedback and expert heuristic reviews to identify and address all facets of user experience.
What were the main findings?: The System Usability Scale (SUS) score was 64.76, indicating the system is not yet fully acceptable and requires improvements.. Effectiveness was high, with success rates of 100% for expert users and 97.9% for novice users, exceeding the 80% benchmark.. Efficiency was moderate, with expert users taking approximately 2.35 minutes per task and novice users taking approximately 2 minutes per task.. Concurrent Think Aloud and Heuristic Evaluation effectively identified the root causes of issues identified by the SUS and efficiency metrics.
What research method was used?: Mixed-methods usability evaluation with 32 participants.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2025 journal from INSERT.
What should I do differently in my next project?: When designing or evaluating digital interfaces, use a combination of SUS questionnaires, task-based performance tracking (success rate and time), and expert heuristic reviews to gain a complete picture of usability.
What are the limitations?: The study focused on a specific user group (S1 students and lecturers in the Faculty of Medicine) and a single system, limiting generalizability to other contexts or user demographics.