OPAC Usability Hinders Information Literacy: Vocational Students Struggle with Library Jargon and Navigation
A significant gap exists between how vocational students search for information and the current design of library Online Public Access Catalogs (OPACs), leading to poor usability and reduced information literacy.
Journal of Information Systems and Informatics · 2026
Key Findings
- 01Heuristic evaluation identified 18 significant usability violations, particularly related to library technical jargon and error prevention.
- 02User testing revealed a low average Task Success Rate (49.3%) and a poor System Usability Scale (SUS) score (55.0), indicating unacceptable usability.
- 03Specific dissonance points were found between students' mental models and the system's bibliographic metadata and navigation.
Application
Design takeaway
Redesign OPAC interfaces to use plain language, avoid technical jargon, and offer navigation structures that align with users' existing knowledge and common search behaviors.
How to apply
Before launching or updating any information system, conduct heuristic evaluations with usability experts and perform user testing with representative users, employing think-aloud protocols and standardized usability questionnaires.
Project actions
- 01When evaluating a system, consider both expert opinions and actual user experiences.
- 02Use qualitative data (like think-aloud) to understand *why* users struggle, not just *if* they struggle.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Employs a mixed-methods approach combining expert review and empirical user testing.
- +Identifies specific usability issues and quantifies user performance and perception.
Limitations
The number of expert evaluators was small, and the specific student population might not represent all vocational students.
Reliability & validity
Reliability is supported by the use of standardized metrics like SUS and the Think-Aloud protocol. Validity is enhanced by the triangulation of data from expert evaluation and user testing, directly addressing the research aim.
Think critically
To what extent do the findings regarding 'mental model dissonance' generalize to other digital information systems beyond library OPACs, and what are the implications for designing interfaces for diverse user groups?
Design Principles
"Design interfaces to minimize cognitive load by matching system metaphors and terminology with user expectations and mental models."
Designers must recognize that users' mental models, especially those of digital natives, may not align with traditional information architecture. Failing to bridge this gap results in systems that are not only difficult to use but actively impede users from achieving their goals.
What This Means for Your Design
The library's computer system for finding books is hard for students to use because it uses confusing words and isn't organized the way they expect, making it difficult to find what they need.
How to use in your project
- 1.Use the findings to justify user testing and heuristic evaluations in your own design project.
- 2.Cite this study when discussing the importance of aligning system design with user mental models.
Add to My Project
Quick Cite
(2026). Usability Evaluation of a School Library OPAC Using Heuristic Evaluation and User Testing. Journal of Information Systems and Informatics. https://doi.org/10.63158/journalisi.v8i1.1528 Retrieved from https://designdex.org/study/7fabde54-c0c9-4383-97f4-e396354db9eb/opac-usability-hinders-information-literacy-vocational-students-struggle-with-library-jargon-and-navigation
Paragraph starter
This study highlights the critical need for user-centered design in information systems, demonstrating how a mismatch between user mental models and system architecture, as evidenced by low task success rates and poor usability scores in a school library OPAC, can significantly impede user goals. The research underscores the value of integrating heuristic evaluations with empirical user testing to identify specific design flaws and inform necessary interface restructuring for improved user experience and information literacy.
Source
Journal of Information Systems and Informatics
Usability Evaluation of a School Library OPAC Using Heuristic Evaluation and User Testing
journal · 2026
View sourceQuestions about this research
- What does the research say about opac usability hinders information literacy: vocational students struggle with library jargon and navigation?
- Redesign OPAC interfaces to use plain language, avoid technical jargon, and offer navigation structures that align with users' existing knowledge and common search behaviors. Evidence: Journal of Information Systems and Informatics (2026).
- Why does "OPAC Usability Hinders Information Literacy: Vocational Students Struggle with Library Jargon and Navigation" matter for design?
- Designers must recognize that users' mental models, especially those of digital natives, may not align with traditional information architecture. Failing to bridge this gap results in systems that are not only difficult to use but actively impede users from achieving their goals.
- How can designers apply this research?
- Redesign OPAC interfaces to use plain language, avoid technical jargon, and offer navigation structures that align with users' existing knowledge and common search behaviors.
- What were the main findings?
- Heuristic evaluation identified 18 significant usability violations, particularly related to library technical jargon and error prevention.. User testing revealed a low average Task Success Rate (49.3%) and a poor System Usability Scale (SUS) score (55.0), indicating unacceptable usability.. Specific dissonance points were found between students' mental models and the system's bibliographic metadata and navigation.
- What research method was used?
- Mixed-methods evaluation (Heuristic Evaluation and User Testing) with 3 experts, unspecified number of students.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2026 journal from Journal of Information Systems and Informatics.
- What should I do differently in my next project?
- Before launching or updating any information system, conduct heuristic evaluations with usability experts and perform user testing with representative users, employing think-aloud protocols and standardized usability questionnaires.
- What are the limitations?
- The study focused on a single vocational high school, and the specific context of the 'Kurikulum Merdeka' may influence student search behaviors.
- Is there evidence that vocational students affects design outcomes?
- The library's online catalog is difficult for vocational students to use, with many errors and a low success rate in finding information, largely due to confusing terminology and navigation. Designers must recognize that users' mental models, especially those of digital natives, may not align with traditional informati Source: Journal of Information Systems and Informatics (2026).
- Where does this opac research apply?
- Vocational high school library It sits within user-centred design research on designdex.org.
Related research topics
vocational students design research · evidence on vocational students · does vocational students improve design outcomes · opac studies for designers · vocational students and opac findings · user-centred design research evidence