Short answer
When selecting or designing e-learning systems, prioritize a structured evaluation process that actively involves diverse stakeholders and quantifies key quality attributes such as usability, maintainability, and deployability using methods like Fuzzy AHP.
- Field
- User-Centred Design
- Source
- University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape) (2010)
- Method
- Mixed-methods research (qualitative and quantitative)
- Sample
- 33 stakeholders
- Evidence
- Strong effect
A mixed-methods approach, combining qualitative feedback with a quantitative Fuzzy Analytical Hierarchy Process (Fuzzy AHP) called FOSSET, can effectively evaluate and select e-learning systems based on user-centric criteria. This user-centred design research insight is drawn from a 2010 study published in University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape). Using Mixed-methods research (qualitative and quantitative) with 33 stakeholders, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When selecting or designing e-learning systems, prioritize a structured evaluation process that actively involves diverse stakeholders and quantifies key quality attributes such as usability, maintainability, and deployability using methods like Fuzzy AHP.
Fuzzy AHP enhances e-learning system selection by incorporating stakeholder usability, maintainability, and deployability.
A mixed-methods approach, combining qualitative feedback with a quantitative Fuzzy Analytical Hierarchy Process (Fuzzy AHP) called FOSSET, can effectively evaluate and select e-learning systems based on user-centric criteria.
University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape) · 2010
Key Findings
- 01The FOSSET technique is efficient and effective for evaluating e-learning systems.
- 02It reduces the number of pairwise comparisons needed, making it suitable for complex evaluations with many attributes.
- 03Stakeholder participation is crucial for selecting the preferred software product.
Application
Design takeaway
When selecting or designing e-learning systems, prioritize a structured evaluation process that actively involves diverse stakeholders and quantifies key quality attributes such as usability, maintainability, and deployability using methods like Fuzzy AHP.
How to apply
When evaluating potential e-learning platforms for an organization, use a structured approach that includes user surveys and interviews, followed by a Fuzzy AHP analysis to rank options based on predefined criteria like ease of use, technical support, and integration capabilities.
Project actions
- 01When evaluating different design options, consider using a multi-criteria decision-making tool.
- 02Ensure your evaluation criteria directly reflect user needs and system functionality.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Integrates both qualitative and quantitative research methods.
- +Proposes a novel technique (FOSSET) for software evaluation.
- +Focuses on practical, user-relevant quality characteristics.
Limitations
The complexity of Fuzzy AHP might be challenging to implement without specialized software. The subjectivity of pairwise comparisons can introduce bias.
Reliability & validity
The reliability of the Fuzzy AHP method depends on the consistency of the pairwise comparisons made by stakeholders. Validity is addressed by ensuring the chosen criteria (usability, maintainability, deployability) are relevant to the effective functioning of e-learning systems and by using a mixed-methods approach to triangulate findings.
Think critically
To what extent can a purely quantitative approach, like Fuzzy AHP, fully capture the nuanced emotional and experiential aspects of user interaction with a design, and what are the potential drawbacks of relying heavily on such methods?
Design Principles
"System selection and design should be guided by a multi-criteria decision-making framework that incorporates diverse stakeholder perspectives and objective quality assessments."
This research highlights the importance of involving diverse stakeholders in the software selection process, particularly for educational technologies. By systematically assessing usability, maintainability, and deployability through a structured methodology, design teams can make more informed decisions that lead to better user adoption and system effectiveness.
What This Means for Your Design
This study shows that using a smart math method (Fuzzy AHP) along with asking users questions can help pick the best e-learning software by looking at how easy it is to use, fix, and set up.
How to use in your project
- 1.Use the Fuzzy AHP method to justify the selection of a particular design solution over others, referencing stakeholder feedback on usability and other key factors.
Add to My Project
Quick Cite
Paragraph starter
The selection of the final design concept was informed by a mixed-methods evaluation approach, drawing inspiration from Sanga's (2010) work on Fuzzy AHP for e-learning systems. This involved gathering qualitative feedback on usability and functional requirements from target users, which was then integrated into a quantitative analysis using a simplified multi-criteria decision-making framework to objectively compare design alternatives based on predefined criteria such as user experience, feasibility, and innovation potential.
Source
University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape)
A technique for the evaluation of free and open source e-learning systems
journal · 2010
View sourceQuestions About This Research
- What does the research say about fuzzy ahp enhances e-learning system selection by incorporating stakeholder usability, maintainability, and deployability?
- When selecting or designing e-learning systems, prioritize a structured evaluation process that actively involves diverse stakeholders and quantifies key quality attributes such as usability, maintainability, and deployability using methods like Fuzzy AHP. Evidence: University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape) (2010).
- Why does "Fuzzy AHP enhances e-learning system selection by incorporating stakeholder usability, maintainability, and deployability." matter for design?
- This research highlights the importance of involving diverse stakeholders in the software selection process, particularly for educational technologies. By systematically assessing usability, maintainability, and deployability through a structured methodology, design teams can make more informed decisions that lead to better user adoption and system effectiveness.
- How can designers apply this research?
- When selecting or designing e-learning systems, prioritize a structured evaluation process that actively involves diverse stakeholders and quantifies key quality attributes such as usability, maintainability, and deployability using methods like Fuzzy AHP.
- What were the main findings?
- The FOSSET technique is efficient and effective for evaluating e-learning systems.. It reduces the number of pairwise comparisons needed, making it suitable for complex evaluations with many attributes.. Stakeholder participation is crucial for selecting the preferred software product.
- What research method was used?
- Mixed-methods research (qualitative and quantitative) with 33 stakeholders.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2010 journal from University of the Western Cape Electronic Theses and Dissertations Repository (University of the Western Cape).
- What should I do differently in my next project?
- When evaluating potential e-learning platforms for an organization, use a structured approach that includes user surveys and interviews, followed by a Fuzzy AHP analysis to rank options based on predefined criteria like ease of use, technical support, and integration capabilities.
- What are the limitations?
- The study was conducted in a specific developing country context, which may limit generalizability to other regions or types of institutions. The effectiveness of the technique might vary with the complexity and number of attributes considered.