Short answer
Integrate digital and multimedia tools into your design evaluation process to gather more comprehensive user feedback on functionality, meaning, and structure.
- Field
- User-Centred Design
- Source
- Maynooth University ePrints and eTheses Archive (Maynooth University) (2018)
- Method
- Case study and prototype implementation
- Evidence
- Moderate effect
Utilizing multi-media and web-based platforms for evaluating design artifacts allows for a more comprehensive assessment of their syntactic, semantic, and pragmatic qualities, leading to improved design outcomes. This user-centred design research insight is drawn from a 2018 study published in Maynooth University ePrints and eTheses Archive (Maynooth University). Using Case study and prototype implementation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate digital and multimedia tools into your design evaluation process to gather more comprehensive user feedback on functionality, meaning, and structure.
Web-based evaluation methods improve design artifact quality assessment
Utilizing multi-media and web-based platforms for evaluating design artifacts allows for a more comprehensive assessment of their syntactic, semantic, and pragmatic qualities, leading to improved design outcomes.
Maynooth University ePrints and eTheses Archive (Maynooth University) · 2018
Key Findings
- 01A multi-media and web-based approach can effectively assess syntactic, semantic, and pragmatic quality of design artifacts.
- 02This approach offers a more comprehensive evaluation than traditional methods.
- 03The findings and experiences gained can support other DSR approaches.
Application
Design takeaway
Integrate digital and multimedia tools into your design evaluation process to gather more comprehensive user feedback on functionality, meaning, and structure.
How to apply
When evaluating a prototype or concept, create an online survey with embedded videos or interactive elements to gather feedback on usability, clarity, and overall user experience.
Project actions
- 01When evaluating your own designs, consider creating a simple online survey or using video demonstrations to collect feedback.
- 02Think about how you can assess not just if a design works, but also if it's easy to understand and use.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Introduces a novel approach to design artifact evaluation.
- +Addresses multiple dimensions of design quality (syntactic, semantic, pragmatic).
Limitations
The effectiveness of web-based evaluation can depend on the technical skills of the participants and the quality of the online platform used. It might be difficult to observe non-verbal user feedback.
Reliability & validity
The reliability of web-based evaluations can be affected by participant engagement and the consistency of the platform. Validity is enhanced by assessing multiple quality dimensions, but may be limited by the artificiality of the online environment.
Think critically
How might the reliance on web-based evaluation tools limit the depth of understanding compared to in-person user testing, particularly for complex or novel designs?
Design Principles
"Comprehensive design evaluation should consider syntactic, semantic, and pragmatic qualities, and can be enhanced through digital and multimedia platforms."
This research highlights the importance of robust evaluation in the design process, a key aspect of design engineering. By moving beyond traditional methods, designers can gain deeper insights into how users interact with and perceive their designs, ensuring that the final product is not only functional but also meets user needs effectively.
What This Means for Your Design
Using websites and videos to get feedback on designs helps you understand if the design is built right, makes sense, and is easy for people to use.
How to use in your project
- 1.Use the concept of evaluating syntactic, semantic, and pragmatic qualities to structure your own design evaluation in the project.
- 2.Justify the use of web-based or multimedia evaluation methods in your project by referencing the benefits outlined in this paper.
Add to My Project
Quick Cite
Paragraph starter
In line with research by Brandtner and Helfert (2018), a multi-media and web-based evaluation approach was adopted to assess the syntactic, semantic, and pragmatic quality of the design artifact. This method allowed for a comprehensive gathering of user feedback, ensuring that the design was not only functional but also intuitively understood and effectively utilized by the target audience.
Source
Maynooth University ePrints and eTheses Archive (Maynooth University)
Multi-Media and Web-based Evaluation of Design Artifacts - Syntactic, Semantic and Pragmatic Quality of Process Models
journal · 2018
View sourceQuestions About This Research
- What does the research say about web-based evaluation methods improve design artifact quality assessment?
- Integrate digital and multimedia tools into your design evaluation process to gather more comprehensive user feedback on functionality, meaning, and structure. Evidence: Maynooth University ePrints and eTheses Archive (Maynooth University) (2018).
- Why does "Web-based evaluation methods improve design artifact quality assessment" matter for design?
- This research highlights the importance of robust evaluation in the design process, a key aspect of IB Design Technology. By moving beyond traditional methods, designers can gain deeper insights into how users interact with and perceive their designs, ensuring that the final product is not only functional but also meets user needs effectively.
- How can designers apply this research?
- Integrate digital and multimedia tools into your design evaluation process to gather more comprehensive user feedback on functionality, meaning, and structure.
- What were the main findings?
- A multi-media and web-based approach can effectively assess syntactic, semantic, and pragmatic quality of design artifacts.. This approach offers a more comprehensive evaluation than traditional methods.. The findings and experiences gained can support other DSR approaches.
- What research method was used?
- Case study and prototype implementation.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2018 journal from Maynooth University ePrints and eTheses Archive (Maynooth University).
- What should I do differently in my next project?
- When evaluating a prototype or concept, create an online survey with embedded videos or interactive elements to gather feedback on usability, clarity, and overall user experience.
- What are the limitations?
- The study focuses on process models, and its applicability to other types of design artifacts may vary. The specific technologies and platforms used may also influence the results.