Short answer

Adopt or adapt existing, widely-used modeling languages like UML to create structured and accessible frameworks for designing complex interactive systems, particularly those involving multiple modes of input and output.

Field
Modelling
Source
Computer (2004)
Method
Framework development and application
Evidence
Strong effect

Leveraging the widely adopted Unified Modeling Language (UML) provides a standardized and accessible framework for designing multimodal human-computer interactions. This modelling research insight is drawn from a 2004 study published in Computer. Using Framework development and application, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Adopt or adapt existing, widely-used modeling languages like UML to create structured and accessible frameworks for designing complex interactive systems, particularly those involving multiple modes of input and output.

Study
ModellingHigh ImpactStrong effect

UML-based framework standardizes multimodal HCI design

Leveraging the widely adopted Unified Modeling Language (UML) provides a standardized and accessible framework for designing multimodal human-computer interactions.

Computer · 2004

01

Key Findings

  • 01UML can be extended to create a generic modeling framework for multimodal HCI.
  • 02Using a well-established standard like UML lowers the barrier to entry for software engineers in multimodal HCI research.
  • 03Standardization promotes reuse of design components and interoperability of tools.
02

Application

Design takeaway

Adopt or adapt existing, widely-used modeling languages like UML to create structured and accessible frameworks for designing complex interactive systems, particularly those involving multiple modes of input and output.

How to apply

When designing systems with multimodal interaction (e.g., voice, gesture, touch), consider using UML diagrams to model the flow and integration of these different input and output channels. This can help in clearly defining system behavior and facilitating development.

Project actions

  • 01When modeling user interfaces, especially those with multiple interaction methods, consider how standard diagramming tools like UML can be applied.
  • 02Think about how your chosen modeling approach can be understood by others who might not be specialists in your specific design area.
03

Method & Evidence

AimHow can the Unified Modeling Language (UML) be adapted into a generic framework to facilitate the modeling of multimodal human-computer interactions?
MethodFramework development and application
ProcedureA generic modeling framework was designed by incorporating the Unified Modeling Language (UML) to specify multimodal human-computer interactions. The framework's accessibility and utility were assessed by its potential for adoption by software engineers.
ContextHuman-Computer Interaction (HCI) design, software engineering

Variables

IVUse of UML in a generic framework for multimodal HCI modeling
DVAccessibility and adoption of multimodal HCI design methodologies
CVFamiliarity with UML among software engineers, complexity of multimodal interactions being modeled
04

Strengths & Limitations

Strengths

  • +Leverages a widely recognized and supported standard (UML).
  • +Addresses the practical need for accessible design tools in a growing field (multimodal HCI).

Limitations

The proposed framework is generic and may require specific extensions for highly specialized multimodal interactions. The success of its application relies on the user's proficiency with UML.

Reliability & validity

Reliability would be assessed by the consistency of models produced by different designers using the framework. Validity would be assessed by how well the models accurately represent the intended multimodal interactions and facilitate development.

Think critically

To what extent does relying on a pre-existing modeling language like UML limit the innovation or expressiveness required for novel multimodal interaction paradigms?

05

Design Principles

"Leverage established standards to enhance the accessibility, consistency, and interoperability of design methodologies."

This approach democratizes complex HCI research by making it understandable and implementable for a broader range of software engineers. Standardization fosters best practices, encourages component reuse, and improves interoperability of design tools, ultimately accelerating innovation in user interface development.

06

What This Means for Your Design

Using a common language like UML for designing how people interact with computers using multiple methods (like talking and gesturing) makes it easier for more people to do this kind of design work.

How to use in your project

  • 1.Use UML diagrams to model the user interaction flow for a multimodal interface in your design project, referencing this paper to justify the choice of a standardized modeling approach.
07

Add to My Project

08

Quick Cite

Paragraph starter

The research by Obrenović and Starcevic (2004) highlights the benefit of using standardized modeling languages like the Unified Modeling Language (UML) to create accessible frameworks for complex design domains such as multimodal human-computer interaction. This approach facilitates broader adoption by software engineers and promotes consistency and reuse in design.

09

Source

Computer

Modeling multimodal human-computer interaction

journal · 2004

View source

Questions About This Research

What does the research say about uml-based framework standardizes multimodal hci design?
Adopt or adapt existing, widely-used modeling languages like UML to create structured and accessible frameworks for designing complex interactive systems, particularly those involving multiple modes of input and output. Evidence: Computer (2004).
Why does "UML-based framework standardizes multimodal HCI design" matter for design?
This approach democratizes complex HCI research by making it understandable and implementable for a broader range of software engineers. Standardization fosters best practices, encourages component reuse, and improves interoperability of design tools, ultimately accelerating innovation in user interface development.
How can designers apply this research?
Adopt or adapt existing, widely-used modeling languages like UML to create structured and accessible frameworks for designing complex interactive systems, particularly those involving multiple modes of input and output.
What were the main findings?
UML can be extended to create a generic modeling framework for multimodal HCI.. Using a well-established standard like UML lowers the barrier to entry for software engineers in multimodal HCI research.. Standardization promotes reuse of design components and interoperability of tools.
What research method was used?
Framework development and application.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2004 journal from Computer.
What should I do differently in my next project?
When designing systems with multimodal interaction (e.g., voice, gesture, touch), consider using UML diagrams to model the flow and integration of these different input and output channels. This can help in clearly defining system behavior and facilitating development.
What are the limitations?
The effectiveness of the framework is dependent on the familiarity of designers with UML. The specific nuances of all possible multimodal interactions may not be fully captured by a single generic framework.