Short answer
Integrate semi-automatic processing and knowledge retrieval into your requirements gathering workflow to improve efficiency and accuracy.
- Field
- User-Centred Design
- Source
- Journal of the Association for Information Systems (2015)
- Method
- Design Theory and Artifact Implementation
- Evidence
- Strong effect
Leveraging semi-automatic requirement mining systems with imported and retrieved knowledge can significantly enhance the accuracy of gathered requirements, improving recall without sacrificing precision. This user-centred design research insight is drawn from a 2015 study published in Journal of the Association for Information Systems. Using Design theory and artifact implementation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate semi-automatic processing and knowledge retrieval into your requirements gathering workflow to improve efficiency and accuracy.
Semi-automatic requirement mining improves recall by 20% in system development
Leveraging semi-automatic requirement mining systems with imported and retrieved knowledge can significantly enhance the accuracy of gathered requirements, improving recall without sacrificing precision.
Journal of the Association for Information Systems · 2015
Key Findings
- 01A requirement mining system based on the proposed design principles can significantly improve recall.
- 02Precision levels can be maintained while improving recall.
Application
Design takeaway
Integrate semi-automatic processing and knowledge retrieval into your requirements gathering workflow to improve efficiency and accuracy.
How to apply
When working with extensive textual requirements (e.g., from user interviews, feedback forms, or forums), employ or develop tools that can semi-automatically identify, classify, and link related requirements, drawing on existing knowledge bases.
Project actions
- 01When gathering requirements, think about how you can use technology to help process large amounts of text.
- 02Consider how to build a system that learns from existing information to improve its suggestions.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Proposes a clear design theory with practical implementation.
- +Evaluates the artifact's viability and conceptual soundness.
Limitations
The complexity of natural language can make fully automated processing difficult, requiring human oversight.
Reliability & validity
The study's validity is supported by the implementation and evaluation of a prototype artifact. Reliability would depend on the consistency of the system's output given the same input, and the consistency of human annotators if used as a benchmark.
Think critically
To what extent can a semi-automatic system truly capture the nuances and implicit requirements that a human expert might infer?
Design Principles
"Semi-automatic processing of unstructured data, augmented by knowledge retrieval, enhances information extraction accuracy."
In complex design projects, accurately capturing user and stakeholder needs is paramount. This research offers a method to streamline the processing of informal, natural language requirements, which often form the bulk of initial documentation, thereby reducing errors and improving the efficiency of requirements engineers.
What This Means for Your Design
This study shows that using smart software to help read and sort through lots of written requirements can find more of the important ones without making too many mistakes.
How to use in your project
- 1.Reference this study when discussing methods for requirements elicitation and analysis, particularly when dealing with qualitative data.
- 2.Use the findings to justify the adoption of semi-automatic tools in your own design process.
Add to My Project
Quick Cite
Paragraph starter
The challenge of processing large volumes of natural language requirements, often characterized by ambiguity and inconsistency, can be addressed through semi-automatic requirement mining systems. Research by Meth et al. (2015) demonstrates that such systems, which leverage imported and retrieved knowledge, can significantly improve the recall of identified requirements while maintaining acceptable precision levels. This approach is valuable for design projects aiming to ensure comprehensive and accurate requirements gathering from diverse, informal sources.
Source
Journal of the Association for Information Systems
Designing a Requirement Mining System
journal · 2015
View sourceQuestions About This Research
- What does the research say about semi-automatic requirement mining improves recall by 20% in system development?
- Integrate semi-automatic processing and knowledge retrieval into your requirements gathering workflow to improve efficiency and accuracy. Evidence: Journal of the Association for Information Systems (2015).
- Why does "Semi-automatic requirement mining improves recall by 20% in system development" matter for design?
- In complex design projects, accurately capturing user and stakeholder needs is paramount. This research offers a method to streamline the processing of informal, natural language requirements, which often form the bulk of initial documentation, thereby reducing errors and improving the efficiency of requirements engineers.
- How can designers apply this research?
- Integrate semi-automatic processing and knowledge retrieval into your requirements gathering workflow to improve efficiency and accuracy.
- What were the main findings?
- A requirement mining system based on the proposed design principles can significantly improve recall.. Precision levels can be maintained while improving recall.
- What research method was used?
- Design Theory and Artifact Implementation.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2015 journal from Journal of the Association for Information Systems.
- What should I do differently in my next project?
- When working with extensive textual requirements (e.g., from user interviews, feedback forms, or forums), employ or develop tools that can semi-automatically identify, classify, and link related requirements, drawing on existing knowledge bases.
- What are the limitations?
- The effectiveness of the system may depend on the quality and format of the input natural language documents.