Short answer
Invest in developing or adopting testing methodologies that are dynamic and adaptive, rather than static, to ensure mobile applications meet user expectations across a wide range of devices and software versions.
- Field
- User-Centred Design
- Source
- arXiv (Cornell University) (2018)
- Method
- Perspective paper and literature review
- Evidence
- Moderate effect
Current automated mobile app testing methods are insufficient due to device fragmentation and platform evolution, leading to a reliance on manual testing and impacting the end-user experience. This user-centred design research insight is drawn from a 2018 study published in arXiv (Cornell University). Using Perspective paper and literature review, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Invest in developing or adopting testing methodologies that are dynamic and adaptive, rather than static, to ensure mobile applications meet user expectations across a wide range of devices and software versions.
Automated mobile app testing requires continuous evolution for user satisfaction.
Current automated mobile app testing methods are insufficient due to device fragmentation and platform evolution, leading to a reliance on manual testing and impacting the end-user experience.
arXiv (Cornell University) · 2018
Key Findings
- 01Existing automated mobile app testing tools have significant limitations, including issues with automated oracles, test case history awareness, and automated test case evolution.
- 02Device fragmentation and rapid platform evolution are major challenges for comprehensive mobile testing.
- 03A new framework for automated mobile app testing, termed CEL (Continuous, Evolutionary, and Large-scale), is proposed to address these shortcomings.
Application
Design takeaway
Invest in developing or adopting testing methodologies that are dynamic and adaptive, rather than static, to ensure mobile applications meet user expectations across a wide range of devices and software versions.
How to apply
When designing or evaluating testing strategies for mobile applications, consider the need for continuous updates, adaptive test cases, and broad device coverage.
Project actions
- 01When evaluating existing testing tools for your design project, consider their ability to adapt to new software versions or device types.
- 02Think about how your testing process could be made more continuous, perhaps by integrating it into a development workflow.
- 03Consider how test cases could be designed to be 'smart' and evolve based on previous results or user feedback.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Identifies critical gaps in current mobile app testing practices.
- +Proposes a forward-looking framework (CEL) with clear principles for future research and development.
Limitations
The proposed CEL framework is conceptual and requires practical implementation and empirical testing to prove its effectiveness.
Reliability & validity
The reliability and validity of the proposed CEL framework are not yet established as it is a perspective paper. Empirical studies would be needed to assess its practical effectiveness.
Think critically
Given the rapid pace of technological change, how can design projects ensure their testing methodologies remain relevant and effective throughout the product lifecycle?
Design Principles
"Automated testing strategies for complex, evolving digital products must be designed to be continuous, evolutionary, and scalable to maintain product quality and user satisfaction."
Designers and developers must acknowledge the limitations of current automated testing to ensure the quality and usability of mobile applications. A robust testing strategy is crucial for delivering seamless user experiences in a dynamic mobile landscape.
What This Means for Your Design
Testing mobile apps automatically is hard because there are so many different phones and software versions that change all the time. The current tools aren't good enough, so people still test by hand. We need new tools that can keep up with changes, learn from themselves, and test on lots of different devices.
How to use in your project
- 1.Reference this paper when discussing the challenges of testing complex digital products and the need for adaptive testing strategies in your design project's evaluation or justification sections.
Add to My Project
Quick Cite
Paragraph starter
The challenges inherent in mobile application development, such as device fragmentation and rapid platform evolution, necessitate advanced testing strategies. Current automated testing solutions often fall short, leading to a reliance on manual testing and potentially compromising the end-user experience. Research suggests that a more effective approach involves 'Continuous, Evolutionary, and Large-scale' (CEL) testing, which aims to create adaptive and comprehensive automated testing frameworks capable of keeping pace with the dynamic mobile ecosystem.
Source
arXiv (Cornell University)
Continuous, Evolutionary and Large-Scale: A New Perspective for Automated Mobile App Testing
journal · 2018
View sourceQuestions About This Research
- What does the research say about automated mobile app testing requires continuous evolution for user satisfaction?
- Invest in developing or adopting testing methodologies that are dynamic and adaptive, rather than static, to ensure mobile applications meet user expectations across a wide range of devices and software versions. Evidence: arXiv (Cornell University) (2018).
- Why does "Automated mobile app testing requires continuous evolution for user satisfaction." matter for design?
- Designers and developers must acknowledge the limitations of current automated testing to ensure the quality and usability of mobile applications. A robust testing strategy is crucial for delivering seamless user experiences in a dynamic mobile landscape.
- How can designers apply this research?
- Invest in developing or adopting testing methodologies that are dynamic and adaptive, rather than static, to ensure mobile applications meet user expectations across a wide range of devices and software versions.
- What were the main findings?
- Existing automated mobile app testing tools have significant limitations, including issues with automated oracles, test case history awareness, and automated test case evolution.. Device fragmentation and rapid platform evolution are major challenges for comprehensive mobile testing.. A new framework for automated mobile app testing, termed CEL (Continuous, Evolutionary, and Large-scale), is proposed to address these shortcomings.
- What research method was used?
- Perspective paper and literature review.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2018 journal from arXiv (Cornell University).
- What should I do differently in my next project?
- When designing or evaluating testing strategies for mobile applications, consider the need for continuous updates, adaptive test cases, and broad device coverage.
- What are the limitations?
- The paper is a perspective piece and does not present empirical validation of the proposed CEL framework.