Short answer
Prioritize validation of data collection tools with the intended user group, especially when designing for populations with non-typical physiological or biomechanical profiles.
- Field
- Human Factors
- Source
- TSpace (2020)
- Method
- Comparative validation study
- Sample
- 10 participants
- Evidence
- Moderate effect
Consumer-grade wearable activity trackers may not accurately capture physical activity metrics for individuals with mobility-related disabilities. This human factors research insight is drawn from a 2020 study published in TSpace. Using Comparative validation study with 10 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize validation of data collection tools with the intended user group, especially when designing for populations with non-typical physiological or biomechanical profiles.
Fitbit ChargeHRTM undercounts steps and heart rate in youth with mobility impairments
Consumer-grade wearable activity trackers may not accurately capture physical activity metrics for individuals with mobility-related disabilities.
TSpace · 2020
Key Findings
- 01The Fitbit ChargeHRTM consistently underestimated heart rate compared to the criterion measure.
- 02The Fitbit ChargeHRTM overestimated step count compared to the criterion measure.
- 03Device agreement for heart rate was strongest in participants with major gait deviations.
- 04Step count was consistently underestimated across the sample.
Application
Design takeaway
Prioritize validation of data collection tools with the intended user group, especially when designing for populations with non-typical physiological or biomechanical profiles.
How to apply
Before integrating a consumer wearable into a design project for a specific user group, conduct a pilot study to assess its accuracy and reliability for that group.
Project actions
- 01Consider the physical capabilities of your target users when selecting data collection tools.
- 02If using wearable sensors, investigate their accuracy for specific user groups.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Directly addresses a gap in research regarding wearable validity in a specific population.
- +Uses established criterion measures for comparison.
Limitations
Small sample size, potential variability in disability types and severity.
Reliability & validity
The study's validity is challenged by the observed underestimation of HR and overestimation of step count. Inter-device reliability for HR showed some agreement, particularly with gait deviations, but overall device agreement was not demonstrated.
Think critically
How might the design of the wearable sensor itself (e.g., placement, movement detection algorithms) contribute to its inaccuracy in individuals with atypical gaits?
Design Principles
"Ensure measurement tools are validated for the specific user population and context of use."
Designers developing assistive technologies or health monitoring devices must consider the unique physiological and biomechanical characteristics of diverse user groups. Inaccurate data from standard devices can lead to misinformed design decisions and ineffective solutions.
What This Means for Your Design
Fitness trackers like Fitbits might not work well for kids and teens who have trouble moving around, as they don't measure their steps and heart rate accurately.
How to use in your project
- 1.Use this study to justify the selection or rejection of specific data logging devices for your design project, especially if your target users have unique physical characteristics.
Add to My Project
Quick Cite
Paragraph starter
The validity of consumer-grade wearable technology for measuring physical activity in specific populations, such as individuals with mobility-related disabilities, requires careful consideration. Research indicates that devices like the Fitbit ChargeHRTM may not provide accurate data for these groups, underestimating heart rate and overestimating step counts, which could lead to flawed design insights if not accounted for.
Source
TSpace
Investigating the Validity of the Fitbit ChargeHRTM for Measuring Physical Activity in Children and Youth with Mobility-related Disabilities
journal · 2020
View sourceQuestions About This Research
- What does the research say about fitbit chargehrtm undercounts steps and heart rate in youth with mobility impairments?
- Prioritize validation of data collection tools with the intended user group, especially when designing for populations with non-typical physiological or biomechanical profiles. Evidence: TSpace (2020).
- Why does "Fitbit ChargeHRTM undercounts steps and heart rate in youth with mobility impairments" matter for design?
- Designers developing assistive technologies or health monitoring devices must consider the unique physiological and biomechanical characteristics of diverse user groups. Inaccurate data from standard devices can lead to misinformed design decisions and ineffective solutions.
- How can designers apply this research?
- Prioritize validation of data collection tools with the intended user group, especially when designing for populations with non-typical physiological or biomechanical profiles.
- What were the main findings?
- The Fitbit ChargeHRTM consistently underestimated heart rate compared to the criterion measure.. The Fitbit ChargeHRTM overestimated step count compared to the criterion measure.. Device agreement for heart rate was strongest in participants with major gait deviations.. Step count was consistently underestimated across the sample.
- What research method was used?
- Comparative validation study with 10 participants.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2020 journal from TSpace.
- What should I do differently in my next project?
- Before integrating a consumer wearable into a design project for a specific user group, conduct a pilot study to assess its accuracy and reliability for that group.
- What are the limitations?
- The study's small sample size and potential heterogeneity in functioning may limit generalizability.