Short answer
Designers should move beyond assuming fixed skill levels and instead create systems and support that adapt to and acknowledge the evolving, context-dependent nature of user competence.
- Field
- Innovation & Design
- Source
- Journal of the American Society for Information Science and Technology (2004)
- Method
- Qualitative analysis of interview data
- Evidence
- Moderate effect
An individual's perceived IT competence is not a fixed attribute but a dynamic, socially constructed interpretation that shifts based on the specific context and dialogue. This innovation & design research insight is drawn from a 2004 study published in Journal of the American Society for Information Science and Technology. Using Qualitative analysis of interview data, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should move beyond assuming fixed skill levels and instead create systems and support that adapt to and acknowledge the evolving, context-dependent nature of user competence.
User Perceptions of IT Competence are Fluid and Context-Dependent
An individual's perceived IT competence is not a fixed attribute but a dynamic, socially constructed interpretation that shifts based on the specific context and dialogue.
Journal of the American Society for Information Science and Technology · 2004
Key Findings
- 01IT competence is not a set of fixed skills but a 'self' that is momentarily constructed and context-dependent.
- 02Self-assessments of IT skills (e.g., 'computer anxiety') can change significantly depending on the conversational context.
- 03Implicit theories about technology and technical knowledge profoundly influence how IT competence is understood and taught.
Application
Design takeaway
Designers should move beyond assuming fixed skill levels and instead create systems and support that adapt to and acknowledge the evolving, context-dependent nature of user competence.
How to apply
When designing a new software feature, consider how users might perceive their ability to use it differently depending on whether they are in a high-pressure work situation or a relaxed learning environment.
Project actions
- 01When asking users about their skills, consider the context of the interview or survey.
- 02Explore how users talk about their successes and failures with technology in different situations.
- 03Think about how your design might influence a user's confidence in different scenarios.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides a nuanced understanding of user skill beyond simple categorization.
- +Highlights the importance of social and contextual factors in design.
Limitations
The findings are based on qualitative interviews, which are subjective and may not be generalizable to a larger population. The specific context of academic researchers might not apply to other fields.
Reliability & validity
The reliability of self-reported competence is questionable due to its subjective and context-dependent nature. Validity is enhanced by the qualitative depth of the interviews, capturing rich, contextualized data.
Think critically
If user perceptions of competence are so fluid, how can we reliably measure or design for specific skill levels?
Design Principles
"Design for dynamic user self-perception; acknowledge and accommodate contextual shifts in competence."
Understanding that users' self-assessments of their IT skills are fluid and influenced by social context is crucial for designing effective training, support, and user interfaces. It suggests that a one-size-fits-all approach to skill assessment or development may be ineffective.
What This Means for Your Design
How good you think you are with computers changes depending on who you're talking to and what you're doing. It's not just about what you know, but how you feel about it in that moment.
How to use in your project
- 1.Use this research to explain why user self-assessments in your research might vary.
- 2.Discuss how the context of your user testing could influence participant responses about their abilities.
Add to My Project
Quick Cite
Paragraph starter
This design project acknowledges that user perceptions of IT competence are not static but are fluid and context-dependent, as highlighted by Talja's (2004) work on the social construction of IT literacy. Therefore, user feedback regarding skill levels will be interpreted with an understanding that these self-assessments can shift based on the specific situation and dialogue.
Source
Journal of the American Society for Information Science and Technology
The social and discursive construction of computing skills
journal · 2004
View sourceQuestions About This Research
- What does the research say about user perceptions of it competence are fluid and context-dependent?
- Designers should move beyond assuming fixed skill levels and instead create systems and support that adapt to and acknowledge the evolving, context-dependent nature of user competence. Evidence: Journal of the American Society for Information Science and Technology (2004).
- Why does "User Perceptions of IT Competence are Fluid and Context-Dependent" matter for design?
- Understanding that users' self-assessments of their IT skills are fluid and influenced by social context is crucial for designing effective training, support, and user interfaces. It suggests that a one-size-fits-all approach to skill assessment or development may be ineffective.
- How can designers apply this research?
- Designers should move beyond assuming fixed skill levels and instead create systems and support that adapt to and acknowledge the evolving, context-dependent nature of user competence.
- What were the main findings?
- IT competence is not a set of fixed skills but a 'self' that is momentarily constructed and context-dependent.. Self-assessments of IT skills (e.g., 'computer anxiety') can change significantly depending on the conversational context.. Implicit theories about technology and technical knowledge profoundly influence how IT competence is understood and taught.
- What research method was used?
- Qualitative analysis of interview data.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2004 journal from Journal of the American Society for Information Science and Technology.
- What should I do differently in my next project?
- When designing a new software feature, consider how users might perceive their ability to use it differently depending on whether they are in a high-pressure work situation or a relaxed learning environment.
- What are the limitations?
- The study focused on academic researchers, so findings may not generalize to all user groups. The analysis relies on self-reported data, which can be subjective.