Short answer
When designing systems or educational approaches for complex knowledge domains, consider how users will interpret and validate information based on their understanding of established expert practices and the 'artifact' of knowledge itself.
- Field
- Modelling
- Source
- Arrow@dit (Dublin Institute of Technology) (2010)
- Method
- Qualitative research using a schema-based observational framework and semi-structured interviews.
- Sample
- Not explicitly stated, but refers to 'first year honours mathematics students'.
- Evidence
- Moderate effect
Novice students' understanding and evaluation of mathematical proofs are shaped by their perception of expert community practices and the proof as an artifact within that community. This modelling research insight is drawn from a 2010 study published in Arrow@dit (Dublin Institute of Technology). Using Qualitative research using a schema-based observational framework and semi-structured interviews. with Not explicitly stated, but refers to 'first year honours mathematics students'., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing systems or educational approaches for complex knowledge domains, consider how users will interpret and validate information based on their understanding of established expert practices and the 'artifact' of knowledge itself.
Novice mathematicians evaluate proofs using a schema based on community practice
Novice students' understanding and evaluation of mathematical proofs are shaped by their perception of expert community practices and the proof as an artifact within that community.
Arrow@dit (Dublin Institute of Technology) · 2010
Key Findings
- 01Novice students' evaluation criteria for proofs are influenced by their understanding of what constitutes acceptable mathematical practice within an expert community.
- 02A schema based on proofs as artifacts within a community of practice can be a useful tool for analyzing novice proof evaluation behaviours.
- 03Students' habits and knowledge regarding proof features and purposes are revealed through their validation and evaluation performances.
Application
Design takeaway
When designing systems or educational approaches for complex knowledge domains, consider how users will interpret and validate information based on their understanding of established expert practices and the 'artifact' of knowledge itself.
How to apply
When developing a new design methodology or a complex technical tool, consider creating a 'user guide' that not only explains functionality but also implicitly or explicitly demonstrates the underlying principles and evaluation standards of the expert field.
Project actions
- 01When presenting your design or model, explain not just what it does, but why it's designed that way, referencing established principles or expert practices.
- 02Consider how someone new to your field might try to evaluate your work, and provide clear criteria or examples of good practice.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Utilizes a strong theoretical framework (sociocultural learning theories).
- +Develops a novel schema for analysis, providing a structured approach to understanding novice evaluation.
Limitations
The study's focus on mathematical proofs might not directly translate to all design disciplines without careful adaptation of the 'artifact' and 'community practice' concepts.
Reliability & validity
Reliability could be enhanced by using multiple coders to analyze the qualitative data. Validity is supported by the theoretical framework and the detailed analysis of student responses, though the generalizability might be limited by the specific sample.
Think critically
To what extent are the 'expert community practices' observed in mathematics transferable to the more diverse and rapidly evolving practices within design fields?
Design Principles
"Artifacts should be designed and presented in a way that reflects and facilitates understanding of the expert community's practices and evaluation criteria."
This research highlights that effective design of learning tools and educational strategies for complex domains like mathematics requires understanding how novices interpret and validate information based on perceived expert standards. It suggests that making the criteria and processes of expert communities explicit can accelerate learning.
What This Means for Your Design
When learning something new, like how to build a complex model, you often try to copy how experts do it. This study shows that students learning math proofs do the same – they judge proofs based on what they think mathematicians would accept.
How to use in your project
- 1.Use this research to justify why you are using specific evaluation criteria for your design project, linking them to established industry standards or expert practices.
- 2.If your project involves creating a model or a system for others to evaluate, use these findings to inform how you present it to ensure it's understood within the context of expert practice.
Add to My Project
Quick Cite
Paragraph starter
This research by Pfeiffer (2010) suggests that novice learners often evaluate complex outputs, such as mathematical proofs, by referencing their perception of expert community practices and treating the output as an artifact of that community. This implies that when presenting design work or models, it is beneficial to explicitly frame them within the context of established professional standards and expert methodologies to facilitate effective evaluation by others.
Source
Arrow@dit (Dublin Institute of Technology)
Features and purposes of mathematical proofs in the view of novice students: observations from proof validation and evaluation performances
journal · 2010
View sourceQuestions About This Research
- What does the research say about novice mathematicians evaluate proofs using a schema based on community practice?
- When designing systems or educational approaches for complex knowledge domains, consider how users will interpret and validate information based on their understanding of established expert practices and the 'artifact' of knowledge itself. Evidence: Arrow@dit (Dublin Institute of Technology) (2010).
- Why does "Novice mathematicians evaluate proofs using a schema based on community practice" matter for design?
- This research highlights that effective design of learning tools and educational strategies for complex domains like mathematics requires understanding how novices interpret and validate information based on perceived expert standards. It suggests that making the criteria and processes of expert communities explicit can accelerate learning.
- How can designers apply this research?
- When designing systems or educational approaches for complex knowledge domains, consider how users will interpret and validate information based on their understanding of established expert practices and the 'artifact' of knowledge itself.
- What were the main findings?
- Novice students' evaluation criteria for proofs are influenced by their understanding of what constitutes acceptable mathematical practice within an expert community.. A schema based on proofs as artifacts within a community of practice can be a useful tool for analyzing novice proof evaluation behaviours.. Students' habits and knowledge regarding proof features and purposes are revealed through their validation and evaluation performances.
- What research method was used?
- Qualitative research using a schema-based observational framework and semi-structured interviews. with Not explicitly stated, but refers to 'first year honours mathematics students'..
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2010 journal from Arrow@dit (Dublin Institute of Technology).
- What should I do differently in my next project?
- When developing a new design methodology or a complex technical tool, consider creating a 'user guide' that not only explains functionality but also implicitly or explicitly demonstrates the underlying principles and evaluation standards of the expert field.
- What are the limitations?
- The study focuses on novice students in a specific academic context, and their perceptions may not generalize to other learner groups or domains.