Short answer

When designing systems for complex information management, such as archival processing, consider leveraging expert systems by systematically acquiring and codifying domain knowledge.

Field: Innovation & Design
Source: eScholarship (California Digital Library) (2016)
Method: Applied research study involving expert knowledge acquisition and iterative system development.
Evidence: Strong effect

Automated expert systems, developed through knowledge codification from domain experts, can significantly improve the efficiency and effectiveness of appraising and processing digital communications for archival purposes. This innovation & design research insight is drawn from a 2016 study published in eScholarship (California Digital Library). Using Applied research study involving expert knowledge acquisition and iterative system development., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing systems for complex information management, such as archival processing, consider leveraging expert systems by systematically acquiring and codifying domain knowledge.

Study

Innovation & DesignHigh ImpactStrong effect

Expert Systems Enhance Archival Appraisal of Digital Communications

eScholarship (California Digital Library) · 2016

Key Findings

01Bibliometrics can be a useful method for identifying domain experts in archival appraisal.
02Codifying expert knowledge into an expert system is feasible for automating appraisal tasks.
03Iterative development and testing are crucial for refining expert systems in this domain.
04The methodologies employed remain relevant for processing contemporary digital communications like social media and mobile phone data.

Application

Design takeaway

When designing systems for complex information management, such as archival processing, consider leveraging expert systems by systematically acquiring and codifying domain knowledge.

How to apply

When faced with a domain requiring expert judgment and a large volume of data, explore the creation of an expert system by interviewing and documenting the decision-making processes of experienced practitioners.

Project actions

01When designing a system that requires specialized knowledge, consider how you might extract and represent that knowledge.
02Think about how you would test the effectiveness of a system that aims to replicate human expertise.

Method & Evidence

AimCan expert systems be effectively designed and implemented to automate the appraisal and acquisition of computer-mediated communications for archival purposes?

MethodApplied research study involving expert knowledge acquisition and iterative system development.

ProcedureThe study involved identifying appraisal domain experts using bibliometrics, acquiring and codifying their knowledge, and then iteratively developing and testing an expert appraisal system based on this codified knowledge.

ContextArchival science and digital preservation of computer-mediated communications (e.g., email, social media).

Variables

IVExpert knowledge acquisition and codification methods.

DVEffectiveness and efficiency of archival appraisal and processing.

CVType of computer-mediated communication, archival appraisal criteria.

Strengths & Limitations

Strengths

+Pioneering work in applying expert systems to archival science.
+Demonstrated a practical methodology for knowledge acquisition and system development.

Limitations

The effectiveness of an expert system is highly dependent on the quality and completeness of the expert knowledge captured, and the system may struggle with novel situations not covered by the original knowledge base.

Reliability & validity

Reliability would be assessed by the consistency of the expert system's output given the same input. Validity would be assessed by comparing the system's appraisal decisions against those made by human experts or by measuring the long-term value of archived materials selected by the system.

Think critically

How does the evolution of digital communication technologies (e.g., encryption, ephemeral messaging) challenge the long-term applicability of expert systems designed for earlier forms of digital communication?

Design Principles

"Automate complex decision-making processes by capturing and formalizing expert knowledge into rule-based or inference systems."

As digital communication platforms proliferate, archivists face immense challenges in managing vast amounts of data. This research demonstrates a viable technological approach to automate and standardize the complex appraisal process, ensuring valuable digital heritage is preserved.

What This Means for Your Design

This study shows that you can build computer programs that act like expert archivists to help decide what digital stuff (like old emails) is important enough to save forever. They did this by asking real experts how they make these decisions and putting that knowledge into a computer system.

How to use in your project

1.Reference this study when discussing the design of systems that automate complex decision-making processes or require the capture of expert knowledge.

Add to My Project

Quick Cite

Paragraph starter

The research by Gilliland (2016) provides a foundational framework for designing expert systems in specialized domains. Their work on archival appraisal of digital communications highlights the efficacy of codifying expert knowledge to automate complex decision-making, a principle directly applicable to designing systems that require nuanced judgment, such as [mention your project's domain]. The iterative development and testing methodology also offers valuable insights into refining such systems for practical application.

Source

eScholarship (California Digital Library)

Designing Expert Systems for Archival Evaluation and Processing of Computer Mediated Communications: Frameworks and Methods

journal · 2016

View source

Questions About This Research

What does the research say about expert systems enhance archival appraisal of digital communications?: When designing systems for complex information management, such as archival processing, consider leveraging expert systems by systematically acquiring and codifying domain knowledge. Evidence: eScholarship (California Digital Library) (2016).
Why does "Expert Systems Enhance Archival Appraisal of Digital Communications" matter for design?: As digital communication platforms proliferate, archivists face immense challenges in managing vast amounts of data. This research demonstrates a viable technological approach to automate and standardize the complex appraisal process, ensuring valuable digital heritage is preserved.
How can designers apply this research?: When designing systems for complex information management, such as archival processing, consider leveraging expert systems by systematically acquiring and codifying domain knowledge.
What were the main findings?: Bibliometrics can be a useful method for identifying domain experts in archival appraisal.. Codifying expert knowledge into an expert system is feasible for automating appraisal tasks.. Iterative development and testing are crucial for refining expert systems in this domain.. The methodologies employed remain relevant for processing contemporary digital communications like social media and mobile phone data.
What research method was used?: Applied research study involving expert knowledge acquisition and iterative system development..
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2016 journal from eScholarship (California Digital Library).
What should I do differently in my next project?: When faced with a domain requiring expert judgment and a large volume of data, explore the creation of an expert system by interviewing and documenting the decision-making processes of experienced practitioners.
What are the limitations?: The study was conducted nearly two decades ago, and while the principles are sound, the specific technologies and the nature of digital communications have evolved significantly.