Short answer

When designing systems that evolve complex behaviors, consider a cyclical or revisiting approach to task complexity rather than a strictly linear progression to ensure robust learning and prevent skill degradation.

Field: Human Factors
Source: Keele Research Repository (Keele University) (2017)
Method: Simulation and Evolutionary Computation
Evidence: Strong effect

Complex behaviors in 3D virtual agents can be incrementally evolved by presenting successive generations with a range of objective functions, outperforming linear or direct presentations. This human factors research insight is drawn from a 2017 study published in Keele Research Repository (Keele University). Using Simulation and evolutionary computation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing systems that evolve complex behaviors, consider a cyclical or revisiting approach to task complexity rather than a strictly linear progression to ensure robust learning and prevent skill degradation.

Study

Human FactorsHigh ImpactStrong effect

Incremental Neuroevolution of Complex 3D Agent Behaviors

Complex behaviors in 3D virtual agents can be incrementally evolved by presenting successive generations with a range of objective functions, outperforming linear or direct presentations.

Keele Research Repository (Keele University) · 2017

Key Findings

01Incremental evolutionary systems can suffer from forgetting and loss of gradient.
02Different complexification strategies significantly impact the management of these issues.
03Presenting successive generations to a full range of objective functions (covering and revisiting complexity) leads to more robust evolution of embodied agents.
04A bespoke control architecture combined with this approach can result in intricate reactive and deliberative behaviors.
05Achieved simultaneous incremental evolution in 3D of composite behaviors more complex than simple locomotion.

Application

Design takeaway

How to apply

When developing AI agents for simulations or games, implement a training regimen where the agent is periodically re-exposed to simpler tasks or foundational skills even after mastering more complex ones.

Project actions

01When designing a system that learns over time, consider how to prevent 'forgetting' of earlier skills.
02Explore different sequences for introducing new challenges or tasks to your system.

Method & Evidence

AimTo demonstrate the capacity to evolve a sequence of increasingly complex behaviors in a single, unified system for 3D virtual agents.

MethodSimulation and Evolutionary Computation

ProcedureDeveloped an environment-body-control architecture for evolving multiple behaviors incrementally. Explored a simulation based on this architecture with a complex environment and adapted it to include physical manipulation. Investigated how subtask presentations affect whole-task generalization performance of evolved agents.

Context3D virtual environments, artificial intelligence, evolutionary computation, agent-based systems.

Variables

IVStrategy for presenting objective functions (linear, direct, cyclical).

DVGeneralization performance of evolved agents, complexity of evolved behaviors.

CVAgent morphology, physical simulation parameters, environment complexity.

Strengths & Limitations

Strengths

+Demonstrates a novel approach to incremental evolution of complex behaviors.
+Provides a foundational architecture for future research in embodied AI.

Limitations

The computational resources required for complex simulations and evolutionary processes can be substantial, potentially limiting the scope of a design project.

Reliability & validity

The study's validity is supported by rigorous simulation and exploration of different strategies. Reliability would depend on the reproducibility of evolutionary outcomes, which can be influenced by random seeds in evolutionary algorithms.

Think critically

How might the 'forgetting' and 'loss of gradient' issues manifest in a physical robotic system, and what adaptations would be necessary to address them?

Design Principles

"Incremental complexity with cyclical objective function presentation fosters robust emergent behavior in artificial agents."

This research offers a novel approach to developing sophisticated artificial agents by mimicking naturalistic evolutionary processes. Understanding how to incrementally build complex behaviors is crucial for designing more adaptive and intelligent virtual environments, simulations, and even robotic systems.

What This Means for Your Design

Imagine teaching a robot to walk, then jump, then pick up a ball. Instead of just teaching them in order, this research suggests it's better to revisit walking and jumping occasionally while teaching the ball-picking skill to make sure the robot doesn't forget how to do the earlier things.

How to use in your project

1.This research can be cited to support the methodology for developing complex AI behaviors in a design project, particularly when using evolutionary or learning algorithms.

Add to My Project

Quick Cite

Paragraph starter

The methodology employed in this research, which demonstrates the effectiveness of incremental neuroevolution with cyclical objective function presentation for developing complex 3D agent behaviors, offers a robust framework for evolving sophisticated functionalities in artificial agents. This approach addresses potential issues of skill forgetting and gradient loss, leading to more adaptive and capable virtual entities.

Source

Keele Research Repository (Keele University)

Simultaneous incremental neuroevolution of motor control, navigation and object manipulation in 3D virtual creatures

journal · 2017

View source

Questions About This Research

What does the research say about incremental neuroevolution of complex 3d agent behaviors?: When designing systems that evolve complex behaviors, consider a cyclical or revisiting approach to task complexity rather than a strictly linear progression to ensure robust learning and prevent skill degradation. Evidence: Keele Research Repository (Keele University) (2017).
Why does "Incremental Neuroevolution of Complex 3D Agent Behaviors" matter for design?: This research offers a novel approach to developing sophisticated artificial agents by mimicking naturalistic evolutionary processes. Understanding how to incrementally build complex behaviors is crucial for designing more adaptive and intelligent virtual environments, simulations, and even robotic systems.
How can designers apply this research?: When designing systems that evolve complex behaviors, consider a cyclical or revisiting approach to task complexity rather than a strictly linear progression to ensure robust learning and prevent skill degradation.
What were the main findings?: Incremental evolutionary systems can suffer from forgetting and loss of gradient.. Different complexification strategies significantly impact the management of these issues.. Presenting successive generations to a full range of objective functions (covering and revisiting complexity) leads to more robust evolution of embodied agents.. A bespoke control architecture combined with this approach can result in intricate reactive and deliberative behaviors.
What research method was used?: Simulation and Evolutionary Computation.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2017 journal from Keele Research Repository (Keele University).
What should I do differently in my next project?: When developing AI agents for simulations or games, implement a training regimen where the agent is periodically re-exposed to simpler tasks or foundational skills even after mastering more complex ones.
What are the limitations?: The research focused on fixed-morphology agents, and the complexity of the physical simulation might not fully capture real-world physics.