Learning to design from humans: Imitating human designers through deep learning

07/26/2019
by   Ayush Raina, et al.
3

Humans as designers have quite versatile problem-solving strategies. Computer agents on the other hand can access large scale computational resources to solve certain design problems. Hence, if agents can learn from human behavior, a synergetic human-agent problem solving team can be created. This paper presents an approach to extract human design strategies and implicit rules, purely from historical human data, and use that for design generation. A two-step framework that learns to imitate human design strategies from observation is proposed and implemented. This framework makes use of deep learning constructs to learn to generate designs without any explicit information about objective and performance metrics. The framework is designed to interact with the problem through a visual interface as humans did when solving the problem. It is trained to imitate a set of human designers by observing their design state sequences without inducing problem-specific modelling bias or extra information about the problem. Furthermore, an end-to-end agent is developed that uses this deep learning framework as its core in conjunction with image processing to map pixel-to-design moves as a mechanism to generate designs. Finally, the designs generated by a computational team of these agents are then compared to actual human data for teams solving a truss design problem. Results demonstrates that these agents are able to create feasible and efficient truss designs without guidance, showing that this methodology allows agents to learn effective design strategies.

READ FULL TEXT

page 5

page 6

page 8

page 12

research
11/28/2022

Learning to design without prior data: Discovering generalizable design strategies using deep learning and tree search

Building an AI agent that can design on its own has been a goal since th...
research
03/08/2018

SentRNA: Improving computational RNA design by incorporating a prior of human design strategies

Designing RNA sequences that fold into specific structures and perform d...
research
09/01/2021

Balancing Performance and Human Autonomy with Implicit Guidance Agent

The human-agent team, which is a problem in which humans and autonomous ...
research
01/15/2021

Teaming up with information agents

Despite the intricacies involved in designing a computer as a teampartne...
research
10/07/2021

Goal-Directed Design Agents: Integrating Visual Imitation with One-Step Lookahead Optimization for Generative Design

Engineering design problems often involve large state and action spaces ...
research
05/13/2002

From Alife Agents to a Kingdom of N Queens

This paper presents a new approach to solving N-queen problems, which in...
research
12/19/2016

Computing Human-Understandable Strategies

Algorithms for equilibrium computation generally make no attempt to ensu...

Please sign up or login with your details

Forgot password? Click here to reset