A CNN-based Patent Image Retrieval Method for Design Ideation

by   Shuo Jiang, et al.

The patent database is often used in searches of inspirational stimuli for innovative design opportunities because of its large size, extensive variety and rich design information in patent documents. However, most patent mining research only focuses on textual information and ignores visual information. Herein, we propose a convolutional neural network (CNN)- based patent image retrieval method. The core of this approach is a novel neural network architecture named Dual-VGG that is aimed to accomplish two tasks: visual material type prediction and International Patent Classification (IPC) class label prediction. In turn, the trained neural network provides the deep features in the image embedding vectors that can be utilized for patent image retrieval. The accuracy of both training tasks and patent image embedding space are evaluated to show the performance of our model. This approach is also illustrated in a case study of robot arm design retrieval. Compared to traditional keyword-based searching and Google image searching, the proposed method discovers more useful visual information for engineering design.


page 1

page 2

page 3

page 4


Matchable Image Retrieval by Learning from Surface Reconstruction

Convolutional Neural Networks (CNNs) have achieved superior performance ...

2-bit Model Compression of Deep Convolutional Neural Network on ASIC Engine for Image Retrieval

Image retrieval utilizes image descriptors to retrieve the most similar ...

Investigating the Vision Transformer Model for Image Retrieval Tasks

This paper introduces a plug-and-play descriptor that can be effectively...

A Fast Content-Based Image Retrieval Method Using Deep Visual Features

Fast and scalable Content-Based Image Retrieval using visual features is...

Compression of Deep Neural Networks for Image Instance Retrieval

Image instance retrieval is the problem of retrieving images from a data...

Semi Supervised Phrase Localization in a Bidirectional Caption-Image Retrieval Framework

We introduce a novel deep neural network architecture that links visual ...

Date Estimation in the Wild of Scanned Historical Photos: An Image Retrieval Approach

This paper presents a novel method for date estimation of historical pho...