Online Refinement of a Scene Recognition Model for Mobile Robots by Observing Human's Interaction with Environments

08/13/2022
by   Shigemichi Matsuzaki, et al.
2

This paper describes a method of online refinement of a scene recognition model for robot navigation considering traversable plants, flexible plant parts which a robot can push aside while moving. In scene recognition systems that consider traversable plants growing out to the paths, misclassification may lead the robot to getting stuck due to the traversable plants recognized as obstacles. Yet, misclassification is inevitable in any estimation methods. In this work, we propose a framework that allows for refining a semantic segmentation model on the fly during the robot's operation. We introduce a few-shot segmentation based on weight imprinting for online model refinement without fine-tuning. Training data are collected via observation of a human's interaction with the plant parts. We propose novel robust weight imprinting to mitigate the effect of noise included in the masks generated by the interaction. The proposed method was evaluated through experiments using real-world data and shown to outperform an ordinary weight imprinting and provide competitive results to fine-tuning with model distillation while requiring less computational cost.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
08/02/2021

Semantic-aware plant traversability estimation in plant-rich environments for agricultural mobile robots

This paper describes a method of estimating the traversability of plant ...
research
02/07/2023

Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interaction

We introduce a novel robotic system for improving unseen object instance...
research
12/21/2021

Generalized Few-Shot Semantic Segmentation: All You Need is Fine-Tuning

Generalized few-shot semantic segmentation was introduced to move beyond...
research
11/28/2017

One-Shot Reinforcement Learning for Robot Navigation with Interactive Replay

Recently, model-free reinforcement learning algorithms have been shown t...
research
03/08/2022

Enhancing Door Detection for Autonomous Mobile Robots with Environment-Specific Data Collection

Door detection represents a fundamental capability for autonomous mobile...
research
03/23/2022

A Scalable Model Specialization Framework for Training and Inference using Submodels and its Application to Speech Model Personalization

Model fine-tuning and adaptation have become a common approach for model...
research
07/03/2023

Surgical fine-tuning for Grape Bunch Segmentation under Visual Domain Shifts

Mobile robots will play a crucial role in the transition towards sustain...

Please sign up or login with your details

Forgot password? Click here to reset