Deep learning framework for robot for person detection and tracking

04/19/2022
by   Adarsh Ghimire, et al.
0

Robustly tracking a person of interest in the crowd with a robotic platform is one of the cornerstones of human-robot interaction. The robot platform which is limited by the computational power, rapid movements, and occlusions of the target requires an efficient and robust framework to perform tracking. This paper proposes a deep learning framework for tracking a person using a mobile robot with a stereo camera. The proposed system detects a person based on its head, then utilizes the low-cost, high-speed regression network-based tracker to track the person of interest in real-time. The visual servoing of the mobile robot has been designed using a PID controller which utilizes tracker output and depth estimation of the person in subsequent frames, hence providing smooth and adaptive movement of the robot based on target movement. The proposed system has been tested in a real environment, thus proving its effectiveness.

READ FULL TEXT
research
05/21/2022

Robot Person Following in Uniform Crowd Environment

Person-tracking robots have many applications, such as in security, elde...
research
03/15/2017

Real-time 3D Human Tracking for Mobile Robots with Multisensors

Acquiring the accurate 3-D position of a target person around a robot pr...
research
04/26/2018

Detection-Tracking for Efficient Person Analysis: The DetTA Pipeline

In the past decade many robots were deployed in the wild, and people det...
research
12/14/2019

Follow Pedro! An Infrared-based Person-Follower using Nonlinear Optimization

We used ROS2 as a platform to conduct AI research for developing a Follo...
research
09/13/2019

Human Following for Wheeled Robot with Monocular Pan-tilt Camera

Human following on mobile robots has witnessed significant advances due ...
research
07/03/2020

Three-dimensional Human Tracking of a Mobile Robot by Fusion of Tracking Results of Two Cameras

This paper proposes a process that uses two cameras to obtain three-dime...
research
02/04/2023

Robot Person Following Under Partial Occlusion

Robot person following (RPF) is a capability that supports many useful h...

Please sign up or login with your details

Forgot password? Click here to reset