DeepAI AI Chat
Log In Sign Up

TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applications

07/08/2019
by   Yu-Chuan Huang, et al.
10

Ball trajectory data are one of the most fundamental and useful information in the evaluation of players' performance and analysis of game strategies. Although vision-based object tracking techniques have been developed to analyze sport competition videos, it is still challenging to recognize and position a high-speed and tiny ball accurately. In this paper, we develop a deep learning network, called TrackNet, to track the tennis ball from broadcast videos in which the ball images are small, blurry, and sometimes with afterimage tracks or even invisible. The proposed heatmap-based deep learning network is trained to not only recognize the ball image from a single frame but also learn flying patterns from consecutive frames. TrackNet takes images with a size of 640×360 to generate a detection heatmap from either a single frame or several consecutive frames to position the ball and can achieve high precision even on public domain videos. The network is evaluated on the video of the men's singles final at the 2017 Summer Universiade, which is available on YouTube. The precision, recall, and F1-measure of TrackNet reach 99.7%, 97.3%, and 98.5%, respectively. To prevent overfitting, 9 additional videos are partially labeled together with a subset from the previous dataset to implement 10-fold cross-validation, and the precision, recall, and F1-measure are 95.3%, 75.7%, and 84.3%, respectively. A conventional image processing algorithm is also implemented to compare with TrackNet. Our experiments indicate that TrackNet outperforms conventional method by a big margin and achieves exceptional ball tracking performance. The dataset and demo video are available at https://nol.cs.nctu.edu.tw/ndo3je6av9/.

READ FULL TEXT

page 1

page 5

page 6

page 7

11/22/2022

Deep-Learning-Based Computer Vision Approach For The Segmentation Of Ball Deliveries And Tracking In Cricket

There has been a significant increase in the adoption of technology in c...
03/08/2020

A Tracking System For Baseball Game Reconstruction

The baseball game is often seen as many contests that are performed betw...
09/05/2019

Utilizing Temporal Information in DeepConvolutional Network for Efficient Soccer BallDetection and Tracking

Soccer ball detection is identified as one of the critical challenges in...
09/05/2019

Utilizing Temporal Information in Deep Convolutional Network for Efficient Soccer Ball Detection and Tracking

Soccer ball detection is identified as one of the critical challenges in...
03/30/2022

Ball 3D localization from a single calibrated image

Ball 3D localization in team sports has various applications including a...
06/11/2020

Privacy-Aware Activity Classification from First Person Office Videos

In the advent of wearable body-cameras, human activity classification fr...

Code Repositories

TrackNet-Badminton-Tracking-tensorflow2

TrackNet for badminton tracking using tensorflow2


view repo

squash-ball-detector

Original source code can be found at: https://nol.cs.nctu.edu.tw:234/open-source/TrackNet/


view repo