Vision Transformers: State of the Art and Research Challenges

07/07/2022
by   Bo-Kai Ruan, et al.
0

Transformers have achieved great success in natural language processing. Due to the powerful capability of self-attention mechanism in transformers, researchers develop the vision transformers for a variety of computer vision tasks, such as image recognition, object detection, image segmentation, pose estimation, and 3D reconstruction. This paper presents a comprehensive overview of the literature on different architecture designs and training tricks (including self-supervised learning) for vision transformers. Our goal is to provide a systematic review with the open research opportunities.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset