Alert button
Picture for Xiyang Dai

Xiyang Dai

Alert button

Efficient Self-supervised Vision Transformers for Representation Learning

Jun 17, 2021
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao

Figure 1 for Efficient Self-supervised Vision Transformers for Representation Learning
Figure 2 for Efficient Self-supervised Vision Transformers for Representation Learning
Figure 3 for Efficient Self-supervised Vision Transformers for Representation Learning
Figure 4 for Efficient Self-supervised Vision Transformers for Representation Learning
Viaarxiv icon

Dynamic Head: Unifying Object Detection Heads with Attentions

Jun 15, 2021
Xiyang Dai, Yinpeng Chen, Bin Xiao, Dongdong Chen, Mengchen Liu, Lu Yuan, Lei Zhang

Figure 1 for Dynamic Head: Unifying Object Detection Heads with Attentions
Figure 2 for Dynamic Head: Unifying Object Detection Heads with Attentions
Figure 3 for Dynamic Head: Unifying Object Detection Heads with Attentions
Figure 4 for Dynamic Head: Unifying Object Detection Heads with Attentions
Viaarxiv icon

CvT: Introducing Convolutions to Vision Transformers

Mar 29, 2021
Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang

Figure 1 for CvT: Introducing Convolutions to Vision Transformers
Figure 2 for CvT: Introducing Convolutions to Vision Transformers
Figure 3 for CvT: Introducing Convolutions to Vision Transformers
Figure 4 for CvT: Introducing Convolutions to Vision Transformers
Viaarxiv icon

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

Mar 29, 2021
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

Figure 1 for Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Figure 2 for Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Figure 3 for Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Figure 4 for Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Viaarxiv icon

Revisiting Dynamic Convolution via Matrix Decomposition

Mar 15, 2021
Yunsheng Li, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Ye Yu, Lu Yuan, Zicheng Liu, Mei Chen, Nuno Vasconcelos

Figure 1 for Revisiting Dynamic Convolution via Matrix Decomposition
Figure 2 for Revisiting Dynamic Convolution via Matrix Decomposition
Figure 3 for Revisiting Dynamic Convolution via Matrix Decomposition
Figure 4 for Revisiting Dynamic Convolution via Matrix Decomposition
Viaarxiv icon

Weak NAS Predictors Are All You Need

Feb 21, 2021
Junru Wu, Xiyang Dai, Dongdong Chen, Yinpeng Chen, Mengchen Liu, Ye Yu, Zhangyang Wang, Zicheng Liu, Mei Chen, Lu Yuan

Figure 1 for Weak NAS Predictors Are All You Need
Figure 2 for Weak NAS Predictors Are All You Need
Figure 3 for Weak NAS Predictors Are All You Need
Figure 4 for Weak NAS Predictors Are All You Need
Viaarxiv icon

MicroNet: Towards Image Recognition with Extremely Low FLOPs

Nov 24, 2020
Yunsheng Li, Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Lu Yuan, Zicheng Liu, Lei Zhang, Nuno Vasconcelos

Figure 1 for MicroNet: Towards Image Recognition with Extremely Low FLOPs
Figure 2 for MicroNet: Towards Image Recognition with Extremely Low FLOPs
Figure 3 for MicroNet: Towards Image Recognition with Extremely Low FLOPs
Figure 4 for MicroNet: Towards Image Recognition with Extremely Low FLOPs
Viaarxiv icon

DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search

Mar 27, 2020
Xiyang Dai, Dongdong Chen, Mengchen Liu, Yinpeng Chen, Lu Yuan

Figure 1 for DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Figure 2 for DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Figure 3 for DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Figure 4 for DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Viaarxiv icon

Dynamic ReLU

Mar 22, 2020
Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, Zicheng Liu

Figure 1 for Dynamic ReLU
Figure 2 for Dynamic ReLU
Figure 3 for Dynamic ReLU
Figure 4 for Dynamic ReLU
Viaarxiv icon

Dynamic Convolution: Attention over Convolution Kernels

Dec 07, 2019
Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, Zicheng Liu

Figure 1 for Dynamic Convolution: Attention over Convolution Kernels
Figure 2 for Dynamic Convolution: Attention over Convolution Kernels
Figure 3 for Dynamic Convolution: Attention over Convolution Kernels
Figure 4 for Dynamic Convolution: Attention over Convolution Kernels
Viaarxiv icon