Alert button
Picture for Robert D Mullins

Robert D Mullins

Alert button

Revisiting Structured Dropout

Oct 05, 2022
Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins

Figure 1 for Revisiting Structured Dropout
Figure 2 for Revisiting Structured Dropout
Figure 3 for Revisiting Structured Dropout
Figure 4 for Revisiting Structured Dropout
Viaarxiv icon

DARTFormer: Finding The Best Type Of Attention

Oct 02, 2022
Jason Ross Brown, Yiren Zhao, Ilia Shumailov, Robert D Mullins

Figure 1 for DARTFormer: Finding The Best Type Of Attention
Figure 2 for DARTFormer: Finding The Best Type Of Attention
Figure 3 for DARTFormer: Finding The Best Type Of Attention
Figure 4 for DARTFormer: Finding The Best Type Of Attention
Viaarxiv icon

Wide Attention Is The Way Forward For Transformers

Oct 02, 2022
Jason Ross Brown, Yiren Zhao, Ilia Shumailov, Robert D Mullins

Figure 1 for Wide Attention Is The Way Forward For Transformers
Figure 2 for Wide Attention Is The Way Forward For Transformers
Figure 3 for Wide Attention Is The Way Forward For Transformers
Figure 4 for Wide Attention Is The Way Forward For Transformers
Viaarxiv icon