Picture for Yake Wei

Yake Wei

Diagnosing and Re-learning for Balanced Multimodal Learning

Add code
Jul 12, 2024
Viaarxiv icon

MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance

Add code
May 28, 2024
Viaarxiv icon

Multimodal Fusion on Low-quality Data: A Comprehensive Survey

Add code
Apr 27, 2024
Figure 1 for Multimodal Fusion on Low-quality Data: A Comprehensive Survey
Figure 2 for Multimodal Fusion on Low-quality Data: A Comprehensive Survey
Figure 3 for Multimodal Fusion on Low-quality Data: A Comprehensive Survey
Figure 4 for Multimodal Fusion on Low-quality Data: A Comprehensive Survey
Viaarxiv icon

Quantifying and Enhancing Multi-modal Robustness with Modality Preference

Add code
Feb 09, 2024
Viaarxiv icon

Enhancing Multi-modal Cooperation via Fine-grained Modality Valuation

Add code
Sep 12, 2023
Viaarxiv icon

Learning in Audio-visual Context: A Review, Analysis, and New Perspective

Add code
Aug 20, 2022
Figure 1 for Learning in Audio-visual Context: A Review, Analysis, and New Perspective
Figure 2 for Learning in Audio-visual Context: A Review, Analysis, and New Perspective
Figure 3 for Learning in Audio-visual Context: A Review, Analysis, and New Perspective
Figure 4 for Learning in Audio-visual Context: A Review, Analysis, and New Perspective
Viaarxiv icon

Learning to Answer Questions in Dynamic Audio-Visual Scenarios

Add code
Apr 05, 2022
Figure 1 for Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Figure 2 for Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Figure 3 for Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Figure 4 for Learning to Answer Questions in Dynamic Audio-Visual Scenarios
Viaarxiv icon

Balanced Multimodal Learning via On-the-fly Gradient Modulation

Add code
Mar 29, 2022
Figure 1 for Balanced Multimodal Learning via On-the-fly Gradient Modulation
Figure 2 for Balanced Multimodal Learning via On-the-fly Gradient Modulation
Figure 3 for Balanced Multimodal Learning via On-the-fly Gradient Modulation
Figure 4 for Balanced Multimodal Learning via On-the-fly Gradient Modulation
Viaarxiv icon

Class-aware Sounding Objects Localization via Audiovisual Correspondence

Add code
Dec 22, 2021
Figure 1 for Class-aware Sounding Objects Localization via Audiovisual Correspondence
Figure 2 for Class-aware Sounding Objects Localization via Audiovisual Correspondence
Figure 3 for Class-aware Sounding Objects Localization via Audiovisual Correspondence
Figure 4 for Class-aware Sounding Objects Localization via Audiovisual Correspondence
Viaarxiv icon