Alert button

Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interference

Nov 29, 2022
Yabin Wang, Zhiheng Ma, Zhiwu Huang, Yaowei Wang, Zhou Su, Xiaopeng Hong

Figure 1 for Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interference
Figure 2 for Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interference
Figure 3 for Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interference
Figure 4 for Isolation and Impartial Aggregation: A Paradigm of Incremental Learning without Interference

Share this with someone who'll enjoy it:

This paper focuses on the prevalent performance imbalance in the stages of incremental learning. To avoid obvious stage learning bottlenecks, we propose a brand-new stage-isolation based incremental learning framework, which leverages a series of stage-isolated classifiers to perform the learning task of each stage without the interference of others. To be concrete, to aggregate multiple stage classifiers as a uniform one impartially, we first introduce a temperature-controlled energy metric for indicating the confidence score levels of the stage classifiers. We then propose an anchor-based energy self-normalization strategy to ensure the stage classifiers work at the same energy level. Finally, we design a voting-based inference augmentation strategy for robust inference. The proposed method is rehearsal free and can work for almost all continual learning scenarios. We evaluate the proposed method on four large benchmarks. Extensive results demonstrate the superiority of the proposed method in setting up new state-of-the-art overall performance. \emph{Code is available at} \url{https://github.com/iamwangyabin/ESN}.

* This is the accepted version of the Paper & Supp to appear in AAAI 2023. Please cite the final published version. Code is available at https://github.com/iamwangyabin/ESN  
View paper onarxiv icon

Share this with someone who'll enjoy it: