Alert button

Matching Papers and Reviewers at Large Conferences

Add code
Alert button
Mar 02, 2022
Figure 1 for Matching Papers and Reviewers at Large Conferences
Figure 2 for Matching Papers and Reviewers at Large Conferences
Figure 3 for Matching Papers and Reviewers at Large Conferences
Figure 4 for Matching Papers and Reviewers at Large Conferences

Share this with someone who'll enjoy it:

This paper studies a novel reviewer-paper matching approach that was recently deployed in the 35th AAAI Conference on Artificial Intelligence (AAAI 2021), and has since been adopted by other conferences including AAAI 2022 and ICML 2022. This approach has three main elements: (1) collecting and processing input data to identify problematic matches and generate reviewer-paper scores; (2) formulating and solving an optimization problem to find good reviewer-paper matchings; and (3) the introduction of a novel, two-phase reviewing process that shifted reviewing resources away from papers likely to be rejected and towards papers closer to the decision boundary. This paper also describes an evaluation of these innovations based on an extensive post-hoc analysis on real data -- including a comparison with the matching algorithm used in AAAI's previous (2020) iteration -- and supplements this with additional numerical experimentation.

Share this with someone who'll enjoy it: