I recently reviewed one ICLR paper. The opinions about the paper are somewhat diversed. The area chair then arranged a meeting with all reviewers to finalize the idea to accept or reject the paper. The area chair said it's his/her first time doing this kind of meeting as well.

Due to the concerns of breaking anonymity and peer pressure, I am wondering is it allowed for the area chair to ask all reviewers to participate in a meeting to discuss the decision of a paper?

Comments

You must log in or register to comment.

fastglow t1_iyeylms wrote on November 30, 2022 at 10:02 PM

#830,253

I agree with your concerns. ICLR's reviewer's guide states that "During the discussion phase, reviewers, authors and area chairs engage in asynchronous discussion, and authors are allowed to revise their submissions to address concerns that arise." Note the word asynchronous. I think everything should be done on OpenReview, not through outside, off-the-record discussions. I would express my concerns to the AC, and perhaps to the PCs if necessary.

Least_Pollution7078 OP t1_iyf6o0t wrote on November 30, 2022 at 10:59 PM

#833,824

Replying to fastglow (#830,253)

Thank you for your response. After reading the guide on area chair more carefully, ICLR2023 actually requires virtual meeting for "borderline paper" starting this year.

fastglow t1_iyf7w07 wrote on November 30, 2022 at 11:08 PM

#834,439

Replying to Least_Pollution7078 (#833,824)

Ah! I did not know that (and have never done that as a reviewer). I can't say I agree with the new process, but you have your answer.

trnka t1_iyfc1dj wrote on November 30, 2022 at 11:39 PM

#836,689

If it were me as the reviewer, I wouldn't mind so long as the time is ok, like a half hour when I don't have anything else scheduled. It might be faster and easier than long threads online. But also I'm accustomed to dealing with pressure.