Submitted by von_oldmann t3_z1dc1g in MachineLearning
AISTATS 2023 reviews are out, creating a thread for discussion!
Submitted by von_oldmann t3_z1dc1g in MachineLearning
AISTATS 2023 reviews are out, creating a thread for discussion!
2 might be an outlier considering your other scores! Not really sure how this could happen. But I hope it pans out for you
I'm in a very similar situation myself. I'm not very hopeful that I can change their mind with a rebuttal. Gonna try and hope the meta-reviewer realizes how much that reviewer missed the mark. I hope AISTATS is still small enough for that much attention to detail (I know it's not just let me cope).
i think you still have a chance
New to this, no idea what it means when a reviewer misses to review - any guidance ?
The email said that more reviews might be added before Nov 23rd, so you might still get them.
Ahh thanks !
We got 6,6,6,6,6,4,7, any chance?
and they say there is a shortage of reviewers
This is Indeed strange. How does sisters decide how many reviews for one paper?
I think a meta reviewer fucked up. Maybe to eager on emergency reviews?
You’re good. Address the comments on the 5 and it’s 100%…honestly even with out that you’re fine
4 7 6 3 9 with confidence 2 3 3 2 4.
Holy this is the reviews with largest range and variance that I got. A nice rebuttal might save my ass.
Well, your two lowest scores also come with the lowest confidence. I think you've nothing to worry about.
Good luck to everybody for the next steps.
How is the confidence calculated here? Do the reviewers decide it themselves or it is based on a reviewer's consensus with other reviewers' decisions among all their reviews?
The reviewers decide the confidence themselves
Thank you for the explanation.
2 6 6 7 with confidence scores,
5 4 2 4
Reviewer 1 also clearly misunderstood the paper.
What are my chances?
2 out of 5 reviewers miss. Will that be possible to add new reviews?
Chances with 4,5,6,7,8 ?
100% depends on your rebuttal. Show that you understood the low reviews and improved your paper in consequence. Or if a bad review is nonsensical make it clear with line ref and citations.
Thanks, how is the usual average ?
Papers are not selected based on their average, but wether or bot there is a consensus towards acceptance. Show the meta reviewers that you can meaningfully address the reservations of the 4 and 5, or show that they are not valid (be very careful with this route).
Based on the scores, the scale tips in your favor. But the rebuttal will be critical.
Got 6 reviewers ...how to reply in only a 1-page pdf...
64673
7 has confidence 2, rest all are of confidence 4.
The reviews are really well thought out, and recommend some good experiments, also highlight some weaknesses. Some also praise the cleverness and intuitiveness of the idea, and already thorough experiments!
I guess the new experiments will take some time to finish and update (one even asked for a user study!), so not sure whether I will be able to put new results in the rebuttal. But I suppose, the suggestions could make it a stronger submission next time! Does providing new supporting results really help during the rebuttal?
[deleted]
Got only two reviews. Been checking cmt every hour since there won't be any notification of the added review. :\
9 and 3, both confidence of 4 lol fortunately, the other reviewers are also more positive
got 64686, what are the chances?
I want to congratulate you...
reviewer with score 4 would increase the value from the sound rebuttal process.
Got 77655 with confidence 33444...
Coin toss?
A lot of the reviews posted here seem pretty good (mean around 6, which is toward acceptance on the scale), why are these papers considered borderline? Based on how noisy the process is it seems unlikely for a paper to get all accepts across the board...
Any chance with 4 5 6 7 7 ?
5 5 4 5 4 (confidence: 3 2 5 4 4). Any chance of acceptance if we address the concerns (mainly more experiments)?
55546(44434) here…I am personally pessimistic already : (
Any guide on the norms of writing a rebuttal? This is my first time writing one, so sample rebuttals will be really appreciated!
Tim rockatchsel ucl shared a really good guide on twitter!
[removed]
ok so if I assume that the replies here are a random sample, then basically a high percentage of people get contradictory reviews (Some very high and some very low).
I got 77744 with confidence 23344. What on earth is happening? I don’t know what my chances are but how is it possible for papers to get so different ratings?
what is the chance for 67676
As a reviewer, when can you see the reviews from other reviewers in CMT for AISTATS? If I remember correctly from last time, it was the same time as they were released to the authors.
Please update when you do:)
Are there instructions for format/length of rebuttal?
​
edit: nevermind, found the template at the bottom of the FAQ
Outside-Fun-4954 t1_ixaeo4j wrote
76825
Got 2 I think I have no chance :(