That is pretty much my rebuttal, along with previous work in CV suggesting that it might not work as well because one the main hypothesis does not seem to hold in image.

​

But they decreased their grade because we did not provide experiment in CV :(

I had a difficult discussion on an NLP paper I submitted with a reviewer whose sole argument for rejecting the paper is, "you did not try your method in computer vision". (Even though it beats all baselines and SOTA in NLP, on a broader NLP benchmark than all previous works).

I hope the AC will step in and will not take this review into account :(

The same is happening to me. My supervisors just told me that it happens and that we can't do anything...