Inconsistency in Conference Peer Review: Revisiting the 2014 NeurIPS Experiment

Explore a detailed analysis of the 2014 NeurIPS peer review experiment in this informative video. Delve into the subjective nature of conference paper reviews, examining how well reviewers can predict future impact and the fate of rejected papers. Learn about the experiment's findings, including the lack of correlation between quality scores and citation counts for accepted papers, and the implications for assessing researcher quality. Gain insights into potential improvements for the reviewing process and understand the broader context of peer review in machine learning conferences.