What have we learned from OpenReview?
Copyright policy )What have we learned from OpenReview?
Abstract Anonymous peer review is used by the great majority of computer science conferences. OpenReview is such a platform that aims to promote openness in peer review process. The paper, (meta) reviews, rebuttals, and final decisions are all released to public. We collect 11,915 submissions and their 41,276 reviews from the OpenReview platform. We also collect these submissions' citation data from Google Scholar and their non-peer-reviewed versions from arXiv.org. By acquiring deep insights into these data, we have several interesting findings that could help understand the effectiveness of the public-accessible double-blind peer review process. Our results can potentially help writing a paper, reviewing it, and deciding on its acceptance.
- Northeastern University China (People's Republic of)
- NORTHEASTERN UNIVERSITY
- Northwestern University
- Northwestern University
- Northeastern University United States
FOS: Computer and information sciences, Information Systems and Management, FOS: Political science, Social Sciences, FOS: Law, Social psychology, Peer review, Decision Sciences, Data science, Artificial Intelligence, Psychology, Digital Libraries (cs.DL), Citation, Political science, Natural Language Processing, Management and Reproducibility of Scientific Workflows, Technical peer review, Openness to experience, Computer Science - Digital Libraries, Computer science, Process (computing), World Wide Web, FOS: Psychology, Operating system, Expert Finding in Online Communities, Computer Science, Physical Sciences, Internet privacy, Knowledge Sharing, Law, Information Systems
FOS: Computer and information sciences, Information Systems and Management, FOS: Political science, Social Sciences, FOS: Law, Social psychology, Peer review, Decision Sciences, Data science, Artificial Intelligence, Psychology, Digital Libraries (cs.DL), Citation, Political science, Natural Language Processing, Management and Reproducibility of Scientific Workflows, Technical peer review, Openness to experience, Computer Science - Digital Libraries, Computer science, Process (computing), World Wide Web, FOS: Psychology, Operating system, Expert Finding in Online Communities, Computer Science, Physical Sciences, Internet privacy, Knowledge Sharing, Law, Information Systems
selected citations These citations are derived from selected sources.This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).7 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Top 10% influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Average impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Average
Citations provided by BIP!Popularity provided by BIP!