The author expresses shock at the frequent hallucinated citations by LLMs in academic papers, leading to incorrect author lists. They question the lack of respect for research and the need for harsher penalties, asking if others are experiencing the same issue.
Um autor descreve enfrentar um avaliador extremamente antiprofissional no ICML 2026, que utilizou referências falsas, ataques pessoais e argumentos sem sentido para desqualificar seu trabalho. O autor busca orientação sobre como intervir contra um avaliador que emprega citações fraudulentas e ataques ad hominem no processo de revisão por pares.
This content discusses the submission of code alongside papers for NeurIPS 2026, with the author torn between the boost in credibility and concerns about plagiarism. The post seeks community opinions on this practice.
A UC Berkeley team demonstrated how to exploit flaws in eight AI agent benchmarks by manipulating evaluation methods. This raises serious questions about the integrity of AI evaluation, as benchmarks rely on a vulnerable "honor system."
LLM-based agents are increasingly used in scientific data analysis, but risk generating plausible analyses optimized for publishable positive results. This paper proposes that non-experimental claims produced with agentic assistance be evaluated under a falsification framework to ensure scientific rigor.
This paper argues against using current AI systems for peer review, identifying two critical issues: a "hivemind effect" that reduces perspective diversity and the trivial gameability of AI review scores through paper rewriting. Empirical comparison of human- versus AI-generated reviews shows that AI reviewers are susceptible to stylistic changes rather than scientific merit, highlighting the need for non-gameability and review diversity for automation.
A user raises concerns about an alleged influential Chinese network in AI conferences (like IJCAI) practicing nepotism and rejecting papers from non-Chinese authors. The author shares a personal experience where a reviewer demanded a citation to a paper by a Chinese lead author.