AI Can Learn Scientific Taste
About
Scientific discovery depends on expert judgement and foresight, which we call scientific taste: the ability to judge and propose research ideas with potential for long-term scientific impact. Whether AI can learn this ability remains an open question. Here we provide evidence that artificial intelligence can learn judgement and ideation. We introduce Reinforcement Learning from Community Feedback (RLCF), a training paradigm that uses large-scale signals from scientific community as supervision. We first train Scientific Judge on field- and time-matched pairs of high- vs. low-citation papers to judge ideas. We then train a Scientific Thinker, to propose research ideas with high potential impact. Experiments show that the 30B Scientific Judge variant outperforms strong LLM baselines (e.g., GPT-5.4 Thinking), while Scientific Judge generalizes across future-year papers, unseen fields, and other community metrics. Furthermore, Scientific Thinker proposes research ideas with higher potential impact than baselines. These results suggest that AI can learn scientific taste, marking an important step towards AI systems that could help accelerate scientific discovery.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Scientific judgment (Pairwise citation prediction) | SciJudgeBench in-domain (test) | CS Pairwise Accuracy87.9 | 22 | |
| Prospective paper impact forecasting | arXiv October 2025 | Top-5 Accuracy40 | 12 | |
| Prospective paper impact forecasting | arXiv (November 2025) | Top-5 Accuracy26.7 | 12 | |
| Scientific Impact Forecasting | arXiv June 2024 to November 2025 (temporal out-of-distribution (OOD)) | Forecast Score (2025.08)0.226 | 12 | |
| Prospective paper impact forecasting | arXiv June 2025 - November 2025 Average | Top-5 Accuracy22.2 | 12 | |
| Prospective paper impact forecasting | arXiv August 2025 | Top-5 Accuracy13.3 | 12 | |
| Prospective paper impact forecasting | arXiv September 2025 | Top-5 Accuracy0.00e+0 | 12 | |
| Prospective paper impact forecasting | arXiv January 2025 | Top-5 Accuracy40 | 11 | |
| Prospective paper impact forecasting | arXiv July 2025 | Top-5 Accuracy33.3 | 11 | |
| Prospective paper impact forecasting | arXiv December 2024 - May 2025 Average | Top-5 Accuracy13.6 | 11 |