LLMs surpass humans in predicting which neuroscience experiments will succeed (81% vs 64%)

We can accelerate discovery and reduce waste with AI-guided research.

BrainBench beats humans in predicting the outcome of neuroscience experiments

A new study by Xiaoliang Luo and colleagues has shown that large language models (LLMs) can predict which neuroscience experiments are likely to yield positive findings more accurately than human experts. Interestingly, the researchers used a mere GPT-3.5 class models with 7 billion parameters and found that fine-tuning these models on neuroscience literature further improved their performance.

In this article, I'll explain why this is such a big deal and how the researchers were able to build a system that not only out-predicted humans, but can help them narrow down where they should focus their research. Let's begin!