OpenAI、専門家が作成した評価基準を用いた750タスクのライフサイエンス研究ベンチマーク「LifeSciBench」を公開

Most biology benchmarks ask narrow, fact-based questions with clean answers. Scientists weigh imperfect evidence and make decisions. OpenAI released LifeSciBench and it targets that gap directly.

Even the strongest model passes roughly one task in three. The benchmark is far from saturated.

What is LifeSciBench

LifeSciBench contains 750 expert-authored tasks. They span seven workflows and seven biological domains. Each task pairs a prompt, supporting artifacts, and a grading rubric.

The seven workflows cover evidence handling and analysis. They also include design and optimization, scientific reasoning, validation and operations, translation, and scientific communication.

The seven domains run from genomics and medicinal chemistry to clinical and translational science.

Tasks are written as a scientist would brief a colleague. They are free-response, not multiple-choice. Around 79% require multiple reasoning or decision-making steps, averaging four steps each.

How the Benchmark was Built

A cohort of 173 expert scientists wrote the tasks. Each held a Ph.D. and had biotechnology or pharmaceutical experience. Accepted tasks averaged six automated review cycles and at least two expert reviews.

Many tasks ship with artifacts. The benchmark includes 1,062 attached artifacts in total. About 53% of tasks require at least one artifact. Types include sequences, figures, tables, PDFs, and chemical structures.

A separate cohort validated quality. There were 453 reviewers, and 97% held doctorates. Overall agreement exceeded 96% on relevance, reasoning, grounding, and usefulness.

The Rubric System

Rubrics are the core mechanic here. They contain 19,020 criteria across the benchmark. That is roughly 25 criteria per task.

Each criterion rewards one concrete property. Examples include a specific fact, a reasoning step, or a numeric answer within tolerance. Grading runs against the rubric, not a single reference string.

Two metrics summarize performance. Normalized rubric score divides awarded points by total points. Task pass rate counts tasks scoring at or above 70%.

This separation matters for interpretation. A response can earn partial credit while still failing the task. The pass threshold is strict by design.

Here is the scoring logic in plain Python:

Copy CodeCopiedUse a different Browser

def grade(rubric, awarded_ids):

total = sum(c["pts"] for c in rubric)

earned = sum(c["pts"] for c in rubric if c["id"] in awarded_ids)

normalized = earned / total # partial credit

passed = normalized >= 0.70 # task-level success

return normalized, passed

How the Models Performed

OpenAI evaluated five models in a single-turn setting. Each model saw the prompt and artifacts once. Unrestricted internet browsing was permitted.

ModelNormalized scoreTask pass rate

GPT-Rosalind0.57636.1%

GPT-5.50.51925.7%

Gemini 3.1 Pro0.51523.6%

GPT-5.40.47920.7%

Grok 4.30.39913.0%

GPT-Rosalind, OpenAI’s domain-specialized model, led overall. It had the highest per-task mean on 386 of 750 tasks. It also lifted the overall pass rate over GPT-5.5, from 25.7% to 36.1%. Pass rates stayed modest across every model.

Rankings are not the whole story. Gemini 3.1 Pro uniquely led on 214 tasks. Aggregate scores can hide task-specific strengths.

Where Models Win, and Where They Fall Short

Models were strongest on structured judgment. GPT-Rosalind reached a 0.712 mean score on Translation. Scientific Communication scored 0.718, but that category is small, so read it cautiously.

Two workflows stayed hard. Design, Optimization, and Prediction was among the toughest, with GPT-Rosalind passing 30.7%. Analysis was close behind at 30.3%.

Artifact use was a clear bottleneck. GPT-Rosalind dropped from 45.1% on text-only tasks to 28.1% on artifact tasks. GPT-5.5 fell the same way, from 29.9% to 21.9%.

Exact outputs were hardest of all. Sequence and structure criterion success ranged from 46.9% to 18.0% across models. GPT-Rosalind’s gain over GPT-5.5 on generate/construct items was just +0.001.

Models also stalled mid-task. For GPT-Rosalind, 109 tasks earned at least 50% rubric credit but still passed below 20%.

Headroom remains large. No model passed 171 tasks (22.8%). And 261 tasks (34.8%) had a best-model pass rate below 20%.

Strengths and Weaknesses

Strengths:

Broad coverage across seven workflows and seven biological domains

Expert-authored rubrics with 19,020 atomic, gradeable criteria

Realistic artifacts: sequences, figures, tables, PDFs, and structures

Independent validation by 453 expert reviewers, 97% with doctorates

Weaknesses:

Single-turn only; real research is iterative and multi-turn

Built by OpenAI, which also supplies most evaluated models

Public release may be limited by safety and licensing constraints

750 tasks cannot cover every scientific specialty

Try It: Interactive Rubric Grader Demo

@import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;500;700&display=swap');

/* ---- hard reset, scoped to the widget only ---- */

#lsb-root, #lsb-root *, #lsb-root *::before, #lsb-root *::after{

box-sizing:border-box !important;

margin:0 !important; padding:0 !important;

font-family:'JetBrains Mono', ui-monospace, "SFMono-Regular", Menlo, Consolas, monospace !important;

letter-spacing:normal !important; text-shadow:none !important; float:none !important;

}

#lsb-root{

--green:#76B900; --bg:#111111; --panel:#171717; --panel2:#1e1e1e;

--line:#2a2a2a; --txt:#e8e8e8; --mut:#8a8a8a; --red:#e0533d;

display:block !important;

background:var(--bg) !important; color:var(--txt) !important;

max-width:920px !important; width:100% !important; margin:0 auto !important;

padding:16px !important; border-radius:8px !important; line-height:1.5 !important;

border:1px solid var(--line) !important;

}

/* suppress wpautop artifacts inside the widget */

#lsb-root p:empty{ display:none !important; }

#lsb-root br{ display:none !important; }

#lsb-root .lsb-head{ border:1px solid var(--line) !important; border-left:3px solid var(--green) !important;

background:var(--panel) !important; padding:16px 18px !important; border-radius:6px !important; }

#lsb-root .lsb-kicker{ color:var(--green) !important; font-size:11px !important; letter-spacing:2px !important; text-transform:uppercase !important; }

#lsb-root .lsb-title{ font-size:20px !important; font-weight:700 !important; margin:6px 0 4px !important; color:var(--txt) !important; }

#lsb-root .lsb-sub{ color:var(--mut) !important; font-size:12.5px !important; }

#lsb-root .lsb-tabs{ display:flex !important; gap:8px !important; margin:16px 0 !important; flex-wrap:wrap !important; }

#lsb-root button{ -webkit-appearance:none !important; appearance:none !important; cursor:pointer !important;

box-shadow:none !important; text-transform:none !important; min-height:0 !important; width:auto !important; line-height:1.5 !important; }

#lsb-root .lsb-tab{ border:1px solid var(--line) !important; background:var(--panel) !important; color:var(--mut) !important;

padding:9px 14px !important; border-radius:6px !important; font-size:12.5px !important; font-weight:500 !important; }

#lsb-root .lsb-tab.on{ color:var(--bg) !important; background:var(--green) !important; border-color:var(--green) !important; font-weight:700 !important; }

#lsb-root .lsb-card{ border:1px solid var(--line) !important; background:var(--panel) !important; border-radius:6px !important; padding:16px !important; }

#lsb-root .lsb-prompt{ background:var(--panel2) !important; border:1px solid var(--line) !important; border-radius:5px !important;

padding:12px !important; font-size:12px !important; color:#cfcfcf !important; margin-bottom:14px !important; }

#lsb-root .lsb-prompt b{ color:var(--green) !important; }

#lsb-root .lsb-grp{ margin-bottom:14px !important; }

#lsb-root .lsb-grp .lsb-h{ font-size:12px !important; color:var(--green) !important; text-transform:uppercase !important;

letter-spacing:1px !important; margin-bottom:8px !important; font-weight:700 !important; }

#lsb-root .lsb-crit{ display:flex !important; align-items:flex-start !important; gap:10px !important; padding:7px 9px !important;

border:1px solid var(--line) !important; border-radius:5px !important; margin-bottom:6px !important; cursor:pointer !important; background:var(--panel2) !important; }

#lsb-root .lsb-crit.sel{ border-color:var(--green) !important; background:rgba(118,185,0,.08) !important; }

#lsb-root .lsb-crit input{ margin-top:3px !important; accent-color:var(--green) !important; width:15px !important; height:15px !important; flex:0 0 auto !important; }

#lsb-root .lsb-crit .lbl{ font-size:12px !important; flex:1 !important; color:var(--txt) !important; }

#lsb-root .lsb-crit .pts{ color:var(--green) !important; font-weight:700 !important; font-size:12px !important; flex:0 0 auto !important; }

#lsb-root .lsb-presets{ display:flex !important; gap:7px !important; flex-wrap:wrap !important; margin-bottom:14px !important; align-items:center !important; }

#lsb-root .lsb-presets .cap{ font-size:11px !important; color:var(--mut) !important; }

#lsb-root .lsb-pbtn{ border:1px solid var(--line) !important; background:var(--panel2) !important; color:var(--txt) !important;

padding:7px 11px !important; border-radius:5px !important; font-size:11.5px !important; }

#lsb-root .lsb-score{ background:var(--panel2) !important; margin-top:8px !important; }

#lsb-root .lsb-meter{ display:flex !important; justify-content:space-between !important; align-items:baseline !important; margin-bottom:6px !important; }

#lsb-root .lsb-ptsbig{ font-size:26px !important; font-weight:700 !important; color:var(--txt) !important; }

#lsb-root .lsb-norm{ font-size:13px !important; color:var(--mut) !important; }

#lsb-root .lsb-bar{ height:14px !important; background:var(--bg) !important; border:1px solid var(--line) !important;

border-radius:20px !important; overflow:hidden !important; position:relative !important; }

#lsb-root .lsb-fill{ height:100% !important; background:var(--green) !important; width:0 !important; transition:width .25s ease !important; }

#lsb-root .lsb-thresh{ position:absolute !important; top:-3px !important; bottom:-3px !important; left:70% !important; width:2px !important; background:var(--red) !important; }

#lsb-root .lsb-threshlab{ font-size:10px !important; color:var(--red) !important; text-align:right !important; margin-top:3px !important; }

#lsb-root .lsb-badge{ display:inline-block !important; margin-top:10px !important; padding:6px 14px !important; border-radius:5px !important; font-weight:700 !important; font-size:13px !important; }

#lsb-root .lsb-pass{ background:var(--green) !important; color:var(--bg) !important; }

#lsb-root .lsb-fail{ background:rgba(224,83,61,.15) !important; color:var(--red) !important; border:1px solid var(--red) !important; }

#lsb-root .lsb-note{ font-size:11px !important; color:var(--mut) !important; margin-top:10px !important; }

#lsb-root .lsb-row{ margin-bottom:12px !important; }

#lsb-root .lsb-row .top{ display:flex !important; justify-content:space-between !important; font-size:12.5px !important; margin-bottom:4px !important; }

#lsb-root .lsb-row .nm{ color:var(--txt) !important; font-weight:700 !important; }

#lsb-root .lsb-row .val{ color:var(--green) !important; font-weight:700 !important; }

#lsb-root .lsb-lbar{ height:20px !important; background:var(--bg) !important; border:1px solid var(--line) !important; border-radius:5px !important; overflow:hidden !important; }

#lsb-root .lsb-lfill{ height:100% !important; background:linear-gradient(90deg,#4d7a00,var(--green)) !important; width:0 !important; transition:width .35s ease !important; }

#lsb-root .lsb-hide{ display:none !important; }

#lsb-root .lsb-foot{ margin-top:18px !important; padding-top:12px !important; border-top:1px solid var(--line) !important;

font-size:11px !important; color:var(--mut) !important; display:flex !important; justify-content:space-between !important; flex-wrap:wrap !important; gap:8px !important; }

#lsb-root .lsb-foot b{ color:var(--green) !important; }

@media(max-width:640px){

#lsb-root{ padding:10px !important; }

#lsb-root .lsb-title{ font-size:17px !important; }

#lsb-root .lsb-ptsbig{ font-size:22px !important; }

#lsb-root .lsb-crit .lbl{ font-size:11.5px !important; }

}

LifeSciBench — Interactive Demo

Rubric Grader & Model Leaderboard

See how rubric-based grading works on a real benchmark task. Toggle the criteria a model “got right” and watch the normalized score and 70% pass threshold update live.

Rubric Grader

Model Leaderboard

Task (Analysis — Spatial Transcriptomics): Using attached Visium data from an FFPE cervical cancer slide, cluster the spots into 4 k-means groups, annotate the dominant cell type per cluster, and recommend the 1–2 most promising targeted therapies (ADC, TCE, or CAR-T) based on antigen expression differences between tumor and non-tumor regions.

Simulate a response:

Strong

Partial

Weak

Clear all

0 / 76 pts

Normalized score: 0%

▲ 70% pass threshold (53.2 pts)

FAIL — below 70%

A response can collect partial credit yet still fail the task. That gap is exactly what LifeSciBench measures.

Task pass rate

Normalized score

Single-turn evaluation; unrestricted internet browsing permitted. GPT-Rosalind led overall but uniquely topped only 386 of 750 tasks; Gemini 3.1 Pro uniquely led on 214.

Built by Marktechpost · Data: OpenAI LifeSciBench preprint & release

Verified Jun 17, 2026

(function(){

var root = document.getElementById('lsb-root');

if(!root || root.getAttribute('data-init')) return;

root.setAttribute('data-init','1');

var RUBRIC = {

"Analysis":[

{id:"a1", lbl:"Identifies two clusters as tumor spots", pts:10},

{id:"a2", lbl:"Identifies one cluster as cancer-associated fibroblasts", pts:5},

{id:"a3", lbl:"Identifies one cluster as stromal spots", pts:5},

{id:"a4", lbl:"Identifies that there is no immune cluster", pts:10}

],

"Targeted therapies":[

{id:"f1", lbl:"Identifies F3 as a potential therapeutic target", pts:3},

{id:"f2", lbl:"90\u2013100% of tumor spots have F3 expression", pts:2},

{id:"f3", lbl:"80\u201390% of non-tumor spots have F3 expression", pts:1},

{id:"f4", lbl:"F3 odds ratio 11\u201313 (tumor vs non-tumor)", pts:1},

{id:"f5", lbl:"F3 specificity 12\u201316%", pts:2},

{id:"t1", lbl:"Identifies TROP2 as a potential target", pts:3},

{id:"t2", lbl:"Identifies HER2 as a potential target", pts:3},

{id:"t3", lbl:"Identifies NECTIN4 as a potential target", pts:3},

{id:"t4", lbl:"Identifies HER3 as a potential target", pts:3}

],

"Treatment recommendation":[

{id:"r1", lbl:"NECTIN4 would be a potential target for this patient", pts:5},

{id:"r2", lbl:"HER3 would be a potential target for this patient", pts:5},

{id:"r3", lbl:"Enfortumab vedotin may be considered (NECTIN4); not yet established SOC for cervical cancer", pts:6},

{id:"r4", lbl:"Patritumab deruxtecan would be a potential therapeutic", pts:6},

{id:"r5", lbl:"Checkpoint inhibitor efficacy may be limited (no immune cluster)", pts:3}

]

};

var TOTAL = 76, THRESH = 0.70;

var selected = {};

var PRESETS = {

strong:["a1","a2","a3","a4","f1","t1","t2","t3","t4","r1","r2","r3","r4","r5"],

partial:["a1","a4","f1","t1","t2"],

weak:["a1","f1"],

clear:[]

};

var groupsEl = root.querySelector('[data-groups]');

var ptsEl = root.querySelector('[data-pts]');

var normEl = root.querySelector('[data-norm]');

var fillEl = root.querySelector('[data-fill]');

var badgeEl = root.querySelector('[data-badge]');

var noteEl = root.querySelector('[data-note]');

function esc(s){ var d=document.createElement('div'); d.textContent=s; return d.innerHTML; }

function renderGroups(){

var html='';

for(var grp in RUBRIC){

if(!RUBRIC.hasOwnProperty(grp)) continue;

html += ''+esc(grp)+'

';

RUBRIC[grp].forEach(function(c){

var sel = !!selected[c.id];

html += ''

+ ''

+ ''+esc(c.lbl)+''

+ '+'+c.pts+'';

});

html += '

';

}

groupsEl.innerHTML = html;

}

function update(){

var pts=0;

for(var grp in RUBRIC){

if(!RUBRIC.hasOwnProperty(grp)) continue;

RUBRIC[grp].forEach(function(c){ if(selected[c.id]) pts+=c.pts; });

}

var norm = pts/TOTAL;

ptsEl.textContent = pts;

normEl.textContent = (norm*100).toFixed(1)+'%';

fillEl.style.setProperty('width', (norm*100)+'%', 'important');

if(norm>=THRESH){ badgeEl.className='lsb-badge lsb-pass'; badgeEl.textContent='PASS \u2014 meets 70% threshold'; }

else { badgeEl.className='lsb-badge lsb-fail'; badgeEl.textContent='FAIL \u2014 below 70%'; }

if(pts>0 && norm=THRESH) noteEl.textContent='Task passes. The response satisfies enough rubric criteria to count as a successful answer.';

else noteEl.textContent='A response can collect partial credit yet still fail the task. That gap is exactly what LifeSciBench measures.';

}

function refresh(){ renderGroups(); update(); }

// criterion toggle (event delegation; works for label or checkbox click)

groupsEl.addEventListener('click', function(e){

var lab = e.target.closest ? e.target.closest('.lsb-crit') : null;

if(!lab) return;

e.preventDefault();

var id = lab.getAttribute('data-id');

if(selected[id]) delete selected[id]; else selected[id]=1;

refresh();

});

// presets

root.querySelectorAll('[data-preset]').forEach(function(btn){

btn.addEventListener('click', function(){

selected = {};

PRESETS[btn.getAttribute('data-preset')].forEach(function(id){ selected[id]=1; });

refresh();

});

});

// panel tabs

var tabBtns = root.querySelectorAll('[data-tab]');

var panels = root.querySelectorAll('[data-panel]');

tabBtns.forEach(function(btn){

btn.addEventListener('click', function(){

var t = btn.getAttribute('data-tab');

tabBtns.forEach(function(b){ b.className = 'lsb-tab'+(b===btn?' on':''); });

panels.forEach(function(p){ p.className = 'lsb-card'+(p.getAttribute('data-panel')===t?'':' lsb-hide'); });

if(t==='leaderboard') drawLB();

});

});

// leaderboard

var MODELS=[

{name:"GPT-Rosalind", score:0.576, pass:0.361},

{name:"GPT-5.5", score:0.519, pass:0.257},

{name:"Gemini 3.1 Pro", score:0.515, pass:0.236},

{name:"GPT-5.4", score:0.479, pass:0.207},

{name:"Grok 4.3", score:0.399, pass:0.130}

];

var lbEl = root.querySelector('[data-lb]');

var curMetric='pass';

function drawLB(){

var max = curMetric==='pass'?0.40:0.60, html='';

MODELS.forEach(function(m){

var v=m[curMetric];

var label = curMetric==='pass' ? (v*100).toFixed(1)+'%' : v.toFixed(3);

html += ''+esc(m.name)+''

+ ''+label+'

'

+ '

';

});

lbEl.innerHTML = html;

}

root.querySelectorAll('[data-metric]').forEach(function(btn){

btn.addEventListener('click', function(){

curMetric = btn.getAttribute('data-metric');

root.querySelectorAll('[data-metric]').forEach(function(b){ b.className='lsb-tab'+(b===btn?' on':''); });

drawLB();

});

});

refresh();

drawLB();

})();

Check out t