TheMachine Press

A daily newspaper for the age of artificial intelligence.

Morning editionPermanent story

benchmarks evals

Biomedical Agents Meet Rebuilt Research Tasks

BioXArena-Pro holds out biological units and finds that scaffolding matters nearly as much as the model.

Published Updated Story ID: mp-2026-11-12-019
Read the complete editionStory JSON

Summary

BioXArena-Pro holds out biological units and finds that scaffolding matters nearly as much as the model.

BioXArena-Pro rebuilds 64 modeling tasks across eight biomedical domains, usually holding out whole species or cohorts. Across 22 agent configurations the best score was 55.1 of 100, and removing pretrained biological models cost nine points on tasks where the leading agent used them.

Why it matters

BioXArena-Pro holds out biological units and finds that scaffolding matters nearly as much as the model.

Limits and context

No additional limitation was separately recorded.

Key claims

  1. BioXArena-Pro holds out biological units and finds that scaffolding matters nearly as much as the model.

    Evidence: source-2026-11-12-021

Sources

  1. arXiv:2611.13994v1arXiv / Cornell University · primary research

Corrections

No corrections have been recorded for this story.