Summary
ScienceBuddy turns researcher requests, feedback and execution evidence into new tasks and evaluation rubrics. Its inner loop edits the agent harness while holding the model fixed; an outer loop reinforces the model under the improved harness. The authors release the workspace and code with case studies across four scientific task families. The evidence remains a small author-run set rather than an independent productivity study.
Why it matters
For teams building research agents, this is a concrete design for learning from normal interactive use without mixing harness changes and model updates into one opaque loop. Trial the trace-to-rubric workflow before adopting recursive model training. Keep human review and held-out evaluations because user feedback can encode local preferences or mistakes.
Technical details
| Loops | inner harness evolution with fixed model; outer reinforcement learning with improved harness |
|---|---|
| Interface | chat, trajectory timeline, compute and result panels |
| Evaluation | case studies across four scientific task families |
| Availability | public product site and GitHub repository |
| Limitation | author-run case studies; no independent productivity or safety evaluation |
Tags
research-agentself-improvementharnessreinforcement-learningopen-source