AACL-IJCNLP 2026 · Accepted Tutorial

AI Scientist Persistent Scientific Systems

From workflow agents to persistent systems with memory, novelty verification, scientific infrastructure, embodied experimentation, epistemic reliability, and human governance.

Three-hour tutorial November 6–10, 2026 Hengqin, China
Scroll to begin
§ 01 · Premise

From autonomous workflow agents to persistent scientific systems.

AI Scientists are evolving from autonomous workflow agents that automate a research pipeline into persistent scientific systems that maintain long-horizon research state, verify novelty against the prior literature, track experimental provenance, execute in real or simulated laboratories, and collaborate with human scientists across iterative discovery loops.

The view that dominated 2025 — an AI Scientist as an autonomous agent that runs an end-to-end research pipeline (autoresearch, AI-Researcher) — has given way to a view in which the AI Scientist is treated as a persistent scientific system (LabOS, DeepScientist, Lumilab, Rethinking the AI Scientist). The hard problems have shifted from agent orchestration to research-state evolution, novelty verification, scientific infrastructure, embodied execution, epistemic reliability, and scientist-in-the-loop governance.

The literature is fragmented across NLP, ML, agent, and domain-specific venues, and is organized around outdated framings like “end-to-end automation” or “multi-agent debate.” These framings obscure the actual frontier.

This tutorial reframes AI Scientist research around six concerns: persistent systems, literature discovery and novelty verification, scientific infrastructure, embodied scientific interaction, reliability and provenance, and human governance.

You leave with a compact field map of the six concerns, a reusable vocabulary that separates agent architecture from scientific infrastructure, a curated reading list, classroom-ready slides, and a minimal AI Scientist walkthrough notebook that reads a paper, generates a hypothesis, runs an experiment, and produces a report.

§ 02 · Outline

Seven blocks across the six concerns.

From motivating cases through persistent systems, novelty verification, scientific infrastructure, embodied science, reliability, and human governance.

Module 01 · 15 min

Welcome & Motivating Cases

Concrete cases: a citation-hallucinating drafting agent; a coding agent that cannot reproduce its own result; a biomedical agent that proposes a CRISPR screen and hands the protocol to a human collaborator; and a long-horizon system with branching, failed paths, and human takeover.

Module 02 · 25 min

Scientific Research as a Persistent System

The central reframing of the tutorial. An AI Scientist is not a one-shot pipeline but a persistent system that maintains long-horizon state: hypothesis lineage, experiment graphs, scientific memory, research branching. We compare DeepScientist, Lumilab, and Rethinking the AI Scientist against autoresearch and AI-Researcher.

Module 03 · 25 min

Literature Discovery & Novelty Verification

Idea generation is cheap; novelty validation is hard. Learned idea comparators that outperform GPT-5; literature similarity filtering integrated into end-to-end systems; AutoResearchBench; citation grounding and faithfulness; hypothesis validation in AI co-scientist.

Module 04 · 30 min

Scientific Infrastructure & Execution Environments

Recent systems are best understood as research operating systems: persistent execution environments, sandboxing, experiment caching, artifact lineage, and provenance tracking. Biomni as canonical action space; SARE; MiroFlow. Closes with a live walkthrough in which attendees examine common failure modes (hallucinated novelty, broken provenance, and irreproducible results) in real execution traces.

Module 05 · 25 min

Embodied & Real-World Scientific Interaction

Scientific reasoning is not text reasoning. AI-XR co-scientists in the laboratory (LabOS); embodied scientific benchmarks (LabUtopia); agentic wet-lab automation (CRISPR-GPT, Biomni). The NLP problems that surface when language models talk to instruments, robots, and human collaborators.

Module 06 · 30 min

Reliability, Provenance & Scientific Epistemics

Not whether a system produces a research artifact, but whether the artifact is epistemically reliable. Provenance, falsification, calibrated uncertainty, reproducibility, hallucinated novelty, benchmark leakage. ResearchGym, ResearchClawBench, Scientist-Bench, AutoResearchBench, VeriTrace.

Module 07 · 30 min

Human-Governed AI Scientists

Human governance is not a safety appendix but a core architectural concern. Four design patterns: branching workflows, checkpoint approval, interactive refinement, co-scientist loops. LabOS, DeepScientist, Rethinking the AI Scientist. Closes with Q&A and open problems.

AI Scientists are evolving from autonomous workflow agents into persistent scientific systems that maintain long-horizon research state, verify novelty, track provenance, execute in real or simulated laboratories, and collaborate with human scientists across iterative discovery loops.

Persistent Scientific Systems

§ 03 · Audience

Self-contained at the conceptual level.

Accepted at AACL-IJCNLP 2026 · November 6–10, 2026 · Hengqin, China.

Who Should Attend

Researchers, Ph.D. students, advanced master's students, and industry practitioners working on language agents, tool learning, RAG, deep research, evaluation, scientific NLP, and applied LM systems.

Expected Background

  • LLMs & prompting
  • Chain-of-thought reasoning
  • Retrieval-Augmented Generation
  • Tool use & agent frameworks
Helpful · Basic Python Helpful · LangChain / LangGraph

AACL-IJCNLP 2026

The conference will be held in hybrid format and physically in Hengqin, China, from November 6 to 10, 2026. The specific tutorial date and room will be posted when announced.

§ 04 · Reading List

A curated path through the AI Scientist landscape.

Organized by tutorial workflow — pre-readings recommended before attending, additional readings for broader background. Links will be added as releases become public.

Pre-reading recommended before the tutorial
Additional broader background for self-study

1.Field Maps and Surveys

Pre-reading

  • AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery.Paper Survey covering provenance, validation, accountability, and workflow-level automation
  • A Survey of AI Scientists.Paper Guiyao Tie, Pan Zhou, Lichao Sun — arXiv:2510.23045

Additional reading

  • Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directions.Paper Survey across chemistry, materials, biology, and physics

2.Scientific Research as a Persistent System

Pre-reading

  • Rethinking the AI Scientist: Interactive Multi-Agent Workflows for Scientific Discovery.Paper Persistent world state, interactive investigation, human checkpoints
  • DeepScientist — Local-First Persistent Research Workflows.Repo ResearAI — branching, preserved failed paths, human takeover

Additional reading

  • autoresearch — an automated research loop for overnight ML experiments.Code Andrej Karpathy — the one-shot pipeline baseline we contrast against

3.Literature Discovery & Novelty Verification

Pre-reading

  • AutoResearchBench: Benchmarking AI Agents on Complex Scientific Literature Discovery.Paper Isolates scientific literature discovery as a core capability
  • Forecasting Research Success Through Learned Comparison of Scientific Ideas.Paper Srujan P. Mule, Aniketh Garikaparthi, Manasi Patwardhan

Additional reading

  • Towards an AI Co-Scientist.Paper Juraj Gottweis, Wei-Hung Weng, et al. (Google DeepMind)

4.Scientific Infrastructure & Execution Environments

Pre-reading

  • Biomni: A General-Purpose Biomedical AI Agent.Paper Kexin Huang, Serena Zhang, Hanchen Wang, Yuanhao Qu, Yingzhou Lu, Yusuf Roohani, et al.
  • Lumilab: AI-Native Scientific Lab Infrastructure.Paper Scientific operating systems and long-term state

Additional reading

  • Self-Adapting Agents for Automating Research Coding Workflows (SARE).Paper Balaji Dinesh Gangireddi, Aniketh Garikaparthi, Manasi Patwardhan, Arman Cohan — ICLR 2026 RSI

5.Embodied & Real-World Scientific Interaction

Pre-reading

  • LabOS: The AI-XR Co-Scientist That Sees and Works With Humans.Paper Le Cong, David Smerkous, Xiaotong Wang, Di Yin, Zaixi Zhang, et al.
  • LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents.Paper Rui Li, Zixuan Hu, Wenxi Qu, Jinouwen Zhang, Zhenfei Yin, Sha Zhang, et al.

Additional reading

  • CRISPR-GPT for Agentic Automation of Gene-Editing Experiments.Paper Yuanhao Qu, Kaixuan Huang, Ming Yin, Kanghong Zhan, Dyllan Liu, et al. — Nature Biomedical Engineering

6.Reliability, Provenance & Scientific Epistemics

Pre-reading

  • ResearchGym: Evaluating Language Model Agents on Real-World AI Research.Paper Aniketh Garikaparthi, Manasi Patwardhan, Arman Cohan
  • VeriTrace: Provenance Evaluation for AI Scientist Systems.Paper Provenance evaluation as a core capability

Additional reading

  • ResearchClawBench: From Re-Discovery to New-Discovery.Repo InternScience

7.Human-Governed AI Scientists

Pre-reading

  • Rethinking the AI Scientist: Interactive Multi-Agent Workflows for Scientific Discovery.Paper Persistent world state, interactive investigation, human checkpoints
  • LabOS: The AI-XR Co-Scientist That Sees and Works With Humans.Paper Le Cong et al.

Additional reading

  • DeepScientist — branching, failed paths, human takeover.Repo ResearAI

§ 05 · Organizers

Built by a team spanning SJTU, UGA, Stanford, and Oxford.

Four presenters and a senior advisor · agents, multi-agent systems, AI Scientists, and computer vision.

Presenters

Wanghan Xu
Wanghan Xu

Shanghai Jiao Tong University · Stanford

Yifan Zhou
Yifan Zhou

University of Georgia

Zhenfei Yin
Zhenfei Yin

University of Oxford

Yingcheng Charles Wu
Yingcheng Charles Wu

Stanford University

Advisory Board

Philip Torr
Philip Torr

University of Oxford