Typical Workflow#
1. Choose inputs#
Define hypotheses, outcomes, factors, levels, and admissibility constraints.
2. Instantiate core objects#
Build a Study specification, including a typed DesignSpec, run budgets,
replication policy, and either agent/problem bindings or a standalone
ConditionRunner.
3. Execute or inspect#
Materialize conditions and execute runs. Each planned run immediately receives
a durable evidence record; started runs advance to running and normal
completion records success, failed, or skipped. Checkpointing is a
separate, optional resume facility. In interactive terminals, run execution
shows a tqdm progress bar by default.
Importing the package does not initialize notebook progress support; tqdm
is loaded only when a visible progress bar is requested.
4. Capture artifacts#
Export canonical artifacts (study manifest, conditions, runs, events,
evaluations) for downstream analysis. Use load_run_evidence_records to
inspect the versioned per-run source records from a later process. Treat the
output directory as the stable handoff unit and use Artifact Contract
when another repo or external tool is going to build against those files.
5. Compose the ecosystem seams#
Use top-level design_research_agents APIs to define participant behavior
and the stable design_research_agents.study facade for study-facing
execution and normalization. Use design_research_problems for task
definitions, then analyze exported outputs with design_research_analysis.
Why This Workflow Is Different#
This workflow is about experimental control, not only batch execution. The value is methodological: explicit admissibility, reproducible run construction, and traceable artifact contracts across the ecosystem.