Autoresearch
Usage
/autoresearch <idea>
What it does
Runs an autonomous experiment loop:
- Edit — Modify code or configuration
- Commit — Save the change
- Benchmark — Run evaluation
- Evaluate — Compare against baseline
- Keep or revert — Persist improvements, roll back regressions
- Repeat — Continue until the target is hit
Tracking
Metrics are tracked in:
autoresearch.md— Human-readable progress logautoresearch.jsonl— Machine-readable metrics over time
Controls
/autoresearch <idea> # start or resume
/autoresearch off # stop, keep data
/autoresearch clear # delete all state, start fresh
Example
/autoresearch optimize the learning rate schedule for better convergence