← All projects Project / 03

Tooling · 2026

Orchestra

Design-focused AI agent harness for software developers. Connects your locally run agents to your phone.

Interactive prototype · design system in use

The problem

Every agent still needs a supervisor.

Anyone who has built with AI agents knows the work doesn't end once you've said what to build. It turns into supervision: “build that,” “review it,” “plan the fixes,” “apply the fixes,” “now review the plan.” Days of that, for a single feature.

I wanted to turn that supervision into reusable instructions: what an agent needs to know, how it checks its work, and when the next phase begins. The challenge was making that process work for any coding task.

A handwritten notebook page mapping instructions through planning, task expansion, implementation, and review
Planning Orchestra’s first version, October 2025: a series of PowerShell dispatcher scripts designed to handle any task.

The approach

Turn repeated instructions into a system.

Every agent starts with instructions. I used to write each set by hand, but the same tasks kept coming up: planning fixes, reviewing code, and checking results. Orchestra turns those recurring patterns into instructions that adapt to each task.

Bash scripts coordinate the process, managing files, launching agents, and moving the work forward.

When an agent finishes, it signals completion through a flag file, like ringing a bell. Orchestra detects that signal, closes the agent’s window, and starts a fresh agent with instructions for the next phase.

A single Dispatcher at work — spawning agents, watching for completion flags, and handing the next phase to a fresh agent.

The hard part

Coordinating models, limits, and projects.

  1. Working within weekly limits. Orchestra swaps in suitable agents to make better use of multiple subscriptions. The /crosstalk and /throttling scripts let agents spawn one another and check usage by reading their terminals, much as a person would.
  2. Managing several projects at once. The /pm agent now operates my dispatchers across projects. It keeps up better than I could: monitors feed it events from every dispatcher and subagent, giving it a live view of the whole fleet.
  3. Finding out what each model can do. Company benchmarks can favor their own models, so I run my own A/B tests on real coding tasks. The studies section records how the models compare and which jobs I can trust them with.
Model findings
01 / 02

Discovery & planning

Claude

Opus 4.8

Sets the direction: discovering what matters, drafting plans, and questioning them before the build begins.

From the studies 85 / 100

The Opus baseline score in the lead-chair study. Discovery and planning stayed with Claude.

Read the study
Role fit0–100
Claude: editorial role-fit assessment Discovery: 94. Planning: 96. Build: 82. Review judgment: 38. Grounding: 90. Cost efficiency: 60. Faint outlines show the other models. Discovery 94 Planning 96 Build 82 Review judgment 38 Grounding 90 Costefficiency 60
TrialsFindingsRoles

Editorial scores from the lab’s studies and role assignments.

Players · 29 Aug 2026
Where each model fits, informed by the Orchestra lab’s studies.

Outcome

The engine behind my daily development.

More than 1,600 commits; it now drives my own development across the projects on this site — and it is the product behind the enterprise pitch below.

ONE BRIEF IN → A FINISHED PRODUCT OUT AUDIT DAEMON continuous multi-model review rotates Haiku · Codex · Sonnet · Gemini watches the whole run RESEARCH market & competitor SPEC one brief in ORCHESTRATOR persistent operator coordinates the fleet PIPELINE BUILD PIPELINE spec → plan → build → review ↻ WEB ARM site & landing page ↻ SHIPPED PRODUCT app · website PITCH-DECK deck & narrative flag-file signals · every artifact versioned in git · no chat lock-in
One brief in, a finished product out — an orchestrator feeding a build pipeline and a web arm, with an audit daemon watching the whole run.

Presentation design · pitch deck, in progress

Turning a complex system into a clear pitch.

A fifteen-slide presentation explaining Orchestra’s workflow, model coordination, and value to engineering teams. Design and messaging are still being refined.

Slide 1 of 15: Your AI models, conducted as one engineering system.
Cover
Slide 01 / 15
Open the original deck ↗
Cover
Slide 01 / 15
← → Browse · Esc Close
Next project scriptgen
Visit website orchestra-www.vercel.app