From prototype to infrastructure
The gap between an impressive agent demo and a dependable production system has almost never been model quality. It has been state: what happens when step seven of a twelve-step task fails because a downstream API returned a five hundred error at an inconvenient moment.
Anthropic’s tooling now answers that question directly. Runs are checkpointed after each completed step and can resume from the last good state, which means a deployment, a crash or a transient outage no longer forces a full restart of expensive work.
That single property is what turns agents into something an operations team can put on a rota rather than something an engineer babysits.
Schema-validated tool calls
Tool definitions are validated before execution, and arguments that do not conform are rejected and returned to the planner for correction rather than passed through to a live system.
In our testing across a six-tool workflow, this eliminated the most persistent failure mode in earlier agent frameworks: plausible-looking arguments for parameters that never existed. The model still occasionally proposes them; the executor simply refuses.
The pattern is not new — separating planning from deterministic execution has been recommended practice for two years — but having it enforced by the platform rather than reimplemented by every team is a meaningful reduction in shared effort.
Observability as a first-class feature
Each run emits a structured trace covering the plan, every tool invocation, arguments, results, retries and timing. Traces are queryable, which makes it possible to answer questions like which tool causes the most retries across all runs this week.
For teams running agents against customer-facing workflows, this is the difference between a support ticket that takes ten minutes to diagnose and one that takes three days.
Cost behaviour in real workloads
We rebuilt a support triage workflow with eleven steps and measured cost across one thousand runs. Short, tightly scoped tool calls with narrow outputs were roughly forty percent cheaper than an equivalent loop that gave the agent broad latitude and large tool responses.
The lesson is familiar to anyone who has optimised a distributed system: constrain the interface. Agents given smaller, sharper tools behave better and cost less than agents given one powerful tool and an encouraging prompt.
Teams should budget for an evaluation harness alongside the agent itself. Without it, cost regressions arrive silently through prompt changes nobody measured.
Where agents still struggle
Long-horizon tasks with ambiguous success criteria remain unreliable. Anything where a human would ask a clarifying question tends to produce confident, wrong completion rather than a request for guidance.
The practical mitigation is to make escalation legal and cheap: give the agent an explicit path to hand off to a human, and reward that path in evaluation rather than penalising it as a failure.
Adoption outlook
Expect the strongest early adoption in operations-heavy functions — finance reconciliation, support triage, compliance review — where tasks are repetitive, well-specified and expensive in human hours.
Customer-facing autonomous agents will lag, and reasonably so. The reliability bar for an agent talking directly to your customers is far higher than for one drafting an internal reconciliation summary.
Comments (0)
Discussion is opening soon. Be the first to comment.