developer tools
One Agent Workflow Ran Three Different Ways
A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.
Summary
A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.
The reported platform emerged from Amazon’s Rufus assistant, where real-time serving, background tasks and high-volume evaluation normally require different runtimes. Developers define one typed dataflow graph, which is then bound to in-process streaming, durable AWS SWF orchestration or distributed Apache Flink processing. Language-model calls become suspendable nodes whose delivery, retry and batching semantics follow the selected substrate. Dozens of production configurations across five orchestration patterns showed no detectable output-quality difference across bindings, while batch execution reduced inference cost in line with published batch pricing. The evidence is an engineering report from one production ecosystem rather than a cross-platform standard.
Why it matters
A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.
Limits and context
No additional limitation was separately recorded.
Key claims
A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.
Evidence: source-2026-09-09-007
Sources
- arXiv preprint 2609.06128arXiv · primary research
Corrections
No corrections have been recorded for this story.