TheMachine Press

A daily newspaper for the age of artificial intelligence.

Morning editionPermanent story

developer tools

One Agent Workflow Ran Three Different Ways

A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.

Published Updated Story ID: mp-2026-09-09-007
Read the complete editionStory JSON

Summary

A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.

The reported platform emerged from Amazon’s Rufus assistant, where real-time serving, background tasks and high-volume evaluation normally require different runtimes. Developers define one typed dataflow graph, which is then bound to in-process streaming, durable AWS SWF orchestration or distributed Apache Flink processing. Language-model calls become suspendable nodes whose delivery, retry and batching semantics follow the selected substrate. Dozens of production configurations across five orchestration patterns showed no detectable output-quality difference across bindings, while batch execution reduced inference cost in line with published batch pricing. The evidence is an engineering report from one production ecosystem rather than a cross-platform standard.

Why it matters

A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.

Limits and context

No additional limitation was separately recorded.

Key claims

  1. A production platform compiled the same typed graph to streaming, durable orchestration and batch execution without workflow-code changes.

    Evidence: source-2026-09-09-007

Sources

  1. arXiv preprint 2609.06128arXiv · primary research

Corrections

No corrections have been recorded for this story.