What needs to happen
Responses that stay open longer than fifteen seconds are cut off at the edge, and there is no field anywhere in the proxy API to change that. A user measuring a deliberately slow twenty-five second response saw it closed at about sixteen seconds with bytes still outstanding. That rules out server-sent events, streaming APIs and long-lived agent tool calls behind our edge today, which is an awkward gap for a platform positioning itself at agent workloads.
Why this matters
We advertise streaming-shaped protocol support, so people reasonably build on it and find the ceiling in production rather than in the docs. The user in question had to discover the limit by probing, then redesign around it. Either the limit should be raised and configurable, or it should be stated plainly enough that nobody builds a streaming feature before finding out.
Desired outcome
Related to datum-cloud/enhancements#292
What needs to happen
Responses that stay open longer than fifteen seconds are cut off at the edge, and there is no field anywhere in the proxy API to change that. A user measuring a deliberately slow twenty-five second response saw it closed at about sixteen seconds with bytes still outstanding. That rules out server-sent events, streaming APIs and long-lived agent tool calls behind our edge today, which is an awkward gap for a platform positioning itself at agent workloads.
Why this matters
We advertise streaming-shaped protocol support, so people reasonably build on it and find the ceiling in production rather than in the docs. The user in question had to discover the limit by probing, then redesign around it. Either the limit should be raised and configurable, or it should be stated plainly enough that nobody builds a streaming feature before finding out.
Desired outcome
Related to datum-cloud/enhancements#292