Agent harnesses (the control loops driving LLMs) can run inside a sandbox container or outside on a backend API. The inside model is simpler for single-user agents but creates multi-user filesystem distribution problems; the outside model keeps credentials out of the sandbox and enables efficient resource usage but requires solving durable execution, cold-start latency, and distributed filesystem problems for multi-user scenarios.
Infrastructure
The agent harness belongs outside the sandbox
Agent harnesses should run on backend infrastructure rather than sandboxes to avoid multi-user filesystem distribution problems, trading that complexity for durable execution and cold-start latency challenges.
Sunday, May 3, 2026 12:00 PM UTC2 MIN READSOURCE: Hacker NewsBY sys://pipeline
Tags
infrastructure