QCon AI New York 2025: AI Platform Scaling at LinkedIn
Briefly

QCon AI New York 2025: AI Platform Scaling at LinkedIn
"The presenters framed the core challenge as one of execution rather than intelligence. LinkedIn's approach separates human intent from machine execution, using structured specifications instead of free-form prompts. These specifications define what should happen, which tools may be used, how success is evaluated, and which actions are explicitly disallowed, reducing ambiguity that often leads to inconsistent or unsafe agent behavior."
"A central component of the system is an orchestration layer that manages agent execution end to end. Rather than running agents as single-shot interactions, the orchestrator decomposes work into steps, provisions isolated sandboxes, injects scoped context, invokes tools, and records detailed traces of every action taken. The presenters illustrated this with an example of upgrading a shared library across multiple repositories."
"The talk emphasized that orchestration enables determinism and repeatability in otherwise probabilistic systems. By standardizing how tools are invoked and how failures are handled, LinkedIn avoids a proliferation of bespoke, fragile agent implementations across teams. This shared execution model also makes agents observable and interoperable, allowing platform teams to evolve capabilities centrally while product teams benefit from reuse. Another theme was the distinction between autonomy and authority. Agents are allowed to act freely within bounded environments, such as reading and modifying code."
LinkedIn is building an internal platform to support AI agents at scale as participants in a governed execution environment for large, long-lived engineering organizations. The core challenge is framed as execution rather than intelligence. Human intent is separated from machine execution through structured specifications that define actions, allowed tools, success criteria, and disallowed behavior. An orchestration layer decomposes work into steps, provisions isolated sandboxes, injects scoped context, invokes tools, and records detailed traces. Orchestration enables determinism, repeatability, observability, and interoperability, while distinguishing agent autonomy within bounds from authority for irreversible or sensitive actions.
Read at InfoQ
Unable to calculate read time
[
|
]