Senior Backend Engineer, Agent Infrastructure

The Role:

Airbyte is building the runtime that powers production-grade AI agents.

This is not an ML research or prompt engineering role. We’re looking for an experienced backend or platform engineer who has built complex production systems and has also worked hands-on with AI agents, orchestration, retrieval, or LLM-powered applications.

Our AI Runtime sits between language models and the enterprise systems agents need to understand and act on. It is responsible for assembling the right context, identifying entities across systems, selecting tools and connectors, coordinating execution, validating evidence, enforcing permissions, and handling failures safely.

A user may ask something simple like:

• “Investigate this customer and tell me what changed.”

Behind that request, the runtime may need to identify the customer across multiple systems, retrieve fresh data, determine which tools to call, coordinate multiple steps, validate the result, and return an answer with evidence the user can trust.

That infrastructure is what you’ll help build.

We’re still early. The architecture is taking shape, but there is significant room to influence how the runtime is designed, how developers interact with it, and how we make agentic systems reliable in production.

What You’ll Do:

Build the Runtime

• Design and implement the orchestration layer that turns natural-language intent into reliable, multi-step execution.

• Build systems for routing, state management, retries, failure handling, and long-running agent workflows.

• Develop systems for entity resolution, context assembly, connector orchestration, and evidence retrieval.

• Build reusable Skills that encapsulate business workflows and domain-specific capabilities.

• Coordinate connectors, APIs, tools, deterministic logic, retrieval systems, and multiple language models.

Build Reliable AI Infrastructure

• Design systems that retrieve and assemble the right enterprise context at runtime.

• Build evidence-backed reasoning with citations and traceability that users can inspect and verify.

• Implement permission models, freshness validation, and action policies for production environments.

• Build evaluation, replay, observability, and debugging systems that help us understand why agents succeed or fail.

• Improve the reliability of systems where model outputs may be probabilistic, but execution cannot be.

Own Products End to End

• Take ambiguous product ideas from prototype through production.

• Own features across architecture, implementation, rollout, and iteration.

• Work directly with Product, Design, Sales Engineering, Customer Success, and customers to understand real-world problems.

• Write high-leverage code that creates reusable infrastructure for future product areas.

• Experiment with new agent architectures while maintaining production-grade reliability.

What You’ll Need:

You may be a strong fit if you are fundamentally a backend or platform engineer who has also spent meaningful time building production AI systems.

• 7+ years of software engineering experience building and operating production systems.

• Strong backend engineering fundamentals and experience designing distributed systems.

• Experience building complex systems involving APIs, asynchronous workflows, concurrency, queues, state, retries, or distributed execution.

• Hands-on experience building production applications using LLMs, agents, RAG, tool calling, MCP, or similar technologies.

• Experience with orchestration systems, workflow engines, developer platforms, or infrastructure products.

• Strong system design skills and the ability to reason about reliability, scale, observability, and failure modes.

• Ability to move quickly from prototype to production without sacrificing engineering quality.

• Strong product instincts and comfort operating in ambiguous, 0-to-1 environments.

• Exceptional written communication skills.

• A strong bias toward ownership and shipping.

Nice To Have

• Experience building agent infrastructure, agent platforms, or evaluation systems.

• Familiarity with orchestration technologies such as LangGraph, Temporal, MCP, or similar.

• Experience with retrieval systems, vector search, search infrastructure, or knowledge graphs.

• Experience building developer tools or platform infrastructure.

• Experience with data infrastructure such as Kafka, Iceberg, Postgres, Spark, or modern data warehouses.

• Experience working on early-stage products where you helped define architecture and technical direction.

What Success Looks Like

Success is not measured by the sophistication of the prompts. It is measured by whether the runtime becomes more reliable, observable, and trustworthy over time.

You’ll build systems that:

• Assemble the right context and choose the correct connectors, tools, and Skills.

• Execute multi-step workflows reliably.

• Recover gracefully when something fails.

• Produce evidence-backed answers with citations and traceability.

• Enforce permissions, freshness guarantees, and action policies.

• Learn from failures through replay, evaluation, and observability.

• Allow users to focus on outcomes rather than coordinating individual tools themselves.

As the runtime evolves, developers and users should need to think less about the underlying tools and more about what they want to accomplish. The runtime should handle the complexity underneath.

Why This Role Matters

AI agents work impressively in demos. Making them reliable in production is much harder.

The difficult problems are often not the model itself. They are retrieving the right context, connecting to real enterprise systems, maintaining permissions, coordinating multiple actions, recovering from failures, and determining whether an answer can actually be trusted.

Airbyte already connects to hundreds of business systems. We’re building the runtime that allows agents to use that infrastructure intelligently and safely.

If we succeed, developers will not need to rebuild orchestration, retrieval, permissions, evaluation, and enterprise connectivity every time they build a new agent.

Location

• Onsite 4 days/week in San Francisco, CA

• Flexible PTO with a culture that encourages at least 25 days off annually

• 401(k) retirement plan

• Commuter benefits and monthly internet reimbursement