Staff Software Engineer, Streaming Infrastructure

The Community You Will Join

Airbnb’s Data Infrastructure organization builds the platforms that power data across the company. Within it, the Data Movement & Transformation (DMT) pillar builds the platform that moves data between Airbnb’s storage engines and transforms it along the way.

Today, data moves through many bespoke, one-off pipelines that are built and maintained differently by each team. We’re replacing them with one unified, declarative platform. You define data once, and it is replicated everywhere it needs to go. This work underpins Airbnb’s Data as a Service initiative.

You’ll join the team that owns three connected layers of that platform:

• Control plane: the layer that turns declarative data definitions into running pipelines, including provisioning, runtime selection, and lifecycle management.
• Schema: how schemas are defined, tracked, and evolved safely across every system and engine.
• Realtime Data Infrastructure (RTDI): Kafka and the streaming transport layer that real-time data flows through at scale.

As a Staff Software Engineer, you’ll set technical direction across these layers and stay hands-on in the code.

Examples of the Difference You’ll Make

• Design and evolve the control plane that automatically provisions Kafka topics, registers schemas, and deploys pipelines from a declarative definition.
• Build schema management that makes evolution safe and backward compatible across streaming, storage, and warehouse systems.
• Improve the reliability, scalability, and cost efficiency of RTDI and Kafka at Airbnb’s scale, including capacity, multi-tenancy, and failure handling.
• Replace fragmented pipeline tooling with shared, self-serve platform abstractions that other teams adopt.
• Lead design reviews and incident follow-through, and raise the engineering and operational bar for the team.

Your Expertise

• 9+ years of software engineering, including significant experience building and operating large-scale distributed systems, ideally data platforms, event-driven systems, or streaming infrastructure.
• Hands-on experience with Kafka or a similar distributed log or messaging system, with a good understanding of partitioning, delivery semantics, throughput, and operational tradeoffs.
• Experience designing schema or data contract systems, such as schema registries, serialization formats like Avro or Protobuf, and compatibility and evolution strategies.
• Experience building control planes or platform APIs, such as declarative configuration, reconciliation, workflow orchestration, or resource provisioning, ideally on Kubernetes.
• Familiarity with stream processing (e.g., Flink) or change data capture is a plus.
• A track record of leading ambiguous, multi-quarter projects, taking them from design through delivery in production.
• Ability to set technical direction, write clear design docs, and align multiple teams, and to mentor and grow other engineers.
• Experience running large-scale systems in production, including on-call, incident response, and root cause analysis.
• Writes clean, testable, maintainable code.
• Strong collaboration and communication skills in a remote working environment.

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.