JobFount

Staff Software Engineer, Streaming Infrastructure

Airbnb · Software Engineering

Location
🇺🇸United States
Posted
(8 mo ago)
Field
Software Engineering

About the job

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

Airbnb’s Data Infrastructure organization builds the platforms that power data across the company. Within it, the Data Movement & Transformation (DMT) organization owns the platform that moves data between Airbnb’s online databases, event streams, and data warehouse, and transforms it along the way. Fraud prevention, real-time reporting, search, and AI products all depend on it.

Much of that data still moves through bespoke pipelines that each team builds and runs differently. We’re replacing them with one declarative, self-serve platform. You define your data once, and the platform provisions, runs, and evolves the pipelines that deliver it wherever it needs to go. Hundreds of production pipelines already run on it. Next, we’re bringing every data movement use case at Airbnb onto one platform, with a simpler architecture underneath and a single entry point for every engineer.

DMT is hiring Staff Software Engineers across four teams:

  • Data Frameworks: the declarative pipeline platform and its control plane, including runtime selection across streaming and batch, a growing library of source and sink connectors, and end-to-end lineage.
  • Ingestion: change data capture (CDC) and snapshot exports from Airbnb’s online databases into the warehouse, focused on data completeness and self-serve onboarding.
  • Realtime Data Infrastructure: the Kafka and Flink platforms that real-time data flows through, running on Kubernetes at Airbnb scale.
  • Schema Management: how schemas are defined, registered, and safely evolved across streaming, storage, and warehouse systems.

As a Staff Software Engineer, you’ll set technical direction for your area, stay hands-on in the code, and lead work that spans teams.

Examples of the Difference You’ll Make

  • Unify data movement at Airbnb. Shape the declarative platform that replaces bespoke pipelines across the company. Engineers define their data once, and the platform picks the right streaming or batch runtime and delivers it to every system that needs it.
  • Build the data foundation for AI. Airbnb’s AI and agent platforms are building on DMT instead of rolling their own pipelines. You’ll make sure fresh, trustworthy, well-documented data reaches them at the speed those products need.
  • Run real-time infrastructure that survives anything. Design Kafka and Flink platforms that keep serving through a full regional outage, fail over within minutes, and have no single points of failure at their core.
  • Make schemas a contract across every system. Build schema management where a change is validated and propagated end to end across streaming, storage, and warehouse systems, with no human in the loop.
  • Guarantee data correctness at scale. Make sure data arrives complete and accurate, with zero data loss, column-level lineage, and access controls the business relies on for fraud prevention, reporting, and compliance.
  • Make data infrastructure self-serve. Give every engineer at Airbnb a single entry point to move data, with onboarding measured in hours instead of days and AI-assisted tools for debugging and operations.
  • Raise the technical bar. Set direction through design reviews, lead incident follow-through, and grow the engineers around you.

Your Expertise

  • 9+ years of software engineering, including significant experience building and operating large-scale distributed systems, ideally data platforms or streaming infrastructure.
  • Deep expertise in at least one of the following areas, and comfort learning the others:
    • Kafka or a similar distributed log: partitioning, delivery semantics, replication, and multi-region operation
    • Stream or batch processing such as Flink or Spark: state management, checkpointing, and exactly-once processing
    • CDC and database replication: binlogs, snapshots, and correctness guarantees at scale
    • Schema and data contract systems: schema registries, Avro or Protobuf, and compatibility and evolution strategies
    • Control planes and platform APIs: declarative configuration, reconciliation, and Kubernetes operators
  • A track record of leading large migrations or platform consolidations, including getting other teams to adopt the new path and safely retiring the old one.
  • Strong production ownership: on-call, incident response, root cause analysis, and designing for availability and disaster recovery.
  • Ability to lead ambiguous, multi-quarter projects from design through production delivery.
  • Ability to set technical direction, write clear design docs, and explain tradeoffs to both infrastructure engineers and product or data teams.
  • Experience mentoring engineers and raising the technical bar of a team.
  • Strong collaboration and communication skills in a remote working environment.

Nice to have:
Iceberg or lakehouse table formats, running stateful systems on Kubernetes, and using AI tools in engineering and operations workflows.

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply.

We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@airbnb.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. 

We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application.

Equal Employment Opportunity:

Airbnb values diversity & belonging and is proud to be an Equal Employment Opportunity employer. All individuals seeking employment at Airbnb are considered without regard to race, color, religion, national origin, age, gender, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, gender expression, sexual orientation, or any other legally protected characteristic.

How We'll Take Care of You:

Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.  

Pay Range

$204,000—$255,000 USD

Reasonable Accommodations: We are committed to providing reasonable accommodations throughout the recruitment process for applicants with disabilities. If you need assistance, or an accommodation, please let your recruiter know once you are contacted about a role.

A Note on Recruiting Scams: Scammers sometimes pose as Airbnb recruiters to get money or personal information from candidates. A few things that will always be true for Airbnb’s hiring process: our open roles are posted on Airbnb’s Career’s Page at careers.airbnb.com, and our recruiters correspond only from @airbnb.com or @ext.airbnb.com email addresses. Our recruiters will never ask for your Social Security number, bank account details, passport, or payment app information while you are interviewing.  We’ll also never ask you to pay a fee, send money, deposit or cash a check, or purchase work-related equipment (such as a company laptop) during the interview process. We encourage candidates to remain vigilant of these recruiting scams and not share sensitive information if you do not believe an individual is actually affiliated with Airbnb.

Source: Airbnb’s careers page (via Greenhouse). You apply on the employer’s site.

Apply on Airbnb's site

Last checked today. Listings are removed once the employer closes them. Never pay to apply for a job.

More at Airbnb

All Airbnb jobs →

Similar jobs