Senior Platform Engineer
Lead development of DataHub's ingestion framework as a Senior Platform Engineer in a hybrid role based in Palo Alto.
Posted by employer 6 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 1 day ago
Skills & Technologies
AI in the day-to-day
Your code will determine how safely and effectively thousands of organizations deploy AI.
Requirements
- Experience
- 4+ years
Not disclosed in this posting: visa sponsorship.
Benefits
Joblaze summary
In this role, the Senior Platform Engineer at DataHub focuses on developing a robust ingestion framework that integrates various data systems to enhance metadata collection. The position requires advanced Python skills, experience in building distributed systems, and a strong understanding of API design and data processing frameworks. Ideal candidates will have a background in high-scale data environments and a track record of addressing complex technical challenges. DataHub is positioned at a pivotal moment in the AI infrastructure space, making this an opportunity to contribute to impactful projects.
Joblaze insights
- Listed 9 days ago on Joblaze — tracked directly from DataHub's career page.
- DataHub has 8 other open roles including DevOps, Senior Software Engineer/ Tech lead - SaaS Platform & Product, OSS Product, Staff, Backend Engineer - Catalog.
- 6517 active Python roles on Joblaze right now.
- 399 active API roles on Joblaze right now.
- 18 active event-driven architecture roles on Joblaze right now.
- Salary band is above the typical range for Data Engineering roles (median ~$180,656).
- Pays more than 90% of the 3224 salaried Python roles we track (median $160,000). See Python salary trends
Quick facts
- Is the Senior Platform Engineer role remote?
- It's hybrid — DataHub expects some on-site time in Palo Alto, California, United States.
- What's the salary range?
- DataHub lists $225,000–$300,000 for this role.
- How much experience is required?
- At least 4 years of relevant experience for this Senior Platform Engineer role.
- Where is the role based?
- DataHub is hiring for this position in Palo Alto, California, United States.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: API, Python, event-driven architecture, metadata management.
- What seniority level is this role?
- DataHub targets senior candidates for this position.
- Is this full-time or contract?
- Full-time for this Senior Platform Engineer role at DataHub.
From the original posting
DataHub is an AI & Data Context Platform adopted by over 3,000 enterprises, including Apple, CVS Health, Netflix, and Visa. Innovated jointly with a thriving open-source community of 13,000+ members, DataHub's metadata graph provides in-depth context of AI and data assets with best-in-class scalability and extensibility.
The company's enterprise SaaS offering, DataHub Cloud, delivers a fully managed solution with AI-powered discovery, observability, and governance capabilities. Organizations rely on DataHub solutions to accelerate time-to-value from their data investments, ensure AI system reliability, and implement unified governance, enabling AI & data to work together and bring order to data chaos.
The Challenge
As AI and data products become business-critical, enterprises face a metadata crisis:
- No unified way to track the complex data supply chain feeding AI systems
- Engineering teams struggling with data discovery, lineage, and governance
- Organizations needing machine-scale metadata management, not just human-browsable catalogs
Why This Matters
This is where infrastructure meets impact. The metadata layer you'll build will directly power the next generation of AI systems at massive scale. Your code will determine how safely and effectively thousands of organizations deploy AI, affecting millions of users worldwide.
The Role
We're looking for an exceptional Python engineer to lead development of DataHub's ingestion framework – the core that connects diverse data systems and powers our metadata collection capabilities.
You'll Build
- Scalable, fault-tolerant ingestion systems for enterprise-scale metadata
- Clean, intuitive APIs for our connector ecosystem
- Event-driven architectures for real-time metadata processing
- Schema mapping between diverse systems and DataHub's unified model
- Versioning systems for AI assets (training data, model weights, embeddings)
You Have
- 4+ years building production-grade distributed systems
- Advanced Python expertise with a focus on API design
- Experience with high-scale data processing or integration frameworks
- Strong systems knowledge and distributed architecture experience
- A track record of solving complex technical challenges
Bonus Points
- Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)
- Open-source contributions
- Early-stage startup experience
Location and Compensation
Bay Area (hybrid, 3 days in Palo Alto office)
Salary Range: $225,000 to $300,000
DataHub is an equal opportunity employer committed to workplace diversity and inclusion. We provide equal employment opportunities to all employees and applicants without regard to race, religious creed, color, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, age, sexual orientation, military and veteran status, or any other characteristic protected by federal, state, or local law.
Benefits and Perks
We invest in people so they can do their best work and enjoy doing it. Our benefits reflect the way we build: practical, thoughtful, and designed to support long-term growth.
Competitive compensation
We offer salaries that reflect your skills, experience, and the impact you make. You bring value—we make sure you're recognized for it.
Equity for everyone
Every team member receives an ownership stake in the company. When we grow, you grow with us.
Remote Work
All roles are remote unless otherwise specified in the job description. Review the job description to confirm if the role you are interested in is remote or hybrid.
Location flexibility
Home office, coworking space, or something in between? We support your ideal setup. You’ll receive a monthly coworking stipend to use whenever you need a change of pace or in-person collaboration time.
Comprehensive health coverage
Your well-being matters. We cover 99% of medical, dental, and vision premiums employees, and 65% for dependents.
Flexible savings accounts
We offer FSAs to help cover planned or unexpected healthcare costs. You can also opt into a Dependent Care FSA to support family needs.
Support for every path to parenthood
Through Carrot Fertility, we provide inclusive fertility benefits and family-forming support. All U.S. employees have access, regardless of age, gender identity, or family structure.
Time off that works for you
We trust you to take the time you need. Our unlimited PTO and sick leave policy is designed for flexibility, rest, and real life.
Why Join Us
DataHub is at a rare inflection point: we’ve achieved product-market fit, earned the trust of leading enterprises, and secured backing from top-tier investors like Bessemer Venture Partners and 8VC. The context platform market is expected to grow from $1B to $9B in the next five years—and we’re leading the way.
By joining our team, you’ll:
- Tackle high-impact challenges at the heart of enterprise AI infrastructure
- Ship production systems that power real-world use cases at global scale
- Collaborate with a high-caliber team of builders who’ve scaled some of the most influential data tools in the world
- Build the next generation of AI-native data systems, including conversational agents, intelligent classification, automated governance, and more
If you're passionate about technology, enjoy working with customers, and want to be part of a fast-growing company changing the industry, we want to hear from you!