Member of Technical Staff, Cloud Orchestration
Join Inferact as a cloud orchestration engineer to build reliable systems for AI model deployment at scale.
Posted by employer 7 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 2 hours ago
Skills & Technologies
Requirements
- Education
- Bachelor's degree
- Visa
- Sponsorship available
Not disclosed in this posting: years of experience.
Benefits
Joblaze summary
In this role, the cloud orchestration engineer at Inferact is responsible for developing and maintaining the systems that ensure the reliable operation of vLLM at scale. Key skills include expertise in Kubernetes, container orchestration, and proficiency in programming languages like Python, Rust, or Go, along with experience in managing GPU clusters. This position is ideal for someone with a strong technical background and a focus on operational reliability, particularly in machine learning environments. Inferact, founded by the creators of vLLM, emphasizes innovation at the intersection of AI models and hardware.
Joblaze insights
- Listed 10 days ago on Joblaze — tracked directly from Inferact's career page.
- Inferact has 24 other open roles including IT Support & Operations Engineer, Head of Legal, Inference Engineering, Co-op.
- 6624 active Python roles on Joblaze right now.
- 2757 active AWS roles on Joblaze right now.
- 2606 active Kubernetes roles on Joblaze right now.
- Salary band is above the typical range for DevOps/SRE roles (median ~$165,000).
- Pays more than 79% of the 3275 salaried Python roles we track (median $160,000). See Python salary trends
Quick facts
- Is the Member of Technical Staff, Cloud Orchestration role remote?
- It's hybrid — Inferact expects some on-site time in San Francisco.
- What's the salary range?
- Inferact lists $200,000–$400,000 for this role.
- Where is the role based?
- Inferact is hiring for this position in San Francisco.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AWS, Azure, GCP, Go, Helm, Kubernetes.
- Does Inferact sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Inferact targets staff-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Member of Technical Staff, Cloud Orchestration role at Inferact.
From the original posting
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong experience with Kubernetes and container orchestration at scale.
Experience designing and implementing custom Kubernetes operators.
Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Experience managing GPU clusters and debugging hardware issues.
Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
Experience with ML-specific orchestration tools (Ray, Slurm).
Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
Familiarity with vLLM deployment patterns and configuration.
Track record of improving operational reliability for ML systems.
Bonus points if you have:
Experience deploying inference systems on large-scale GPU (1,000+) clusters.
Logistics
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.