Member of Technical Staff, Cloud Orchestration (Remote)
Join Inferact as a cloud orchestration engineer to build reliable systems for AI model deployment at scale in a fully remote role.
Posted by employer 2 weeks ago
First seen on Joblaze 1 week ago
Last verified on the company career page 15 hours ago
Requirements
- Education
- Bachelor's degree
- Visa
- Sponsorship available
Not disclosed in this posting: compensation, years of experience.
Benefits
Joblaze summary
In this role, the cloud orchestration engineer at Inferact is responsible for developing the systems that ensure the vLLM AI inference engine operates smoothly at scale. Key skills include expertise in Kubernetes, container orchestration, and proficiency in programming languages like Python, Rust, or Go, along with experience in managing GPU clusters. This position is ideal for someone with a strong technical background in cloud infrastructure and a focus on operational reliability, particularly in machine learning environments. Inferact's team is composed of the original creators of vLLM, emphasizing a deep understanding of AI model deployment.
Joblaze insights
- Listed 10 days ago on Joblaze — tracked directly from Inferact's career page.
- Inferact has 24 other open roles including IT Support & Operations Engineer, Head of Legal, Inference Engineering, Co-op.
- 6615 active Python roles on Joblaze right now.
- 2601 active Kubernetes roles on Joblaze right now.
- 1992 active Go roles on Joblaze right now.
- Typical Python salary we track runs $125,000–$190,800 (median $160,000, across 3270 roles). See Python salary trends
Quick facts
- Is the Member of Technical Staff, Cloud Orchestration (Remote) role remote?
- Yes — Inferact lists this as a fully remote position.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: Go, Helm, Kubernetes, Python, Ray, Rust.
- Does Inferact sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Inferact targets staff-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Member of Technical Staff, Cloud Orchestration (Remote) role at Inferact.
From the original posting
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong experience with Kubernetes and container orchestration at scale.
Experience designing and implementing custom Kubernetes operators.
Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Experience managing GPU clusters and debugging hardware issues.
Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
Experience with ML-specific orchestration tools (Ray, Slurm).
Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
Familiarity with vLLM deployment patterns and configuration.
Track record of improving operational reliability for ML systems.
Bonus points if you have:
Experience deploying inference systems on large-scale GPU (1,000+) clusters.
Logistics
Location: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.
Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.