Member of Technical Staff, Cloud Orchestration
Join Inferact as a cloud orchestration engineer to build reliable systems for AI model deployment at scale.
Posted by employer 2 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 1 day ago
Requirements
- Education
- Bachelor's degree
- Visa
- Sponsorship available
Not disclosed in this posting: years of experience.
Benefits
Joblaze summary
In this role, the cloud orchestration engineer at Inferact is responsible for developing the systems that ensure the reliable operation of vLLM at scale, focusing on cluster management, deployment automation, and production monitoring. Key skills include expertise in Kubernetes, proficiency in programming languages like Python or Go, and experience with GPU clusters across various cloud platforms. This position is ideal for someone with a strong technical background in cloud infrastructure and a passion for enhancing operational reliability in machine learning environments. Inferact, founded by the creators of vLLM, emphasizes innovation at the intersection of AI models and hardware.
Joblaze insights
- Listed 9 days ago on Joblaze — tracked directly from Inferact's career page.
- Inferact has 24 other open roles including HR / People Lead, Head of Legal, Inference Engineering, Co-op.
- 6536 active Python roles on Joblaze right now.
- 2739 active AWS roles on Joblaze right now.
- 2580 active Kubernetes roles on Joblaze right now.
- Pays more than 48% of the 3233 salaried Python roles we track (median $160,000). See Python salary trends
Quick facts
- Is the Member of Technical Staff, Cloud Orchestration role remote?
- No — this is an on-site role in Singapore.
- What's the salary range?
- Inferact lists SGD 200,000–SGD 400,000 for this role.
- Where is the role based?
- Inferact is hiring for this position in Singapore.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AWS, Azure, GCP, Go, Helm, Kubernetes.
- Does Inferact sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Inferact targets staff-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Member of Technical Staff, Cloud Orchestration role at Inferact.
From the original posting
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong experience with Kubernetes and container orchestration at scale.
Experience designing and implementing custom Kubernetes operators.
Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
Experience managing GPU clusters and debugging hardware issues.
Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
Experience with ML-specific orchestration tools (Ray, Slurm).
Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
Familiarity with vLLM deployment patterns and configuration.
Track record of improving operational reliability for ML systems.
Bonus points if you have:
Experience deploying inference systems on large-scale GPU (1,000+) clusters.
Logistics
Location: This role is based in Singapore.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers a generous benefits package, including medical, dental, and vision coverage.