Join Inferact as a staff engineer to build distributed systems for AI inference at global scale.
Posted by employer 2 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 6 hours ago
Skills & Technologies
Requirements
- Education
- Bachelor's degree
- Visa
- Sponsorship available
Not disclosed in this posting: years of experience.
Benefits
Joblaze summary
In this role, the engineer focuses on developing the distributed systems that underpin vLLM's AI inference capabilities, ensuring efficient model deployment across numerous accelerators. Proficiency in systems programming languages like Rust, Go, or C++ is essential, along with experience in high-performance distributed systems and network protocols. This position is ideal for someone with a strong technical background and a passion for enhancing system reliability and performance at scale. Inferact, founded by the original creators of vLLM, is positioned at the forefront of AI infrastructure innovation.
Joblaze insights
- Listed 10 days ago on Joblaze — tracked directly from Inferact's career page.
- Inferact has 24 other open roles including IT Support & Operations Engineer, Head of Legal, Inference Engineering, Co-op.
- 1997 active Go roles on Joblaze right now.
- 1680 active C++ roles on Joblaze right now.
- 776 active Rust roles on Joblaze right now.
- Pays more than 44% of the 978 salaried Go roles we track (median $164,200). See Go salary trends
Quick facts
- Is the Member of Technical Staff, Performance and Scale role remote?
- No — this is an on-site role in Singapore.
- What's the salary range?
- Inferact lists SGD 200,000–SGD 400,000 for this role.
- Where is the role based?
- Inferact is hiring for this position in Singapore.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: C++, GPU programming, Go, Infiniband, NVLink, RoCE.
- Does Inferact sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Inferact targets staff-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Member of Technical Staff, Performance and Scale role at Inferact.
From the original posting
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We're looking for an infrastructure engineer to build the distributed systems that power inference at global scale. You'll design and implement the foundational layers that enable vLLM to serve models across thousands of accelerators with minimal latency and maximum reliability. Tomorrow, deploying a frontier model at scale should be as straightforward as spinning up a serverless database. The complexity doesn't disappear as it gets absorbed into the infrastructure you're building.
Skills and Qualifications
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong systems programming skills in Rust, Go, or C++.
Experience designing and building high-performance distributed systems at scale.
Understanding of network protocols and high-performance I/O.
Ability to debug complex distributed systems issues.
Preferred qualifications:
Experience with ML serving infrastructure and disaggregated inference architecture.
Familiarity with GPU programming models and memory hierarchies.
Knowledge of GPU interconnects (NVLink, InfiniBand, RoCE) and their performance characteristics.
Track record of improving system reliability and performance at scale.
Bonus points if you have:
Prior experience in supporting large‑scale model training or inference environments.
Logistics
Location: This role is based in Singapore.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits: Inferact offers a generous benefits package, including medical, dental, and vision coverage.