← Back to results

Performance Engineer, On-Device Inference

Join Sarvam AI as a Performance Engineer to optimize AI models for production on various chipsets, impacting India's AI landscape.

Location
Bengaluru
Compensation
Not disclosed
Level
mid
Type
full time

Posted by employer 3 months ago

First seen on Joblaze 1 week ago

Last verified on the company career page 1 day ago

AI in the day-to-day

Sarvam is building a full-stack sovereign AI platform focused on making AI genuinely work for India.

Requirements

Experience
3+ years

Not disclosed in this posting: compensation, work arrangement, visa sponsorship.

Joblaze summary

In this role, the Performance Engineer focuses on transforming Sarvam's AI models into production-ready artifacts for various chipsets, ensuring they meet performance and accuracy standards. Key skills include expertise in PyTorch, ONNX, and quantization techniques, along with experience in profiling and debugging across multiple platforms. This position is ideal for professionals with over three years of experience in machine learning systems who thrive in a fast-paced, high-impact environment. Sarvam's team is characterized by a strong emphasis on collaboration and high standards, making it a compelling place for those passionate about advancing AI in India.

Joblaze insights

Quick facts

How much experience is required?
At least 3 years of relevant experience for this Performance Engineer, On-Device Inference role.
What's the tech stack?
Joblaze extracted these technologies from the posting: CoreML, LiteRT, ONNX, ONNX Runtime, OpenVINO, PyTorch.
What seniority level is this role?
Sarvam AI targets mid-level candidates for this position.
Is this full-time or contract?
Full-time for this Performance Engineer, On-Device Inference role at Sarvam AI.

From the original posting

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

Take Sarvam models from research-handoff state to production-ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You'll own 1 - 2 (model, chipset) pairs end-to-end and partner with the consuming app team during integration.

What You’ll Do

  • Quantize, validate accuracy, benchmark, and document. Author the deployment workbook for each pair you own.

  • Embed part-time with consuming teams during integration; debug perf and accuracy issues alongside them.

  • Maintain and extend the team's benchmark harness.

What We're Looking For

  • 3+ years on ML systems.

  • Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops).

  • Quantization in production on at least one real model.

  • Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT.

  • Profiling fluency on at least one platform.

Bonus Points

  • Custom op authoring in any runtime.

Why Sarvam?

Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

  • Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar

  • High ownership and high impact, from day one

  • Everything we do is AI-first, from the way we build and ship to the way we think about problems

  • You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.

 
 
 
 
 
 

Similar positions