Sarvam
Performance Engineer, On-Device Inference
Bengaluru, Karnataka, IN · On-site · FullTime
Apply on the employer’s site ↗See how well you match this job
You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.
Role details
- Employer posted
- Added to ROLIVA
- Last checked
- SourceSarvam careers page
Does the apply link above not work?
About the employer
- EmployerSarvam
- Open roles on ROLIVA59 open roles
- Where this posting comes fromListed on the employer’s own careers site: jobs.ashbyhq.com
About the role
Description from the employer’s posting. Check the employer’s page for the current version.
About Sarvam
Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.
About the Role
Take Sarvam models from research-handoff state to production-ready artifacts on at least two of our target chipsets (Intel xPU, ARM xPU, Apple xPU, Nvidia / AMD GPUs). You'll own 1 - 2 (model, chipset) pairs end-to-end and partner with the consuming app team during integration.
What You’ll Do
- Quantize, validate accuracy, benchmark, and document. Author the deployment workbook for each pair you own.
- Embed part-time with consuming teams during integration; debug perf and accuracy issues alongside them.
- Maintain and extend the team's benchmark harness.
What We're Looking For
- 3+ years on ML systems.
- Solid PyTorch + ONNX export experience including the gotchas (dynamic shapes, control flow, custom ops).
- Quantization in production on at least one real model.
- Comfort with at least two of: ONNX Runtime, TensorRT, CoreML, OpenVINO, QNN, LiteRT.
- Profiling fluency on at least one platform.
Bonus Points
- Custom op authoring in any runtime.
Why Sarvam?
Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.
- Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar
- High ownership and high impact, from day one
- Everything we do is AI-first, from the way we build and ship to the way we think about problems
- You can work on problems that could change how an entire country learns, works, and communicates
If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.
Staying safe while you apply
- Never pay to apply, interview or accept an offer — ROLIVA never asks you for payment to apply to a job.
- Apply only through the official button above, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
- Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.
Does something look wrong with this listing? Use “Report broken link” above, or read ROLIVA’s full job-safety guidance ↗.
Preparing for this role with ROLIVA
- Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
- Prepare honestly.
Build interview stories and application drafts from your own evidence.
- Keep track.
Save the role and record your own application status and follow-ups.