Litellm
Product Engineer
San Francisco, California, United States · On-site · FullTime
USD 200,000–260,000/year
Apply on the employer’s site ↗See how well you match this job
You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.
About the role
Description from the employer’s posting. Check the employer’s page for the current version.
- EmployerLitellm
- LocationSan Francisco, California, United States
- Work styleOn-site
- Employment typeFullTime
- Employer posted
- Salary (as stated by the employer)USD 200,000 – 260,000 per year
Product Engineer
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
Show full description
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Responsibilities
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
What We're Looking For
Bachelor's or Master's degree in Computer Science or a related field.
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Bonus Points
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
Check your resume against this job Free, no sign-up. Nothing you paste is stored.
Staying safe while you apply
- Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
- Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
- Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.
Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.
Preparing for this role with ROLIVA
- Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
- Prepare honestly.
Build interview stories and application drafts from your own evidence.
- Keep track.
Save the role and record your own application status and follow-ups.
Software engineer jobs in San Francisco
ROLIVA currently lists 227 open roles like this in San Francisco.
Employers hiring for this
- Harvey34 open roles
- Cursor23 open roles
- Notion16 open roles
- Hinge Health15 open roles
- Lambda14 open roles
Top skills asked for
Listings whose description mentions each term. A mention is not a requirement.
- Python104 postings
- TypeScript81 postings
- AWS74 postings
- React69 postings
- Kubernetes64 postings
- GCP43 postings
- LLM41 postings
- Java33 postings
Advertised salary for this role here
These are advertised ranges, not what people are paid.
- USD a year, after annualising120,000–465,000 (111 listings, 17 employers)
At a glance
- Work styleOn-site
- Employment typeFullTime
- Salary (as stated by the employer)USD 200,000–260,000 per year
- Employer posted
- Added to ROLIVA
- Last checked
Skills in this posting
Skills ROLIVA found in the employer’s own description above. A mention is not a requirement.