Senior Software Engineer - ML Ops

If you are interested in the opportunity to pursue purposeful work, join a mission-driven team, and build a rewarding career while having fun, Truveta may be the perfect fit for you.

This Opportunity

If you are seeking a sense of purpose in your software job and are motivated by solving computing problems that can have a direct impact on people’s lives, then we have opportunities for you in an exciting startup environment.

We are looking for a Senior Engineer to participate in note processor. This role requires deep technical expertise in cloud-native infrastructure, distributed systems, as well as strong product thinking. You will partner closely with Compute Platform, security, ML engineering, and applied AI teams to understand business needs, define platform requirements, and build self-service capabilities that help teams move quickly and safely. Success in this role will directly influence how Truveta delivers data at using AI development and tools.

Responsibilities

• Leverage software engineering skills to build and deliver reliable, secure and scalable software solutions using modern cloud-based paradigms across different components in Truveta.
• Collaborate closely with partner teams inside & outside of Truveta.
• Show creativity and curiosity to build integration proof of concepts across the Truveta and partner ecosystems.
• Bring your curiosity, entrepreneurial spirit, and passion to deliver on the promise of technology in the difficult, competitive, and exciting industry of healthcare.

We are seeking software engineers who:

• Have proven experience designing and building reliable, secure, and scalable software solutions using modern cloud-based architectures and engineering practices.
• Have hands-on experience with machine learning infrastructure, including scaling GPU resources to optimize model throughput, performance, and efficiency at scale.
• Are familiar with vLLM and GPU optimization techniques, with an understanding of how to maximize compute utilization and improve inference performance.
• Have experience working with large language models (LLMs), generative AI, and related applications.
• Have experience deploying and operating large-scale machine learning models in production environments.
• Ideally, have prior experience building or working with agentic AI platforms and systems.
• Are quick learners who can iterate on and evolve distributed software systems while thoughtfully balancing privacy, security, reliability, and rapidly changing product requirements.
• Have strong knowledge of distributed systems, data pipelines, APIs, and data consumption experiences, with experience designing and building these systems at scale.
• Demonstrate a strong commitment to the Truveta principles and to advancing responsible and ethical innovation.
• Are committed to ongoing learning and training in critical areas such as privacy, ethics, and security.

Key Qualifications:

• 5+ years of experience building production quality software in a team setting.
• 2+ years of experience working on modern cloud-native platforms and languages (AWS, GCP, Azure)
• Some familiarity with crafting modular APIs and building engaging and intuitive web experiences.
• B.S. or M.S. in Computer Science or related field.

Why Truveta?

Be a part of building something special. Now is the perfect time to join Truveta. We have strong, established leadership with decades of success. We are well-funded. We are building a culture that prioritizes people and their passions across personal, professional, and everything in between. Join us as we build an amazing company together.

We Offer:

• Interesting and meaningful work for every career stage
• Great benefits package
• Comprehensive benefits with strong medical, dental and vision insurance plans
• 401K plan
• Professional development & training opportunities for continuous learning
• Work/life autonomy via flexible work hours and flexible paid time off
• Generous parental leave
• Regular team activities (virtual and in-person)
• The base pay for this position is $155,000 to $190,000. The pay range reflects the minimum and maximum target. Pay is based on several factors including location and may vary depending on job-related knowledge, skills, and experience. Certain roles are eligible for additional compensation such as incentive pay and stock options.

If you are based in California, we encourage you to read this important information for California residents linkedhere.

Truveta is committed to creating a diverse, inclusive, and empowering workplace. We believe that having employees, interns, and contractors with diverse backgrounds enables Truveta to better meet our mission and serve patients and health communities around the world. We recognize that opportunities in technology historically excluded and continue to disproportionately exclude Black and Indigenous people, people of color, people from working class backgrounds, people with disabilities, and LGBTQIA+ people. We strongly encourage individuals with these identities to apply even if you don’t meet all of the requirements.

Please note that all applicants must be authorized to work in the United States for any employer as we are unable to sponsor work visas or permits (e.g. F-1 OPT, H1-B) at this time. We appreciate your interest in the position and encourage you to explore future opportunities with us.