Ddn
Senior Software Engineering Manager – KV Cache Platform
Santa Clara, California, United States · Hybrid · FullTime
USD 225,000–275,000/year
Apply on the employer’s site ↗See how well you match this job
You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.
About the role
Description from the employer’s posting. Check the employer’s page for the current version.
- EmployerDdn
- LocationSanta Clara, California, United States
- Work styleHybrid
- Employment typeFullTime
- Employer posted
- Salary (as stated by the employer)USD 225,000 – 275,000 per year
DDN is seeking a Senior Software Engineering Manager to lead the engineering organization responsible for our KV Cache Platform—a distributed memory and storage platform that accelerates large-scale LLM inference across GPU clusters.
In this role, you will lead geographically distributed engineering teams responsible for building highly scalable, low-latency distributed systems that power AI inference. You will define the technical vision and execution strategy for the platform while partnering closely with Product Management, Sales, Customer Engineering, NVIDIA, and executive leadership to deliver innovative AI infrastructure that meets customer needs and supports DDN's long-term product strategy.
This is a highly visible leadership role with responsibility for engineering execution, customer success, roadmap delivery, and building a world-class engineering organization.
Show full description
Responsibilities
Lead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration.
Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence.
Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies.
Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments.
Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery.
Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness.
Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.
Qualifications
Required
15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software.
7+ years leading high-performing software engineering organizations, including geographically distributed teams.
Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment.
Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures.
Hands-on programming experience with Go and Python; experience with C/C++ is a plus.
Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations.
Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions.
Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure.
Background in HPC, distributed storage, networking, or enterprise infrastructure software.
Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.
Check your resume against this job Free, no sign-up. Nothing you paste is stored.
Staying safe while you apply
- Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
- Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
- Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.
Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.
Preparing for this role with ROLIVA
- Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
- Prepare honestly.
Build interview stories and application drafts from your own evidence.
- Keep track.
Save the role and record your own application status and follow-ups.
Engineering manager jobs in United States
ROLIVA currently lists 330 open roles like this in United States.
Employers hiring for this
- General Motors16 open roles
- Snowflake11 open roles
- Boeing10 open roles
- CrowdStrike7 open roles
- FMR7 open roles
Top skills asked for
Listings whose description mentions each term. A mention is not a requirement.
Advertised salary for this role here
These are advertised ranges, not what people are paid.
- USD a year, after annualising130,000–488,700 (51 listings, 20 employers)
At a glance
- Work styleHybrid
- Employment typeFullTime
- SenioritySenior
- Salary (as stated by the employer)USD 225,000–275,000 per year
- Employer posted
- Added to ROLIVA
- Last checked
Skills in this posting
Skills ROLIVA found in the employer’s own description above. A mention is not a requirement.