Nebius

Senior Software Engineer (Serverless)

Amsterdam, Netherlands; London, United Kingdom · Work style not stated

Apply on the employer’s site ↗See how well you match this job

You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.

About the role

Description from the employer’s posting. Check the employer’s page for the current version.

  • EmployerNebius
  • LocationAmsterdam, Netherlands; London, United Kingdom
  • Work styleWork style not stated
  • Employer posted

About Nebius:

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role

We're looking for a Senior Software Engineer to help us build Nebius Serverless AI — our GPU-native platform for deploying inference endpoints, batch jobs, and AI workloads without managing infrastructure. Customers run production AI on it today; the mission now is to make it the fastest, cheapest, most reliable place to ship GPU workloads on the planet.
This is a senior, high-ownership position on a fast-evolving service. You'll set the technical bar: own the architecture of the parts you ship, drive the hard design decisions, and raise the standard of everything around you through code reviews, design reviews, and the way you operate. The work is end-to-end — from cold-start latency in the runtime to the API contract customers integrate against.
You'll work from our office in Amsterdam or London, hybrid.

Show full description

In this position, your responsibility will be to:

  • Design and build core components of the Serverless platform — the control plane, scheduler, runtime, autoscaler, and the APIs customers integrate against.
  • Own the hardest engineering problems on the service: cold-start latency, GPU scheduling under contention, multi-tenant isolation, fair-share quotas, request routing at the edge.
  • Set the technical direction for the areas you own — drive architecture decisions, write the design docs, and align the team behind the chosen approach.
  • Raise the engineering bar across the team through code reviews, design reviews, and example — the kind of senior presence that compounds.
  • Run the service like an SRE: define SLOs, build observability, lead incident response, and make sure every postmortem changes the platform, not just the runbook.
  • Work directly with customers on architecture reviews, performance escalations, and the production problems that don't fit a ticket template.
  • Partner closely with Product, GTM, and infrastructure teams to translate customer needs into a coherent technical roadmap.

We expect you to have:

  • 7+ years of professional software engineering experience, with a track record of shipping production distributed systems at scale.
  • Excellent knowledge of Golang, or you are ready to quickly switch to it.
  • Deep experience with Kubernetes and container orchestration — you've operated it in anger, not just deployed it.
  • Strong distributed-systems instincts: consistency vs. availability trade-offs, queueing, backpressure, retries, idempotency, multi-tenancy.
  • Experience designing and operating high-throughput, low-latency services — you know where the milliseconds go and how to get them back.
  • A history of being the engineer others look to on hard problems — driving design discussions, unblocking teammates, and shipping the thing nobody else wanted to touch.
  • Ability to write reliable code and dig into complex problems.
  • Teamwork-oriented approach.

It would be an added bonus if you had:

  • Experience building serverless or function-as-a-service platforms (Knative, AWS Lambda, GCP Cloud Run, Cloudflare Workers, Modal, Replicate, Together, Fireworks, Anyscale, or similar).
  • GPU scheduling experience — Kubernetes device plugins, MIG, MPS, time-slicing, NVIDIA GPU Operator.
  • ML inference experience — vLLM, TensorRT-LLM, Triton Inference Server, SGLang, model loading and warm-pool strategies.
  • Cold-start optimization at the runtime, image, or snapshot level (FireCracker, gVisor, checkpoint/restore, image streaming).
  • Experience writing Kubernetes operators (Go + controller-runtime / kubebuilder).
  • Contributions to relevant open-source projects in the serverless, scheduling, or inference ecosystems.

We conduct coding interviews as part of the process.

Benefits & Perks:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

What's it like to work at Nebius:

Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.

If you need accommodations during the application process, please let us know.

Staying safe while you apply

  • Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
  • Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
  • Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.

Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.

Preparing for this role with ROLIVA

  • Check the fit.

    Compare the requirements with the experience you have confirmed, including gaps.

  • Prepare honestly.

    Build interview stories and application drafts from your own evidence.

  • Keep track.

    Save the role and record your own application status and follow-ups.

Create a free workspace or log in.

At a glance

  • SenioritySenior
  • Employer posted
  • Added to ROLIVA
  • Last checked

Skills in this posting

Skills ROLIVA found in the employer’s own description above. A mention is not a requirement.

AWS GCP Kubernetes LLM

Explore similar roles

Similar jobs